-- Logs begin at Fri 2021-10-15 03:01:50 UTC, end at Fri 2021-10-15 04:22:56 UTC. -- Oct 15 03:30:07.564750 dv-cinder-814100-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 15 03:30:07.577386 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 15 03:30:07.579339 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 15 03:30:07 2021] *** Oct 15 03:30:07.579339 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 15 03:30:07.579339 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 15 03:30:07.579339 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: nodename: dv-cinder-814100-1-iscsi Oct 15 03:30:07.579339 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: machine: x86_64 Oct 15 03:30:07.579339 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: clock source: unix Oct 15 03:30:07.579339 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: pcre jit disabled Oct 15 03:30:07.579339 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: detected number of CPU cores: 4 Oct 15 03:30:07.579339 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: current working directory: / Oct 15 03:30:07.579339 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: detected binary path: /usr/bin/uwsgi-core Oct 15 03:30:07.580059 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: your processes number limit is 47680 Oct 15 03:30:07.580059 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: your memory page size is 4096 bytes Oct 15 03:30:07.580059 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: detected max file descriptor number: 2048 Oct 15 03:30:07.580059 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: lock engine: pthread robust mutexes Oct 15 03:30:07.580059 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: thunder lock: enabled Oct 15 03:30:07.580059 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 15 03:30:07.580059 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 15 03:30:07.623832 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: Python main interpreter initialized at 0x55b965b1e9c0 Oct 15 03:30:07.623832 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: python threads support enabled Oct 15 03:30:07.623832 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: your server socket listen backlog is limited to 100 connections Oct 15 03:30:07.623832 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: your mercy for graceful operations on workers is 90 seconds Oct 15 03:30:07.624150 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: mapped 403077 bytes (393 KB) for 2 cores Oct 15 03:30:07.624227 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: *** Operational MODE: preforking *** Oct 15 03:30:07.624490 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: *** uWSGI is running in multiple interpreter mode *** Oct 15 03:30:07.624490 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: spawned uWSGI master process (pid: 99662) Oct 15 03:30:07.624671 dv-cinder-814100-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 15 03:30:07.625245 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: spawned uWSGI worker 1 (pid: 99663, cores: 1) Oct 15 03:30:07.627213 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: spawned uWSGI worker 2 (pid: 99664, cores: 1) Oct 15 03:30:07.627213 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 15 03:30:09.264015 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 03:30:09.264015 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: from cryptography.utils import int_from_bytes Oct 15 03:30:09.264567 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 03:30:09.264567 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: from cryptography.utils import int_from_bytes Oct 15 03:30:09.264723 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 03:30:09.264723 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: from cryptography.utils import int_from_bytes Oct 15 03:30:09.265171 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 03:30:09.265171 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: from cryptography.utils import int_from_bytes Oct 15 03:30:11.859841 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 15 03:30:11.860393 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 15 03:30:11.860557 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 15 03:30:11.860917 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 15 03:30:11.861334 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 15 03:30:11.861724 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.862054 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.862164 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 15 03:30:11.862506 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 15 03:30:11.862583 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.862687 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.862793 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 15 03:30:11.863014 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.863133 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 15 03:30:11.863337 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 15 03:30:11.863581 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.863763 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.863951 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.864189 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.864293 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.864373 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.864623 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.864718 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.864890 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.865047 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.865190 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.865336 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.865519 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-814100-1-iscsi {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.865623 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.865846 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.865940 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.866156 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.866250 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.866470 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.866577 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.866788 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.866881 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.867091 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.867195 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-814100-1-iscsi {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.867404 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.867509 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.867728 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.867823 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.868044 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.868233 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.868353 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.869383 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.869619 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.869849 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.870047 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.870288 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.870504 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.870804 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.871035 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.871243 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.871443 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.871653 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.871897 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.872112 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.872311 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.872521 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.872719 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.872931 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.873145 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.873353 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.873553 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.873762 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.873762 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.874149 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-814100-1-iscsi {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.874417 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.874591 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.874782 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.874965 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.874965 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.875226 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-814100-1-iscsi {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.875226 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.875530 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.875674 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.875848 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.875995 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.876165 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.876165 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.876451 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.876606 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.876755 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.876755 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.877022 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.877163 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.877306 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.877472 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.877614 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.877758 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.877895 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.878030 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.878175 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.878311 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.878457 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.878605 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.878743 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.878884 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.879020 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.879162 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.879493 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.879768 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.879914 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.880093 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.880265 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.880265 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.880542 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.880691 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.880922 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.880922 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.881198 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.881341 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.881487 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.881624 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.881765 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.881914 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.882057 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.882057 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.882338 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.882474 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.882610 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.882610 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.882869 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.883018 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.883157 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.883292 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.883434 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.883570 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.883872 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.884043 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.884190 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.884326 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.884556 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.884693 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.884837 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.884975 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.885109 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.885244 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.885378 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.885520 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.885668 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.885804 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.885950 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.886093 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.886230 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.886364 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.886513 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.886656 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.886791 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.886926 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.887061 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.887208 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.887353 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.887497 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.887633 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.887830 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.887968 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.888128 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.888766 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.890871 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.894117 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.894301 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.894470 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.894703 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.894854 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.894995 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.895134 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.895272 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.895423 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.895570 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.896257 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.896404 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.896724 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.896877 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.897030 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.897168 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.897304 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.897304 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.897568 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.897704 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.897847 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.898003 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.898140 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.898140 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.898407 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.898550 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.898699 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.898844 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.898980 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.899114 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.899256 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.899256 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.899528 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.899665 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.899841 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.900065 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.900208 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.900344 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.900497 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.900634 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.900770 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.900912 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.901048 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.901280 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.901431 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.901567 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.901704 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.901856 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.901993 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.902141 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.902284 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.902429 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.902573 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.902715 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.902852 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.903005 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.903150 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.903286 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.903428 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.903564 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.903740 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.903896 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.904034 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.904178 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.904323 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.904459 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.904593 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.904822 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.904967 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.905103 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.905247 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.905383 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.905518 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.905671 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.905808 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.905944 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.906079 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.906214 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.906348 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.906491 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.906635 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.906778 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.906914 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.907050 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.907192 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.907350 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.907488 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.907622 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.907781 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.907918 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.908054 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.908208 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.908356 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.908492 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.908627 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.908761 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.908905 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.909042 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.909189 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.909323 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.909458 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.909593 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.909736 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.909872 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.910006 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.910227 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.910370 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.910552 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.910702 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.910839 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.910974 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.911129 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.911285 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.911527 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.912437 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.912589 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.912726 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.912861 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.913003 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.913149 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.913294 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.913294 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.913724 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.913869 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:30:11.914016 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.914166 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.914311 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.914447 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.914582 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.914718 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.914939 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.915091 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.915228 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.915372 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.915519 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.915655 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.915827 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.915976 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.916113 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.916253 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.916390 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.916525 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.916668 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.916812 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.916955 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.917091 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.917233 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.917370 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.917514 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.917668 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.917804 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.917946 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.918089 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.918251 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.918405 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.918549 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.918685 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.918828 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.918971 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.919129 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.919274 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.919418 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.919603 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.919603 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.919887 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.920024 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.920177 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.920372 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.920515 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.920783 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.920952 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.921093 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.921242 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.921379 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.921533 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.921760 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.921927 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.922175 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.922346 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.922487 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.922622 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.922765 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.922902 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.923046 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.923183 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.923318 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.923454 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.923599 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.923850 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.924013 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.924152 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.924295 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.924431 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.924573 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.924709 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.924854 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.925075 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.925218 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.925355 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.925490 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.925635 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.925780 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.925917 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.926053 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.926188 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.926322 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.926466 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.926602 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.926745 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.926881 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.927046 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.927189 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.927337 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.927485 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.927627 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.927787 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.927926 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.928062 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.928220 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.928362 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.928498 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.928633 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.928768 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.928903 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.929048 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.929184 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.929331 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.929467 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.929602 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.929746 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.929883 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.930020 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.930162 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.930306 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.930442 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.930586 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.930723 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.930857 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.930993 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.931148 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.931285 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.931429 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.931574 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.931745 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.931969 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.932198 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.932338 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.932486 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.932715 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.932859 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.932996 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.933149 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.933288 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.933436 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.933580 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.933716 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.933869 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.934089 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.934312 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.934453 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.934589 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.934724 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.934868 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.935005 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.935244 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.935397 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.935535 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.935672 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.935835 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.936013 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.936176 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.936315 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.936451 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.936587 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.936730 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.936867 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.937012 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.937159 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.937305 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.937443 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.937579 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.937723 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.937867 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.938012 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.938155 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.938304 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.938448 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.938596 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.938740 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.938883 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.939030 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.939165 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.939308 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.939454 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.939599 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.939767 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.939923 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.940060 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.940204 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.940349 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.940493 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.940631 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.940776 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.940932 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.941070 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.941215 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.941352 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.941493 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.941637 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.941782 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.941944 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.942153 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.942302 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.942446 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.942583 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.942751 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.942908 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.943046 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.943182 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.943318 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.943454 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.943590 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.943826 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.943973 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.944192 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.944387 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.944530 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.944666 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.944816 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.944964 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.945101 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.945254 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.945460 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.945600 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.945750 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.945888 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.946024 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.946159 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.946294 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.946438 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.946575 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.946711 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.946856 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.946992 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.947128 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.947272 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.947415 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.947559 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.947715 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.947869 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.948007 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.948159 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.948300 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.948436 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.948589 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.948726 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.948862 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.949050 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.949192 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.949329 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.949471 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.949607 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.949743 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.949887 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.950025 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.950161 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.950296 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.950442 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.950587 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.950731 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.950867 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.951004 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.951139 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.951281 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.951429 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.951566 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.951720 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.951863 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.951999 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.952153 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.952382 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.952525 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.952669 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.952805 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.952940 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.953077 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.953227 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.953371 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.953507 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.953649 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.953785 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.953921 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.954066 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.954230 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.954434 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.954582 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.954719 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.954863 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.955007 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.955144 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.955280 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.955416 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.955639 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.955838 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.955978 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.956114 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.956271 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.956409 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.956544 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.956688 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.956825 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.956960 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.957103 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.957240 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.957376 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.957521 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.957657 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.957793 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.957935 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.958081 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.958742 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.958742 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.959011 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.959155 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.959291 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.959427 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.959576 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.959742 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.959885 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.960021 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.960157 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.960157 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.960432 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.960578 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.960725 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.960898 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.961041 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.961185 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.961331 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.961469 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.961605 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.961742 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.961878 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.962013 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.962221 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.962388 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.962597 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.962739 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.962876 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.963021 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.963160 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.963295 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.963431 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.963567 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.963733 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.963895 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.964039 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.964208 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.964546 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.964700 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.964851 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.965003 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.965148 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.965297 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.965447 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.965589 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.965816 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.965974 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.966118 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.966260 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.966419 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.966563 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.966714 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.966857 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.966998 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.967147 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.967298 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.967441 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.967591 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.967756 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.967907 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.968059 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.968213 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.968367 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.968518 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.968662 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.968812 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.968812 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.969081 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.969222 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.969378 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.969521 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.969662 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.969662 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.969930 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.970071 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.970236 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.970381 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.970778 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.970921 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.971069 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.971221 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.971364 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.971506 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.971661 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.971862 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.972005 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.972159 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.972313 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.972455 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.972614 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.972803 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.972953 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.973105 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.973249 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.973391 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.973533 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.973675 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.973824 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.974671 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.974827 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.974981 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.975126 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.975268 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.975418 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.975563 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.975725 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.975965 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.976117 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.976261 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.976417 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.976569 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.976721 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.976871 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.977031 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.977174 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.977317 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.977471 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.977627 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.977780 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.977930 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.978081 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.978241 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.978393 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.978536 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.978689 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.978835 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.978988 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.979130 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.979272 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.979422 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.979607 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.979816 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.979816 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.980098 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.980098 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.980387 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.980531 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.980675 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.980816 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.980969 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.981120 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.981275 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.981420 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.981570 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.981714 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.981855 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.981998 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.982153 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.982298 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.982442 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.982583 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.982739 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.982890 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.983034 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.983176 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.983318 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.983459 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.983601 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.983778 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.984042 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.984207 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.984353 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.984494 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.984784 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.984957 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.985103 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.985246 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.985395 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.985539 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.985681 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.985834 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.985997 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.986217 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.986366 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.986509 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.986659 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.986876 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.987033 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.987175 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.987317 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.987459 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.987610 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.987790 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.987936 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.988095 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.988243 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.988385 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.988536 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.988680 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.988830 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.988983 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.989125 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.989267 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.989417 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.989590 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.989735 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.989877 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.990019 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.990159 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.990310 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.990453 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.990602 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.990752 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.990912 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.991055 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.991206 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.991349 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.991490 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.991638 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.991814 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.991970 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.992113 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.992254 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.992402 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.992545 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.992686 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.992847 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.992992 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.993133 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.993274 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.993415 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.993564 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.993715 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.993859 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.994002 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.994150 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.994682 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.994985 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.995145 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.995302 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.995454 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.995598 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.995849 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.996013 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.996173 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.996413 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.996564 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.996707 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.996857 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.997010 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.997161 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.997312 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.997466 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.997609 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.997752 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.997903 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.998068 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.998218 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.998370 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.998513 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.998671 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.998847 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.998998 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.999148 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.999303 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.999446 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.999588 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.999759 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:11.999910 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.001483 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.001657 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.001817 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.001972 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.002117 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.002260 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.002405 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.002547 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.002703 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.002855 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.003011 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.003155 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.003296 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.003440 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.003581 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.004588 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.004750 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.005044 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.005226 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.005226 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.005226 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.005732 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.005732 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.005732 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.006128 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.006128 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.006413 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.006641 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.006791 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.006934 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.007075 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.007216 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.007216 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.007499 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.007661 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.007831 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.007974 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.008126 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.008280 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.008424 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.008573 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.008717 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.008858 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.008858 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.009134 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.009284 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.009426 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.009578 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.009722 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.009863 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.010013 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.010162 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.010304 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.010453 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.010631 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.010780 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.010931 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.011080 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.011223 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.011364 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.011516 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.011668 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.011871 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.012014 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.012165 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.012165 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.012442 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.012593 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.012737 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.012887 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.013036 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.013179 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.013320 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.013480 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.013630 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.013772 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.013924 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.014074 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.014224 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.014379 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.014522 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.014522 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.014791 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.014791 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.015219 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.015397 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.015542 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.015709 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.015860 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.015860 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.016153 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.016302 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.016445 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.016586 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.016815 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.016964 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.017116 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.017261 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.017415 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.017558 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.017699 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.017842 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.018073 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.018223 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.018372 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.018515 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.018657 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.018800 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.018951 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.019095 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.019238 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.019391 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.019534 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.019771 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.019937 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.020091 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.020237 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.020379 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.020529 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.021308 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.021475 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.021622 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.021764 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.021906 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.022060 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.022321 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.022487 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.022633 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.022784 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.022937 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.023081 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.023081 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.023361 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.023361 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.023631 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.023631 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.023949 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.024105 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.024248 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.024248 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.024527 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.024678 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.024830 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.024974 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.025255 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.025418 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.025565 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.025707 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.025862 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.026017 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.026166 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.026309 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.026451 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.026594 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.026802 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.027019 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.027169 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.027319 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.027462 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.027605 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.027820 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.027968 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.028123 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.028268 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.028418 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.028580 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.028727 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.028869 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.029012 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.029153 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.029295 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.029295 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.029574 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.029718 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.029860 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.030031 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.030184 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.030328 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.030470 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.030620 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.030765 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.030907 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.031049 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.031191 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.031339 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.031490 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.031634 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.031801 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.031960 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.032104 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.032246 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.032399 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.032543 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.032685 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.032828 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.032971 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.033125 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.033269 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.033411 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.033616 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.033774 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.033929 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.034082 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.034226 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.034368 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.034511 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.034653 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.034795 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.034951 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.035095 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.035372 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.035530 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.035674 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.035869 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.036027 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.036171 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.036315 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.037030 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.037249 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.037397 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.037555 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.037699 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.037842 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.037992 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.038143 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.038300 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.038462 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.038618 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.038763 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.038905 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.039054 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.039211 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.039356 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.039498 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.039640 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.039817 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.039962 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.040120 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.040266 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.040420 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.040563 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.040705 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.040848 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.040998 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.041143 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.041285 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.041427 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.041569 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.041721 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.041870 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.042014 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.042157 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.042310 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.042460 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.042612 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.042755 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.042897 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.043039 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.043181 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.043324 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.043479 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.043623 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.043801 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.043946 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.044088 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.044242 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.044402 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.044547 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.044689 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.044832 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.044974 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.045115 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.045271 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.045552 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.045703 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.045847 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.045996 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.046160 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.046313 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.046458 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.046602 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.046745 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.046894 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.047047 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.047191 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.047419 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.047571 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.047734 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.047885 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.048045 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.048207 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.048351 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.048501 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.048650 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.048798 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.048950 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.049129 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.049278 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.049422 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.049566 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.049718 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.049862 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.050005 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.050158 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.050301 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.050443 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.050599 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.050746 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.050889 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.051031 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.051174 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.051323 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.051475 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.051625 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.051824 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.051994 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.052686 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.052842 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.052996 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.053140 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.053283 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.053426 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.053568 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.053710 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.053866 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.054009 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.054152 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.054294 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.054438 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.054728 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.054885 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.055036 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.055180 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.055324 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.055603 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.055800 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.055981 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.056129 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.056271 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.056414 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.056564 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.056728 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.056874 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.057018 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.057160 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.057302 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.057538 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.057688 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.057831 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.057977 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.058120 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.058263 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.058462 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.058635 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.058779 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.058922 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.059067 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.059218 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.059362 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.059505 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.059653 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.059821 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.059965 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.060124 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.060279 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.060423 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.060566 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.060707 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.060858 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.061037 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.061186 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.061330 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.061472 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.061614 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.061765 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.061908 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.062050 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.062205 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.062347 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.062489 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.062644 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.062788 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.062930 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.063073 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.063217 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.063360 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.063511 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.063655 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.063856 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.064019 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.064165 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.064318 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.064461 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.064605 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.064754 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.064897 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.065039 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.065253 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.065401 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.065401 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.065810 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.065810 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.066100 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.066254 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.066400 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.066550 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.066693 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.066835 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.066986 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.067137 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.067281 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.067423 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.067703 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.068340 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.068506 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.068667 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.068811 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.068960 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.069104 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.069248 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.069399 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.069543 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.069685 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.069828 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.069970 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.070112 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.070263 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.070407 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.070561 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.070704 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.070846 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.070995 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.071147 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.071292 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.071435 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.071435 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.071762 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.071762 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.072057 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.072200 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.072354 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.072497 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.072648 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.072873 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.073019 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.073169 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.073313 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.073456 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.073598 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.073754 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.073898 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.074041 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.074191 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.074345 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.074496 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.074650 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.074802 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.074946 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.075088 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.075231 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.075382 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.075526 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.075669 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.075974 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.076126 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.076270 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.076435 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.076581 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.076724 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.076868 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.077012 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.077154 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.077310 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.077461 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.077604 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.077836 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.077985 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.078135 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.078288 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.078455 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.078604 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.078748 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.078891 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.079043 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.079187 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.079330 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.079472 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.079658 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.079829 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.079987 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.080132 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.080274 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.080427 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.080570 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.080720 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.080872 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.081017 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.081160 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.081303 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.081446 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.081588 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.081744 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.081888 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.082038 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.082182 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.082334 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.082485 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.082485 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.082766 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.082766 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.083037 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.083188 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.083369 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.083514 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.083665 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.083864 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.084026 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.084287 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.084466 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.084614 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.084764 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.084914 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.085067 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.085211 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.085364 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.085515 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.085658 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.085658 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.086076 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.086076 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.086389 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.086542 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.086687 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.086836 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.086979 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.087122 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.087273 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.087418 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.087561 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.087723 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.087953 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.088116 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.088269 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.088431 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.088586 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.088729 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.088881 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.089037 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.089188 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.089332 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.089476 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.089618 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.089761 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.089913 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.090058 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.090200 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.090353 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.090498 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.090649 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.090793 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.090935 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.091078 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.091220 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.091220 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.091503 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.091648 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.091838 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.091983 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.092136 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.092280 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.092435 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.092580 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.092723 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.092723 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.092992 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.093133 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.093288 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.093431 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.093574 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.093717 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.093860 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.094013 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.094165 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.094308 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.094453 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.094602 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.094746 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.094899 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.095069 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.095069 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.095357 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.095357 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.095911 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.096214 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.096374 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.096518 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.096661 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.096821 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.096974 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.097125 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.097276 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.097443 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.097590 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.097740 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.097894 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.097894 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.098269 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.098269 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.098570 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.098570 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.099364 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.099518 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.099662 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.099863 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.100038 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.100186 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.100342 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.100494 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.100651 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.100794 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.100939 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.101090 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.101235 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.101377 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.101765 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.101928 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.102075 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.102290 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.102437 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.102581 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.102724 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.102878 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.103023 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.103179 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.103323 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.103465 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.103608 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.103608 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.103922 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.104077 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.104249 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.104396 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.104539 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.104693 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.104845 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.104989 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.105171 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.105329 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.105480 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.105624 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.105776 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.105920 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.106069 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.106382 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.106534 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.106678 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.106842 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.106988 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.107132 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.107276 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.107418 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.107569 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.107755 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.107906 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.108050 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.108279 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.108444 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.108598 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.108761 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.108905 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.109060 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.109204 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.109347 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.109498 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.109642 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.109784 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.109961 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.110114 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.110268 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.110413 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.110557 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.110557 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.110557 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.110557 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.111146 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.111291 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.111291 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.111291 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.111291 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.111291 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.111291 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.111291 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.111291 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.112389 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.112389 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.112389 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 15 03:30:12.112798 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.112798 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.112798 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.112798 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.112798 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.112798 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.112798 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.112798 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.113857 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.113857 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.113857 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:30:12.113857 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 15 03:30:12.130211 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG oslo_db.sqlalchemy.engines [None req-28d48564-10e9-419e-a156-4a933d7c2f61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 03:30:12.134003 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_db.sqlalchemy.engines [None req-76f079dd-79f2-4165-9a85-d097b43acfe3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 03:30:12.304035 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.context [None req-28d48564-10e9-419e-a156-4a933d7c2f61 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43587adf-3b37-4daa-a785-c641cb70328e(cell1) {{(pid=99664) load_cells /opt/stack/nova/nova/context.py:464}} Oct 15 03:30:12.308426 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG oslo_concurrency.lockutils [None req-28d48564-10e9-419e-a156-4a933d7c2f61 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:30:12.309295 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.context [None req-76f079dd-79f2-4165-9a85-d097b43acfe3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43587adf-3b37-4daa-a785-c641cb70328e(cell1) {{(pid=99663) load_cells /opt/stack/nova/nova/context.py:464}} Oct 15 03:30:12.310015 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG oslo_concurrency.lockutils [None req-28d48564-10e9-419e-a156-4a933d7c2f61 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:30:12.310797 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG oslo_concurrency.lockutils [None req-28d48564-10e9-419e-a156-4a933d7c2f61 None None] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:30:12.312761 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG oslo_concurrency.lockutils [None req-28d48564-10e9-419e-a156-4a933d7c2f61 None None] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:30:12.313663 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-76f079dd-79f2-4165-9a85-d097b43acfe3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:30:12.315607 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-76f079dd-79f2-4165-9a85-d097b43acfe3 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:30:12.316947 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-76f079dd-79f2-4165-9a85-d097b43acfe3 None None] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:30:12.319095 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-76f079dd-79f2-4165-9a85-d097b43acfe3 None None] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:30:12.325714 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG oslo_db.sqlalchemy.engines [None req-28d48564-10e9-419e-a156-4a933d7c2f61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 03:30:12.329969 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG oslo_db.sqlalchemy.engines [None req-28d48564-10e9-419e-a156-4a933d7c2f61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 03:30:12.332279 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_db.sqlalchemy.engines [None req-76f079dd-79f2-4165-9a85-d097b43acfe3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 03:30:12.334956 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_db.sqlalchemy.engines [None req-76f079dd-79f2-4165-9a85-d097b43acfe3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 03:30:12.604881 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG oslo_db.sqlalchemy.engines [None req-28d48564-10e9-419e-a156-4a933d7c2f61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 03:30:12.606406 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_db.sqlalchemy.engines [None req-76f079dd-79f2-4165-9a85-d097b43acfe3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 03:30:12.948356 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: WARNING keystonemiddleware.auth_token [None req-28d48564-10e9-419e-a156-4a933d7c2f61 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 03:30:12.952203 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: WARNING keystonemiddleware.auth_token [None req-76f079dd-79f2-4165-9a85-d097b43acfe3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 03:30:12.954774 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: WARNING keystonemiddleware.auth_token [None req-28d48564-10e9-419e-a156-4a933d7c2f61 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 03:30:12.959213 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: WARNING keystonemiddleware.auth_token [None req-76f079dd-79f2-4165-9a85-d097b43acfe3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 03:30:13.300244 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: WARNING keystonemiddleware.auth_token [None req-28d48564-10e9-419e-a156-4a933d7c2f61 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 03:30:13.305380 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: WARNING keystonemiddleware.auth_token [None req-28d48564-10e9-419e-a156-4a933d7c2f61 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 03:30:13.305521 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: WARNING keystonemiddleware.auth_token [None req-76f079dd-79f2-4165-9a85-d097b43acfe3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 03:30:13.310665 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: WARNING keystonemiddleware.auth_token [None req-76f079dd-79f2-4165-9a85-d097b43acfe3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 03:30:13.311397 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b965b1e9c0 pid: 99664 (default app) Oct 15 03:30:13.313461 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-28d48564-10e9-419e-a156-4a933d7c2f61 None None] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:30:13.314621 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-28d48564-10e9-419e-a156-4a933d7c2f61 None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001709 Oct 15 03:30:13.315022 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Fri Oct 15 03:30:13 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:30:13.316767 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b965b1e9c0 pid: 99663 (default app) Oct 15 03:31:34.257351 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-28d48564-10e9-419e-a156-4a933d7c2f61 None None] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:31:34.258386 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-28d48564-10e9-419e-a156-4a933d7c2f61 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Oct 15 03:31:34.258967 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 930 bytes} [Fri Oct 15 03:31:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:31:34.715300 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-1e3b45b1-ad9a-4e3b-ba0d-6efaa42b2ec1 admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:31:34.747233 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-1e3b45b1-ad9a-4e3b-ba0d-6efaa42b2ec1 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.480647 Oct 15 03:31:34.748402 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1291 bytes} [Fri Oct 15 03:31:34 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:31:37.066286 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-28d48564-10e9-419e-a156-4a933d7c2f61 None None] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:31:37.067279 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-28d48564-10e9-419e-a156-4a933d7c2f61 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 15 03:31:37.067671 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 930 bytes} [Fri Oct 15 03:31:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:31:37.126979 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-d26250de-fe88-4b07-86da-767cfbd46ec6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "vcpus": 1, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0}} {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:31:37.145352 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:31:37.145352 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: warnings.warn(msg) Oct 15 03:31:37.175266 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-d26250de-fe88-4b07-86da-767cfbd46ec6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.100949 Oct 15 03:31:37.175898 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Oct 15 03:31:37 2021] POST /compute/v2.1/flavors => generated 407 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:31:37.397944 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-78fde13c-4eae-4ddb-b8d2-154038792421 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:31:37.400288 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:31:37.400288 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: warnings.warn(msg) Oct 15 03:31:37.452309 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-78fde13c-4eae-4ddb-b8d2-154038792421 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.267622 Oct 15 03:31:37.452949 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1335 bytes} [Fri Oct 15 03:31:37 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:31:39.749616 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-d26250de-fe88-4b07-86da-767cfbd46ec6 admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:31:39.750618 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-d26250de-fe88-4b07-86da-767cfbd46ec6 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 15 03:31:39.751195 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 930 bytes} [Fri Oct 15 03:31:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:31:39.870999 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-b32deef8-d5ff-4669-b552-3fbe9e4619be admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M"}} {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:31:39.889431 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:31:39.889431 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: warnings.warn(msg) Oct 15 03:31:39.909909 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-b32deef8-d5ff-4669-b552-3fbe9e4619be admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.152208 Oct 15 03:31:39.910700 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Oct 15 03:31:39 2021] POST /compute/v2.1/flavors => generated 404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:31:39.922920 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-129e4fce-00d6-4620-8834-5d25e8963ac7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:31:39.924420 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:31:39.924420 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: warnings.warn(msg) Oct 15 03:31:39.963795 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-129e4fce-00d6-4620-8834-5d25e8963ac7 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044179 Oct 15 03:31:39.964623 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1335 bytes} [Fri Oct 15 03:31:39 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:31:42.290847 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-b32deef8-d5ff-4669-b552-3fbe9e4619be admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:31:42.291867 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-b32deef8-d5ff-4669-b552-3fbe9e4619be admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 15 03:31:42.293181 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 930 bytes} [Fri Oct 15 03:31:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:31:42.368958 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-1abe2381-522f-4b0e-b755-0c6e42a7c9b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G"}} {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:31:42.401397 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-1abe2381-522f-4b0e-b755-0c6e42a7c9b3 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.097846 Oct 15 03:31:42.402249 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Oct 15 03:31:42 2021] POST /compute/v2.1/flavors => generated 404 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:31:42.416872 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-c96090d7-1595-4c70-b495-715e3aee6f27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:31:42.441846 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-c96090d7-1595-4c70-b495-715e3aee6f27 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028219 Oct 15 03:31:42.444082 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1335 bytes} [Fri Oct 15 03:31:42 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:31:44.749913 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-1abe2381-522f-4b0e-b755-0c6e42a7c9b3 admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:31:44.750906 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-1abe2381-522f-4b0e-b755-0c6e42a7c9b3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 15 03:31:44.751297 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 930 bytes} [Fri Oct 15 03:31:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:31:44.808043 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-4bfe8b05-a731-41ef-8414-44fb5e715d51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0}} {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:31:44.825100 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-4bfe8b05-a731-41ef-8414-44fb5e715d51 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.067072 Oct 15 03:31:44.825646 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Oct 15 03:31:44 2021] POST /compute/v2.1/flavors => generated 404 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:31:44.837657 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-6bfaf2fa-5a39-4616-8fbb-356ed2b64c6b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:31:44.860220 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-6bfaf2fa-5a39-4616-8fbb-356ed2b64c6b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026084 Oct 15 03:31:44.861240 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1335 bytes} [Fri Oct 15 03:31:44 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:31:47.146530 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-4bfe8b05-a731-41ef-8414-44fb5e715d51 admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:31:47.147535 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-4bfe8b05-a731-41ef-8414-44fb5e715d51 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 15 03:31:47.148140 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 930 bytes} [Fri Oct 15 03:31:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:31:47.207960 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-4c5e673b-61a5-4dab-9b90-f8c60cdaf417 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "ds4G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "id": "d4", "ram": 4096}} {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:31:47.228430 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-4c5e673b-61a5-4dab-9b90-f8c60cdaf417 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073985 Oct 15 03:31:47.228980 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Oct 15 03:31:47 2021] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:31:47.245029 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-4ddbc295-ef58-4e56-a7c2-12c5027a71e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:31:47.269677 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-4ddbc295-ef58-4e56-a7c2-12c5027a71e6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030913 Oct 15 03:31:47.270350 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1335 bytes} [Fri Oct 15 03:31:47 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:31:49.588521 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-4c5e673b-61a5-4dab-9b90-f8c60cdaf417 admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:31:49.590620 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-4c5e673b-61a5-4dab-9b90-f8c60cdaf417 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002965 Oct 15 03:31:49.591536 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 930 bytes} [Fri Oct 15 03:31:49 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:31:49.660458 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-b3ee62a6-1e62-43d7-afd2-bb9f4baba129 admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:31:49.684024 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-b3ee62a6-1e62-43d7-afd2-bb9f4baba129 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084687 Oct 15 03:31:49.684575 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1291 bytes} [Fri Oct 15 03:31:49 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:31:51.997907 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-4c5e673b-61a5-4dab-9b90-f8c60cdaf417 admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:31:51.998908 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-4c5e673b-61a5-4dab-9b90-f8c60cdaf417 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Oct 15 03:31:51.999465 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 930 bytes} [Fri Oct 15 03:31:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:31:52.057987 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-5b5eed70-9567-4cc7-ab7d-e59971d379af admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "id": "1", "swap": 0, "rxtx_factor": 1.0}} {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:31:52.076359 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-5b5eed70-9567-4cc7-ab7d-e59971d379af admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070491 Oct 15 03:31:52.076906 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Oct 15 03:31:52 2021] POST /compute/v2.1/flavors => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:31:52.089439 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-6faa3ed2-848e-47a0-90e4-955283035db6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:31:52.113435 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-6faa3ed2-848e-47a0-90e4-955283035db6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027006 Oct 15 03:31:52.114013 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1332 bytes} [Fri Oct 15 03:31:52 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:31:54.787951 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-5b5eed70-9567-4cc7-ab7d-e59971d379af admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:31:54.789281 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-5b5eed70-9567-4cc7-ab7d-e59971d379af admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001967 Oct 15 03:31:54.789844 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 930 bytes} [Fri Oct 15 03:31:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:31:54.852399 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-e9a865c8-7e03-4584-8d99-7b42a1b27dcc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "name": "m1.small"}} {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:31:54.870331 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-e9a865c8-7e03-4584-8d99-7b42a1b27dcc admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072204 Oct 15 03:31:54.870884 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Oct 15 03:31:54 2021] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:31:54.883603 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-77db2ec3-e8c1-46e0-a635-fde7958e2a4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:31:54.907958 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-77db2ec3-e8c1-46e0-a635-fde7958e2a4b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027827 Oct 15 03:31:54.908535 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1332 bytes} [Fri Oct 15 03:31:54 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:31:57.214449 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-e9a865c8-7e03-4584-8d99-7b42a1b27dcc admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:31:57.215480 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-e9a865c8-7e03-4584-8d99-7b42a1b27dcc admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 15 03:31:57.215922 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 930 bytes} [Fri Oct 15 03:31:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:31:57.275746 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-11869790-16ec-4f46-a959-930f66728b90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "id": "3", "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true}} {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:31:57.293483 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-11869790-16ec-4f46-a959-930f66728b90 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070887 Oct 15 03:31:57.294235 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Oct 15 03:31:57 2021] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:31:57.308057 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-94038e0c-6ad5-4538-8a40-a757be871277 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:31:57.332696 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-94038e0c-6ad5-4538-8a40-a757be871277 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028258 Oct 15 03:31:57.333273 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1332 bytes} [Fri Oct 15 03:31:57 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:31:59.664385 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-11869790-16ec-4f46-a959-930f66728b90 admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:31:59.664385 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-11869790-16ec-4f46-a959-930f66728b90 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Oct 15 03:31:59.665090 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 930 bytes} [Fri Oct 15 03:31:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:31:59.724137 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-f904bb45-7da4-48a4-b11a-09b497dfabd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "id": "4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:31:59.747794 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-f904bb45-7da4-48a4-b11a-09b497dfabd6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076452 Oct 15 03:31:59.748455 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Oct 15 03:31:59 2021] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:31:59.760371 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-6eb60ddd-aef3-4bc1-bde6-11bc49969f71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:31:59.786881 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-6eb60ddd-aef3-4bc1-bde6-11bc49969f71 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030001 Oct 15 03:31:59.788055 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1332 bytes} [Fri Oct 15 03:31:59 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:32:02.107091 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-f904bb45-7da4-48a4-b11a-09b497dfabd6 admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:02.108049 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-f904bb45-7da4-48a4-b11a-09b497dfabd6 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 15 03:32:02.108722 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 930 bytes} [Fri Oct 15 03:32:02 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:32:02.169743 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-4a12dcca-d129-4c97-a99b-4f05a1e4dd1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384, "disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "swap": 0}} {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:32:02.189244 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-4a12dcca-d129-4c97-a99b-4f05a1e4dd1b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073620 Oct 15 03:32:02.189921 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1282 bytes} [Fri Oct 15 03:32:02 2021] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:32:02.202929 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-171cc0c5-eca4-4f2d-96cb-f45e0c3e93bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:32:02.225782 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-171cc0c5-eca4-4f2d-96cb-f45e0c3e93bf admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026680 Oct 15 03:32:02.226429 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1332 bytes} [Fri Oct 15 03:32:02 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:32:41.125036 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-4a12dcca-d129-4c97-a99b-4f05a1e4dd1b admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:41.126060 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-4a12dcca-d129-4c97-a99b-4f05a1e4dd1b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Oct 15 03:32:41.126459 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 930 bytes} [Fri Oct 15 03:32:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:32:41.182139 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-1658b24e-cfae-46a4-a4f5-8807b2562ef4 admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:41.198364 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-1658b24e-cfae-46a4-a4f5-8807b2562ef4 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.065591 Oct 15 03:32:41.198888 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1291 bytes} [Fri Oct 15 03:32:41 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:32:42.716942 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-4a12dcca-d129-4c97-a99b-4f05a1e4dd1b admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:42.717933 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-4a12dcca-d129-4c97-a99b-4f05a1e4dd1b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Oct 15 03:32:42.718573 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Oct 15 03:32:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:32:42.910456 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-33370b96-023e-4414-9289-48d3565a6992 admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:42.918546 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.wsgi [None req-33370b96-023e-4414-9289-48d3565a6992 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 15 03:32:42.919120 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-33370b96-023e-4414-9289-48d3565a6992 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=99663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:32:42.919963 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-33370b96-023e-4414-9289-48d3565a6992 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060794 Oct 15 03:32:42.920475 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Fri Oct 15 03:32:42 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 15 03:32:42.930936 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-b4a237b5-cba0-4f50-bb7b-c52ad6a9115c admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:42.951329 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-b4a237b5-cba0-4f50-bb7b-c52ad6a9115c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023924 Oct 15 03:32:42.951902 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Oct 15 03:32:42 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:32:42.962411 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-51527660-8679-4e3c-a722-b04749d3c092 admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:42.983042 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-51527660-8679-4e3c-a722-b04749d3c092 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024077 Oct 15 03:32:42.983560 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Oct 15 03:32:42 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:32:42.993075 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-349c0a8a-3867-4057-bdef-e538c28ccf0e admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:42.998197 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.wsgi [None req-349c0a8a-3867-4057-bdef-e538c28ccf0e admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 15 03:32:42.998754 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-349c0a8a-3867-4057-bdef-e538c28ccf0e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=99664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:32:42.999523 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-349c0a8a-3867-4057-bdef-e538c28ccf0e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.009873 Oct 15 03:32:43.000036 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Fri Oct 15 03:32:42 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 15 03:32:44.396404 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-51527660-8679-4e3c-a722-b04749d3c092 admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:44.397421 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-51527660-8679-4e3c-a722-b04749d3c092 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 15 03:32:44.397809 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Oct 15 03:32:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:32:44.587139 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-0a20abc6-f658-4293-9104-723b231a050a admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:44.592761 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.wsgi [None req-0a20abc6-f658-4293-9104-723b231a050a admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 15 03:32:44.593574 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-0a20abc6-f658-4293-9104-723b231a050a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=99664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:32:44.594361 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-0a20abc6-f658-4293-9104-723b231a050a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057830 Oct 15 03:32:44.594852 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Fri Oct 15 03:32:44 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 15 03:32:44.604972 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-995cc478-5687-4891-9196-369ace3d64da admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:44.618671 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-995cc478-5687-4891-9196-369ace3d64da admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017165 Oct 15 03:32:44.619176 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Oct 15 03:32:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:32:44.628628 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-6ed6eb44-51a3-46f0-90b5-132f3da60bb4 admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:44.641514 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-6ed6eb44-51a3-46f0-90b5-132f3da60bb4 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016205 Oct 15 03:32:44.642024 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Oct 15 03:32:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:32:44.651590 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-73348e3a-f2b5-4e56-8a2e-40371a23775a admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:44.656502 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.wsgi [None req-73348e3a-f2b5-4e56-8a2e-40371a23775a admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 15 03:32:44.657067 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-73348e3a-f2b5-4e56-8a2e-40371a23775a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=99663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:32:44.657799 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-73348e3a-f2b5-4e56-8a2e-40371a23775a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009503 Oct 15 03:32:44.658268 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Fri Oct 15 03:32:44 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 15 03:32:46.057861 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-6ed6eb44-51a3-46f0-90b5-132f3da60bb4 admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:46.058851 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-6ed6eb44-51a3-46f0-90b5-132f3da60bb4 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Oct 15 03:32:46.059244 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Oct 15 03:32:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:32:46.248897 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-3deb83be-1e26-4639-863c-8433e2e5b980 admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:46.254417 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.wsgi [None req-3deb83be-1e26-4639-863c-8433e2e5b980 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 15 03:32:46.254970 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-3deb83be-1e26-4639-863c-8433e2e5b980 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=99663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:32:46.255777 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-3deb83be-1e26-4639-863c-8433e2e5b980 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058082 Oct 15 03:32:46.256270 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Oct 15 03:32:46 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 15 03:32:46.266007 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-d332790d-8d6a-4ce0-87f4-4eccf389cfc4 admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:46.279463 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-d332790d-8d6a-4ce0-87f4-4eccf389cfc4 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016972 Oct 15 03:32:46.279997 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Oct 15 03:32:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:32:46.290088 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-32eda265-83f4-42ef-bfb3-ff8585bcb84d admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:46.303066 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-32eda265-83f4-42ef-bfb3-ff8585bcb84d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016325 Oct 15 03:32:46.303576 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Oct 15 03:32:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:32:46.312798 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-ab2d2142-7206-4977-8c05-c7ebb65326b3 admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:46.317675 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.wsgi [None req-ab2d2142-7206-4977-8c05-c7ebb65326b3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 15 03:32:46.318228 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-ab2d2142-7206-4977-8c05-c7ebb65326b3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=99664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:32:46.318996 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-ab2d2142-7206-4977-8c05-c7ebb65326b3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009539 Oct 15 03:32:46.319471 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Oct 15 03:32:46 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 15 03:32:47.714606 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-32eda265-83f4-42ef-bfb3-ff8585bcb84d admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:47.715596 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-32eda265-83f4-42ef-bfb3-ff8585bcb84d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Oct 15 03:32:47.716018 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Oct 15 03:32:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:32:47.904605 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-0140ec5f-75cc-4e64-bdb5-7f6cfe9b1c73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:32:47.922446 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-0140ec5f-75cc-4e64-bdb5-7f6cfe9b1c73 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067471 Oct 15 03:32:47.922969 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Fri Oct 15 03:32:47 2021] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:32:49.322198 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-32eda265-83f4-42ef-bfb3-ff8585bcb84d admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:49.323197 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-32eda265-83f4-42ef-bfb3-ff8585bcb84d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001394 Oct 15 03:32:49.323585 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Oct 15 03:32:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:32:49.514559 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-16ef7aad-f297-4cc5-adf8-d05c681a2b72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:32:49.532070 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-16ef7aad-f297-4cc5-adf8-d05c681a2b72 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068633 Oct 15 03:32:49.532610 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Fri Oct 15 03:32:49 2021] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:32:50.924364 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-32eda265-83f4-42ef-bfb3-ff8585bcb84d admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:50.925388 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-32eda265-83f4-42ef-bfb3-ff8585bcb84d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 15 03:32:50.925779 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Oct 15 03:32:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:32:51.119226 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-0e36fbc7-e338-45f2-bee0-62522b4b1b70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:32:51.136849 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-0e36fbc7-e338-45f2-bee0-62522b4b1b70 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068195 Oct 15 03:32:51.137310 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Fri Oct 15 03:32:51 2021] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:32:52.562376 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-32eda265-83f4-42ef-bfb3-ff8585bcb84d admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:52.563406 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-32eda265-83f4-42ef-bfb3-ff8585bcb84d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Oct 15 03:32:52.563820 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Oct 15 03:32:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:32:52.751922 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-b99d3f32-8001-45dc-90f9-db9816ef3327 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:32:52.769792 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-b99d3f32-8001-45dc-90f9-db9816ef3327 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068015 Oct 15 03:32:52.770324 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Fri Oct 15 03:32:52 2021] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:32:54.177596 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-32eda265-83f4-42ef-bfb3-ff8585bcb84d admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:54.178586 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-32eda265-83f4-42ef-bfb3-ff8585bcb84d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001393 Oct 15 03:32:54.178971 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Oct 15 03:32:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:32:54.368652 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-f098c5d7-31e1-4341-93db-63c61c769c19 admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:32:54.387061 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-f098c5d7-31e1-4341-93db-63c61c769c19 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068465 Oct 15 03:32:54.387528 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Fri Oct 15 03:32:54 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:33:40.446373 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-32eda265-83f4-42ef-bfb3-ff8585bcb84d admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:33:40.447366 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-32eda265-83f4-42ef-bfb3-ff8585bcb84d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Oct 15 03:33:40.447995 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 930 bytes} [Fri Oct 15 03:33:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:33:40.505448 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-0afbe2e2-4892-4b5b-9e41-956ac1155911 admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:33:40.523831 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-0afbe2e2-4892-4b5b-9e41-956ac1155911 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.068972 Oct 15 03:33:40.524353 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1291 bytes} [Fri Oct 15 03:33:40 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:33:40.546730 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-55a9f1f9-f5f1-44d2-b2db-f4b94a73b5e4 admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:33:40.554779 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-55a9f1f9-f5f1-44d2-b2db-f4b94a73b5e4 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011551 Oct 15 03:33:40.555271 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1282 bytes} [Fri Oct 15 03:33:40 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:33:40.566815 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-a0f0f9ab-c05a-4f7e-a3bc-6a0530b723df admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:33:40.574028 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-a0f0f9ab-c05a-4f7e-a3bc-6a0530b723df admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010583 Oct 15 03:33:40.574531 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1285 bytes} [Fri Oct 15 03:33:40 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:33:40.585590 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-2a23d0ee-2a42-42ed-867f-ce1281911972 admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:33:40.592606 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-2a23d0ee-2a42-42ed-867f-ce1281911972 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010199 Oct 15 03:33:40.593364 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1285 bytes} [Fri Oct 15 03:33:40 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:33:40.606306 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-382561e0-47c5-4358-a2fa-1de43f80ac8e admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:33:40.614166 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-382561e0-47c5-4358-a2fa-1de43f80ac8e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011210 Oct 15 03:33:40.614674 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1282 bytes} [Fri Oct 15 03:33:40 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:35:01.447374 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-2b59c7fc-2288-4684-9409-b2ec753c8d64 tempest-verify_tempest_config-794808949 tempest-verify_tempest_config-794808949-project] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:35:01.449366 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-2b59c7fc-2288-4684-9409-b2ec753c8d64 tempest-verify_tempest_config-794808949 tempest-verify_tempest_config-794808949-project] 10.222.0.30 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.101882 Oct 15 03:35:01.449889 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 34/69] 10.222.0.30 () {58 vars in 1133 bytes} [Fri Oct 15 03:35:01 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:36:23.787104 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-382561e0-47c5-4358-a2fa-1de43f80ac8e admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:36:23.788145 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-382561e0-47c5-4358-a2fa-1de43f80ac8e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 15 03:36:23.788676 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 36/70] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Oct 15 03:36:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:36:24.048736 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-494a486e-e1e5-4ef1-9747-2351d81e870f admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:36:24.049861 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:36:24.049861 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: warnings.warn(msg) Oct 15 03:36:24.051351 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-494a486e-e1e5-4ef1-9747-2351d81e870f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:36:24.051811 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-494a486e-e1e5-4ef1-9747-2351d81e870f admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:36:24.052582 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-494a486e-e1e5-4ef1-9747-2351d81e870f admin admin] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:36:24.052998 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-494a486e-e1e5-4ef1-9747-2351d81e870f admin admin] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:36:24.084563 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-494a486e-e1e5-4ef1-9747-2351d81e870f admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.150988 Oct 15 03:36:24.085096 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 35/71] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Oct 15 03:36:23 2021] GET /compute/v2.1/os-services => generated 791 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:36:25.490696 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-382561e0-47c5-4358-a2fa-1de43f80ac8e admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:36:25.491718 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-382561e0-47c5-4358-a2fa-1de43f80ac8e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Oct 15 03:36:25.492114 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 37/72] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Oct 15 03:36:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:36:25.682708 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-97b2697b-99ac-423a-906f-73f9734cb663 admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:36:25.683878 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:36:25.683878 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: warnings.warn(msg) Oct 15 03:36:25.685373 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-97b2697b-99ac-423a-906f-73f9734cb663 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:36:25.686327 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-97b2697b-99ac-423a-906f-73f9734cb663 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:36:25.687123 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-97b2697b-99ac-423a-906f-73f9734cb663 admin admin] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:36:25.687545 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-97b2697b-99ac-423a-906f-73f9734cb663 admin admin] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:36:25.707064 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-97b2697b-99ac-423a-906f-73f9734cb663 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074463 Oct 15 03:36:25.707597 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 36/73] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Oct 15 03:36:25 2021] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:36:37.545633 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-382561e0-47c5-4358-a2fa-1de43f80ac8e admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:36:37.546604 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-382561e0-47c5-4358-a2fa-1de43f80ac8e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Oct 15 03:36:37.546999 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 38/74] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Oct 15 03:36:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:36:37.738199 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-c22d8551-94f5-4aa2-acda-cf7000deec91 admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:36:37.739320 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:36:37.739320 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: warnings.warn(msg) Oct 15 03:36:37.740871 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-c22d8551-94f5-4aa2-acda-cf7000deec91 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:36:37.741302 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-c22d8551-94f5-4aa2-acda-cf7000deec91 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:36:37.742072 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-c22d8551-94f5-4aa2-acda-cf7000deec91 admin admin] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:36:37.742488 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-c22d8551-94f5-4aa2-acda-cf7000deec91 admin admin] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:36:37.767639 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-c22d8551-94f5-4aa2-acda-cf7000deec91 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082016 Oct 15 03:36:37.768137 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 37/75] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Oct 15 03:36:37 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:36:39.185161 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: DEBUG nova.api.openstack.wsgi [None req-382561e0-47c5-4358-a2fa-1de43f80ac8e admin admin] Calling method '>' {{(pid=99664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:36:39.186662 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: INFO nova.api.openstack.requestlog [None req-382561e0-47c5-4358-a2fa-1de43f80ac8e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001901 Oct 15 03:36:39.187055 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: [pid: 99664|app: 0|req: 39/76] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Oct 15 03:36:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:36:39.377091 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG nova.api.openstack.wsgi [None req-e0b68330-30c8-4acf-bf7a-2de0e3743203 admin admin] Calling method '>' {{(pid=99663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:36:39.378247 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:36:39.378247 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: warnings.warn(msg) Oct 15 03:36:39.379764 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-e0b68330-30c8-4acf-bf7a-2de0e3743203 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:36:39.380201 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-e0b68330-30c8-4acf-bf7a-2de0e3743203 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:36:39.380968 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-e0b68330-30c8-4acf-bf7a-2de0e3743203 admin admin] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:36:39.381385 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: DEBUG oslo_concurrency.lockutils [None req-e0b68330-30c8-4acf-bf7a-2de0e3743203 admin admin] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:36:39.402638 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: INFO nova.api.openstack.requestlog [None req-e0b68330-30c8-4acf-bf7a-2de0e3743203 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076505 Oct 15 03:36:39.403094 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: [pid: 99663|app: 0|req: 38/77] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Oct 15 03:36:39 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:37:34.534972 dv-cinder-814100-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 15 03:37:34.535539 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: Fri Oct 15 03:37:34 2021 - graceful shutdown triggered... Oct 15 03:37:34.536054 dv-cinder-814100-1-iscsi devstack@n-api.service[99664]: Gracefully killing worker 2 (pid: 99664)... Oct 15 03:37:34.536416 dv-cinder-814100-1-iscsi devstack@n-api.service[99663]: Gracefully killing worker 1 (pid: 99663)... Oct 15 03:37:35.536748 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: worker 1 buried after 1 seconds Oct 15 03:37:35.536748 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: worker 2 buried after 1 seconds Oct 15 03:37:35.536748 dv-cinder-814100-1-iscsi devstack@n-api.service[99662]: goodbye to uWSGI. Oct 15 03:37:35.538224 dv-cinder-814100-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 15 03:37:35.538772 dv-cinder-814100-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 15 03:37:35.541618 dv-cinder-814100-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 15 03:37:35.551350 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 15 03:37:35.553382 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 15 03:37:35 2021] *** Oct 15 03:37:35.553382 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 15 03:37:35.553382 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 15 03:37:35.553382 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: nodename: dv-cinder-814100-1-iscsi Oct 15 03:37:35.553382 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: machine: x86_64 Oct 15 03:37:35.553382 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: clock source: unix Oct 15 03:37:35.553382 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: pcre jit disabled Oct 15 03:37:35.553382 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: detected number of CPU cores: 4 Oct 15 03:37:35.553382 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: current working directory: / Oct 15 03:37:35.553382 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: detected binary path: /usr/bin/uwsgi-core Oct 15 03:37:35.553382 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: your processes number limit is 47680 Oct 15 03:37:35.554067 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: your memory page size is 4096 bytes Oct 15 03:37:35.554067 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: detected max file descriptor number: 2048 Oct 15 03:37:35.554067 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: lock engine: pthread robust mutexes Oct 15 03:37:35.554067 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: thunder lock: enabled Oct 15 03:37:35.554067 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 15 03:37:35.554067 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 15 03:37:35.599158 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: Python main interpreter initialized at 0x562f14d119c0 Oct 15 03:37:35.599158 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: python threads support enabled Oct 15 03:37:35.599158 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: your server socket listen backlog is limited to 100 connections Oct 15 03:37:35.599158 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: your mercy for graceful operations on workers is 90 seconds Oct 15 03:37:35.599590 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: mapped 403077 bytes (393 KB) for 2 cores Oct 15 03:37:35.599590 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: *** Operational MODE: preforking *** Oct 15 03:37:35.599912 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: *** uWSGI is running in multiple interpreter mode *** Oct 15 03:37:35.599912 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: spawned uWSGI master process (pid: 120885) Oct 15 03:37:35.600115 dv-cinder-814100-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 15 03:37:35.600823 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: spawned uWSGI worker 1 (pid: 120897, cores: 1) Oct 15 03:37:35.601084 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: spawned uWSGI worker 2 (pid: 120899, cores: 1) Oct 15 03:37:35.601349 dv-cinder-814100-1-iscsi devstack@n-api.service[120885]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 15 03:37:37.401855 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 03:37:37.401855 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: from cryptography.utils import int_from_bytes Oct 15 03:37:37.402509 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 03:37:37.402509 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: from cryptography.utils import int_from_bytes Oct 15 03:37:37.420734 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 03:37:37.420734 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: from cryptography.utils import int_from_bytes Oct 15 03:37:37.421452 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 03:37:37.421452 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: from cryptography.utils import int_from_bytes Oct 15 03:37:39.939230 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 15 03:37:39.939899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 15 03:37:39.940004 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 15 03:37:39.940377 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 15 03:37:39.940637 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 15 03:37:39.941036 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.941364 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.941688 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.942010 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.942346 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.942680 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.942987 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.943313 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.943644 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.943997 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.944246 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.944574 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-814100-1-iscsi {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.944907 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.945219 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.945535 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.945870 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.946180 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.946503 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.946817 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.947325 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.948097 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.948414 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.948838 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.949196 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.949515 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.949831 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.950159 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.950501 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.950839 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.951159 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.951570 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-814100-1-iscsi {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.951923 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.952252 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.952572 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.952989 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.953319 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.953635 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.953947 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.954320 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.954614 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.954960 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.955272 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.955596 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.955956 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.956265 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.956578 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.956892 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.957220 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.957530 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.957839 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.958095 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.958406 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.958733 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.959058 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.959384 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.959640 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.959938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.960263 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.960588 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.960907 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.961214 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.961520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.961829 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.962140 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.962449 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.962758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.963070 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.963392 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.963733 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.964065 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.964376 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.964698 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.965110 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.965365 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.965950 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.966332 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.966658 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.966971 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.967294 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.967619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.967960 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.968271 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.968580 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.968904 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.969245 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.969552 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.969808 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.970112 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.970420 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.970741 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.971050 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.971361 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.971666 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.971993 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.972303 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.972611 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.972920 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.973229 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.973542 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.973850 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.974158 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.974465 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.974771 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.975094 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.975419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.975759 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.976080 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.976390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.976699 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.977021 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.977330 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.977637 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.977960 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.978270 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.978580 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.978899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.979209 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.979517 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.979863 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.980171 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.980484 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.980805 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.981115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.981423 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.982255 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.982571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.982881 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.983191 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.983494 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.983827 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.984131 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.984225 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 15 03:37:39.984765 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.984930 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 15 03:37:39.985073 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.985212 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 15 03:37:39.985351 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.985496 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 15 03:37:39.985689 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.985843 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 15 03:37:39.985984 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.986144 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.986286 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.986464 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.986619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.986770 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.986914 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.987054 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.987197 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.987344 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.987493 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.987644 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.987830 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.987974 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.988120 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.988280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.988432 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.988579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.988963 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.989112 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.989254 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.989403 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.989549 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.989703 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-814100-1-iscsi {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.989844 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.989990 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.990147 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.990306 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.990456 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.990603 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.990750 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.990897 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.991049 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.991197 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.991336 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.991475 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.991619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.991782 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.991934 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.991934 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.992211 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.992379 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.992529 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.992681 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.992828 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.992828 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.993108 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.993257 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.993402 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.993557 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.993703 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.993843 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.994001 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.994153 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.994292 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.994443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.994607 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.994763 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.994938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.995092 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.995241 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.995408 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-814100-1-iscsi {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.995562 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.995760 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.995911 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.996082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.996226 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.996371 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.996510 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.996796 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.996955 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.997184 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.997334 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.998064 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.998213 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.998352 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.998498 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.998659 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.998812 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.999138 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.999300 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.999441 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:39.999588 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.999588 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:39.999902 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.000053 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.000194 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.000334 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.000489 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.000642 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.000801 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.000948 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.001088 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.001227 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.001378 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.001526 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.001673 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.001824 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.001969 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.002125 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.002277 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.002425 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.002582 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.002729 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.002868 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.003016 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.003156 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.003296 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.003435 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.003581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.003754 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.003909 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.004051 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.004200 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.004359 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.004507 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.004660 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.004801 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.004940 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.005078 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.005226 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.005374 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.005522 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.005662 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.005807 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.005946 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.006084 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.006235 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.006383 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.006524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.006670 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.006809 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.006953 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.007093 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.007243 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.007390 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.007530 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.007668 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.007855 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.008015 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.008162 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.008311 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.008457 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.008598 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.008746 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.008964 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.009290 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.009440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.009580 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.009728 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.009951 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.010107 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.010260 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.010407 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.010561 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.010707 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.010845 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.010993 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.011143 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.011283 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.011428 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.011574 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.011753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.011914 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.012055 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.012211 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.012358 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.012497 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.012649 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.012649 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.012926 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.013075 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.013226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.013226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.013496 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.013650 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.013796 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.013937 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.014086 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.014225 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.014370 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.014524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.014664 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.014810 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.014961 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.015107 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.015253 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.015402 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.015542 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.015717 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.015877 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.016019 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.016157 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.016308 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.016449 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.016588 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.016726 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.016874 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.017019 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.017171 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.017317 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.017456 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.017594 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.017750 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.017898 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.018038 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.018188 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.018341 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.018482 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.018629 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.018769 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.018941 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.019096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.019415 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.019575 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.019873 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.020052 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.020195 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.020341 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.020490 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.020727 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.020878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.021025 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.021182 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.021332 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.021472 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.021611 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.021750 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.021895 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.022045 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.022198 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.022337 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.022476 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.022624 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.022770 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.022916 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.023067 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.023215 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.023355 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.023501 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.023639 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.023817 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.023978 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.024147 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.024357 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.024510 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.024651 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.024809 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.024957 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.025103 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.025243 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.025383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.025528 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.025676 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.025816 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.025966 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.026120 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.026260 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.026401 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.026548 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.026694 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.026834 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.026980 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.027126 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.027283 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.027437 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.027590 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.027788 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.027941 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.028088 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.028246 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.028393 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.028546 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.028699 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:37:40.028852 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.028999 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.029153 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.029299 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.029628 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.029792 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.029958 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.030106 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.030269 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.030417 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.030571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.030731 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.030888 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.031044 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.031199 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.031360 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.031507 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.031654 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.031872 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.032040 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.032194 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.032341 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.032496 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.032650 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.032798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.032953 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.033099 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.033252 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.033405 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.033559 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.033711 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.033881 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.034036 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.034182 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.034334 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.034487 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.034642 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.034789 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.034935 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.035080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.035234 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.035387 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.035546 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.035546 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.035876 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.036034 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.036189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.036189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.036480 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.036480 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.036773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.036920 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.037066 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.037212 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.037366 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.037520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.037674 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.037837 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.037984 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.038138 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.038292 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.038445 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.038591 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.038737 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.038883 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.039042 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.039190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.039343 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.039489 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.039856 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.040025 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.040184 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.040340 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.040486 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.040653 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.040808 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.040961 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.041116 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.041270 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.041416 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.041568 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.041723 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.041892 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.042038 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.042184 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.042330 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.042475 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.042620 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.042774 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.042921 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.043073 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.043220 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.043220 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.043502 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.043502 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.043830 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.043979 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.044135 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.044796 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.044945 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.045099 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.045245 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.045391 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.045536 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.045689 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.045849 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.045996 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.046148 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.046313 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.046467 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.046614 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.046767 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.046914 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.046914 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.047206 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.047360 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.047513 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.047513 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.047840 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.047996 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.048153 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.048306 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.048454 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.048677 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.048832 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.048985 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.049131 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.049277 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.049431 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.049586 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.050180 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.050330 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.050476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.050654 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.050818 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.050973 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.051127 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.051303 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.051458 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.051612 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.051829 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.052540 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.052707 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.052856 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.053004 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.053162 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.053320 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.053467 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.053627 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.053777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.053922 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.054067 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.054213 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.054358 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.054516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.054853 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.055010 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.055166 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.055330 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.055634 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.055974 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.056123 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.056278 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.056432 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.056586 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.056743 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.056899 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.057046 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.057200 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.057361 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.057508 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.057661 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.057806 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.057953 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.058107 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.058253 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.058398 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.058544 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.058706 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.058861 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.059008 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.059154 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.059299 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.059445 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.059591 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.059771 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.060620 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.060736 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.060837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.060927 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.061013 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.061115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.061203 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.061295 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.061380 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.061472 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.061558 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.061656 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.061743 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.061835 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.061928 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.062014 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.062111 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.062201 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.062285 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.062369 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.062461 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.062546 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.062638 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.062733 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.062818 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.062910 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.063004 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.063090 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.063183 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.063270 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.063361 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.063447 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.063539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.063637 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.063837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.063936 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.064162 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.064266 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.064467 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.064575 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.064783 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.064886 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.065100 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.065293 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.065445 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.065601 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.065749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.065903 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.066049 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.066194 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.066352 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.066514 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.066661 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.066814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.066961 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.067113 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.067281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.067441 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.067595 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.067800 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.067952 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.068109 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.068258 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.068414 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.068561 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.068714 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.068861 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.069007 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.069173 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.069321 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.069468 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.069621 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.069767 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.069920 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.070076 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.070238 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.070393 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.070567 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.070873 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.071028 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.071183 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.071349 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.071505 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.071505 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.071866 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.072017 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.072178 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.072333 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.072479 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.072633 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.072780 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.072950 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.073105 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.073259 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.073492 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.073655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.073809 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.073968 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.074123 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.074123 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.074408 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.074555 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.074702 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.074860 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.075008 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.075161 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.075314 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.075500 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.075655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.075911 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.076063 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.076216 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.076363 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.076516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.076676 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.076824 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.076976 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.076976 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.077264 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.077409 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.077573 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.077720 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.077873 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.078026 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.078172 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.078324 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.078479 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.078626 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.078779 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.079033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.079199 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.079355 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.079526 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.079729 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.079887 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.080034 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.080191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.080347 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.080494 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.080640 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.080805 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.080981 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.081231 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.081398 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.081546 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.081704 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.081857 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.082082 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.082231 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.082387 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.082535 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.082681 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.082834 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.082991 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.083148 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.083304 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.083697 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.083857 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.084032 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.084181 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.084338 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.084498 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.084646 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.084823 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.084972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.085126 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.085286 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.085434 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.085578 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.085758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.085917 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.086076 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.086237 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.086385 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.086532 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.086677 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.086823 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.086968 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.087127 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.087276 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.087428 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.087583 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.087756 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.087935 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.088091 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.088238 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.088384 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.088538 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.088686 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.088862 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.088862 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.089232 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.089395 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.089549 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.089703 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.089859 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.090017 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.090165 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.090165 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.090458 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.090866 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.091027 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.091802 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.091913 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.092011 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.092099 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.092199 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.092293 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.092387 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.092481 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.092574 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.092667 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.092767 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.092855 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.092947 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.093033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.093118 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.093202 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.093295 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.093381 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.093466 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.093550 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.093642 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.093727 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.093914 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.094011 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.094259 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.094389 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.094572 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.094707 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.094896 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.095019 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.095208 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.095438 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.095534 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.095779 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.095876 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.096103 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.096209 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.096430 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.096526 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.096758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.096852 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.097071 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.097237 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.097396 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.097552 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.097712 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.097857 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.098010 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.098165 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.098319 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.098472 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.098631 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.099092 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.099264 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.099423 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.099579 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.099760 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.099926 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.100093 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.100241 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.100402 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.100550 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.100704 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.100859 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.101005 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.101159 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.101313 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.101313 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.101609 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.101783 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.102035 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.102197 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.102352 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.102498 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.102650 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.102796 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.102944 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.103099 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.103246 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.103393 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.103545 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.103718 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.103874 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.104120 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.104271 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.104425 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.104573 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.104726 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.104881 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.105035 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.105189 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.105342 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.105520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.105673 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.105835 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.105990 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.106157 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.106304 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.106489 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.106642 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.107388 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.107543 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.107746 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.107901 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.108058 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.108207 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.108362 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.108509 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.108655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.108818 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.109000 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.109162 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.109318 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.109472 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.109626 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.109772 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.109919 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.110073 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.110227 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.110381 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.110535 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.110699 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.110846 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.111004 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.111159 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.111312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.111459 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.111606 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.111784 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.111948 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.112208 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.112365 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.112513 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.112666 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.112832 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.112988 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.113142 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.113289 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.113435 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.113581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.113739 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.113887 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.114033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.114178 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.114323 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.114471 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.114626 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.114786 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.114933 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.115085 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.115232 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.115384 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.115540 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.115704 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.115858 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.116015 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.116170 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.116329 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.116493 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.116643 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.116807 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.116962 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.117115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.117274 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.117423 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.117568 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.117714 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.117859 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.118014 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.118173 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.118320 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.118466 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.118622 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.118769 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.118921 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.119076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.119222 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.119367 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.119521 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.119674 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.119878 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.120033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.120186 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.120333 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.120478 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.120708 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.120875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.121030 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.121178 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.121324 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.121476 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.121622 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.121780 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.121935 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.122081 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.122243 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.122508 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.122671 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.122847 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.123004 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.123151 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.123308 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.123455 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.123600 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.123782 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.123933 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.124085 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.124232 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.124384 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.124539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.124695 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.124861 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.125018 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.125166 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.125321 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.125467 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.125612 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.125765 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.125912 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.126138 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.126138 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.126436 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.126587 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.126733 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.126890 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.127045 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.127193 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.127339 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.127485 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.127631 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.127811 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.127987 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.128090 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.128206 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.128305 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.128388 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.128461 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.128544 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.128617 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.128686 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.128762 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.128832 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.128910 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.128983 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.129052 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.129120 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.129367 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.129617 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.129788 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.129928 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.130067 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.130205 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.130349 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.130496 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.130644 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.130781 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.130920 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.131058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.131203 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.131354 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.131508 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.131665 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.131885 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.132041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.132198 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.132358 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.132524 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.132777 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.132931 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.133087 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.133233 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.133393 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.133548 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.133705 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.133852 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.134006 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.134160 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.134316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.134472 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.134619 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.134771 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.134925 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.135083 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.135230 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.135382 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.135548 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.135766 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.135933 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.136096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.136250 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.136397 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.136544 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.136690 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.136851 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.136999 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.137152 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.137298 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.137443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.137605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.137768 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.137924 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.138100 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.138272 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.138449 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.138599 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.138754 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.138937 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.139099 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.139247 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.139394 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.139570 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.139778 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.139940 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.140089 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.140242 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.140389 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.140544 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.140699 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.140847 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.140992 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.141144 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.141290 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.141449 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.141612 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.141762 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.141908 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.142053 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.142204 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.142360 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.142514 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.142661 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.142917 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.143080 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.143229 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.143383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.143530 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.143738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.143907 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.144062 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.144218 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.144373 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.144528 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.144749 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.144917 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.145065 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.145222 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.145370 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.145523 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.145670 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.145827 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.145981 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.146142 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.146297 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.146445 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.146592 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.146736 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.146882 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.147042 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.147196 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.147343 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.147489 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.147641 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.147848 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.148006 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.148154 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.148300 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.148445 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.148590 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.148748 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.148903 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.149056 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.149210 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.149363 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.149516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.149685 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.149834 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.149980 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.150134 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.150280 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.150426 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.150580 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.150973 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.151130 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.151277 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.151422 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.151591 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.151765 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.151939 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.152094 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.152250 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.152397 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.152555 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.152708 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.152861 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.153111 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.153267 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.153412 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.154069 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.154227 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.154383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.154547 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.154700 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.154847 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.155074 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.155230 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.155393 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.155541 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.155727 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.155899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.155899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.156188 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.156340 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.156487 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.156652 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.156807 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.156954 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.157099 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.157250 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.157403 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.157550 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.157719 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.157876 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.158024 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.158176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.158333 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.158333 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.158633 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.158788 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.158936 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.159082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.159235 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.159395 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.159395 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.159674 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.159866 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.160015 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.160169 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.160324 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.160482 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.160629 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.160789 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.160944 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.161091 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.161245 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.161392 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.161538 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.161685 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.161837 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.161993 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.162146 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.162293 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.162452 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.162605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.162761 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.162922 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.163070 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.163329 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.163493 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.163642 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.163819 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.163819 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.164116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.164116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.164407 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.164554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.164713 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.164713 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.165008 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.165008 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.165302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.165302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.165597 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.165745 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.165892 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.166038 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.166184 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.166339 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.166496 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.166643 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.166797 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.166944 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.167089 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.167236 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.167392 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.167540 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.167832 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.167991 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.168145 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.168145 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.168459 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.168615 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.168762 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.168915 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.169064 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.169064 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.169919 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.170068 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.170215 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.170361 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.170507 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.170663 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.170829 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.170989 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.171144 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.171292 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.171450 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.171605 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.171791 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.171956 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.172095 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.172209 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.172318 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.172416 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.172504 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.172663 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.172830 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.172993 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.173151 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.173316 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.173578 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.173777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.173936 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.174084 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.174245 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.174394 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.174541 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.174699 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.174853 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.175010 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.175165 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.175313 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.175467 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.175620 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.175802 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.175967 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.176123 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.176271 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.176418 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.176575 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.176735 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.176882 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.177028 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.177181 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.177334 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.177489 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.177645 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.177792 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.177937 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.178083 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.178229 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.178386 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.178554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.178720 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.178870 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.179017 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.179163 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.179360 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.179511 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.179788 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.179951 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.180100 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.180254 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.180440 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.180643 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.180796 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.180944 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.181107 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.181263 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.181421 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.181625 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.181789 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.181945 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.182092 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.182092 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.182385 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.182546 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.182702 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.182849 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.183003 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.183163 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.183316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.183542 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.183764 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.184018 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.184173 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.184333 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.184481 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.184646 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.184796 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.185090 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.185301 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.185463 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.185619 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.185813 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.185967 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.186113 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.186274 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.186431 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.186585 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.186739 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.186898 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.187053 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.187280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.187436 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 15 03:37:40.187591 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.187591 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.187591 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.188056 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.188300 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.188631 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.188972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.189311 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.189642 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.189965 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.190303 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.190623 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.190940 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.191268 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.191591 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.191932 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.192248 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.192576 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.192895 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.193208 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.193528 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.193843 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.194180 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.194495 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.194809 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.195123 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.195443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.195791 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.196108 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.196422 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.196736 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.197058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.197374 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.197692 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.199071 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.199071 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.199071 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.199505 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.199666 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.199927 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.200247 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.200589 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.200919 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.201241 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.201575 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.201900 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.202223 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.202583 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.202915 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.203475 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.203852 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.204754 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.204937 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.205271 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.205596 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.205916 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.206237 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.206577 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.206900 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.207223 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.207544 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.207897 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.208216 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.208537 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.208863 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.209033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_db.sqlalchemy.engines [None req-1c6a2968-e115-4587-8281-fb8209328ce4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120899) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 03:37:40.209226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.209490 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.209844 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.210175 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.210505 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.210834 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.211164 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.211486 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.211829 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.212152 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.212473 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.212805 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.213146 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.213472 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.213789 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.214227 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.214551 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.214877 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.215209 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.215835 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.216709 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.217011 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.217334 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.217665 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.217989 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.218332 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.218684 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.219028 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.219361 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.219705 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.220011 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.220326 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.220647 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.220979 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.221303 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.221635 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.221955 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.222285 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.222603 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.222933 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.223270 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.223597 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.223943 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.224285 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.224607 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.224928 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.225248 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.225567 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.225886 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.226204 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.226539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.226876 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.227191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.227523 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.227874 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.228207 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.228529 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.228850 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.229189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.229516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.229839 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.230160 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.230481 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.230808 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.231133 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.231472 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.232386 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.232731 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.233069 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.233434 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.233757 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.234115 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.234451 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:37:40.234704 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 15 03:37:40.256806 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_db.sqlalchemy.engines [None req-c432aa47-7072-4530-afbf-af5a3b5ea717 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 03:37:40.288408 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.context [None req-1c6a2968-e115-4587-8281-fb8209328ce4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43587adf-3b37-4daa-a785-c641cb70328e(cell1) {{(pid=120899) load_cells /opt/stack/nova/nova/context.py:464}} Oct 15 03:37:40.292843 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1c6a2968-e115-4587-8281-fb8209328ce4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:37:40.295007 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1c6a2968-e115-4587-8281-fb8209328ce4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:37:40.295841 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1c6a2968-e115-4587-8281-fb8209328ce4 None None] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:37:40.297778 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1c6a2968-e115-4587-8281-fb8209328ce4 None None] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:37:40.309586 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_db.sqlalchemy.engines [None req-1c6a2968-e115-4587-8281-fb8209328ce4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120899) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 03:37:40.311804 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_db.sqlalchemy.engines [None req-1c6a2968-e115-4587-8281-fb8209328ce4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120899) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 03:37:40.336264 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.context [None req-c432aa47-7072-4530-afbf-af5a3b5ea717 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43587adf-3b37-4daa-a785-c641cb70328e(cell1) {{(pid=120897) load_cells /opt/stack/nova/nova/context.py:464}} Oct 15 03:37:40.340974 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c432aa47-7072-4530-afbf-af5a3b5ea717 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:37:40.343101 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c432aa47-7072-4530-afbf-af5a3b5ea717 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:37:40.343947 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c432aa47-7072-4530-afbf-af5a3b5ea717 None None] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:37:40.345908 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c432aa47-7072-4530-afbf-af5a3b5ea717 None None] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:37:40.357331 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_db.sqlalchemy.engines [None req-c432aa47-7072-4530-afbf-af5a3b5ea717 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 03:37:40.359336 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_db.sqlalchemy.engines [None req-c432aa47-7072-4530-afbf-af5a3b5ea717 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 03:37:40.573452 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_db.sqlalchemy.engines [None req-1c6a2968-e115-4587-8281-fb8209328ce4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120899) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 03:37:40.621158 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_db.sqlalchemy.engines [None req-c432aa47-7072-4530-afbf-af5a3b5ea717 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 03:37:40.897498 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: WARNING keystonemiddleware.auth_token [None req-1c6a2968-e115-4587-8281-fb8209328ce4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 03:37:40.904242 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: WARNING keystonemiddleware.auth_token [None req-1c6a2968-e115-4587-8281-fb8209328ce4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 03:37:40.955338 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: WARNING keystonemiddleware.auth_token [None req-c432aa47-7072-4530-afbf-af5a3b5ea717 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 03:37:40.962116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: WARNING keystonemiddleware.auth_token [None req-c432aa47-7072-4530-afbf-af5a3b5ea717 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 03:37:41.251546 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: WARNING keystonemiddleware.auth_token [None req-1c6a2968-e115-4587-8281-fb8209328ce4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 03:37:41.256934 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: WARNING keystonemiddleware.auth_token [None req-1c6a2968-e115-4587-8281-fb8209328ce4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 03:37:41.262033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562f14d119c0 pid: 120899 (default app) Oct 15 03:37:41.305826 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: WARNING keystonemiddleware.auth_token [None req-c432aa47-7072-4530-afbf-af5a3b5ea717 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 03:37:41.311763 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: WARNING keystonemiddleware.auth_token [None req-c432aa47-7072-4530-afbf-af5a3b5ea717 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 03:37:41.316835 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562f14d119c0 pid: 120897 (default app) Oct 15 03:38:12.999314 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3998ab55-5b07-4be4-adc0-af3be8b6ca0c tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] Action: 'create', calling method: .version_select at 0x7f4abe9730d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-616747544"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:38:14.733875 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-198b4777-f16b-480e-8725-f0d92eb7b693 tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] Action: 'create', calling method: .version_select at 0x7f4abe9730d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-136965078", "metadata": {"Type": "work"}}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:38:14.736292 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-198b4777-f16b-480e-8725-f0d92eb7b693 tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:38:14.737534 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-198b4777-f16b-480e-8725-f0d92eb7b693 tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.245793 Oct 15 03:38:14.738586 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1155 bytes} [Fri Oct 15 03:38:13 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1248 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 15 03:38:14.792057 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1c918b36-d38e-4e6b-bdd6-9b5f8de4474f tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] Action: 'create', calling method: .version_select at 0x7f4abe973ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1262571481", "metadata": {"Type": "work"}}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:38:14.798329 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1c918b36-d38e-4e6b-bdd6-9b5f8de4474f tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:38:14.800730 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1c918b36-d38e-4e6b-bdd6-9b5f8de4474f tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.047459 Oct 15 03:38:14.804381 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 2/2] 10.222.0.30 () {60 vars in 1155 bytes} [Fri Oct 15 03:38:14 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 15 03:38:14.918637 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3998ab55-5b07-4be4-adc0-af3be8b6ca0c tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.845020 Oct 15 03:38:14.926353 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1154 bytes} [Fri Oct 15 03:38:12 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 2848 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 15 03:38:14.926353 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d9f6504c-54ac-4502-82ed-7f9e2081ad88 tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] Action: 'create', calling method: .version_select at 0x7f4abe973ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-609628526", "metadata": {"Type": "work"}}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:38:14.927591 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d9f6504c-54ac-4502-82ed-7f9e2081ad88 tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:38:14.928340 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d9f6504c-54ac-4502-82ed-7f9e2081ad88 tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007534 Oct 15 03:38:14.929516 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 2/4] 10.222.0.30 () {60 vars in 1155 bytes} [Fri Oct 15 03:38:14 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 15 03:38:14.937625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f648ff82-cd0c-4849-b3a9-7cc106214ee1 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] Calling method '.version_select at 0x7f4abf1b05e0>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:14.999140 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f648ff82-cd0c-4849-b3a9-7cc106214ee1 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/51098402-1495-48b8-b278-2970cbab8c76" status: 200 len: 344 microversion: 2.1 time: 0.068229 Oct 15 03:38:15.000242 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 3/5] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Oct 15 03:38:14 2021] GET /compute/v2.1/os-volumes/51098402-1495-48b8-b278-2970cbab8c76 => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:38:15.004919 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-89d5a792-22e9-41af-9861-de7e08a6b2f5 tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] Calling method '.version_select at 0x7f4abe7cb040>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:15.037052 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-89d5a792-22e9-41af-9861-de7e08a6b2f5 tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] HTTP exception thrown: Volume tempest-invalid-231620198 could not be found. Oct 15 03:38:15.037884 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-89d5a792-22e9-41af-9861-de7e08a6b2f5 tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] Returning 404 to user: Volume tempest-invalid-231620198 could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:38:15.038897 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-89d5a792-22e9-41af-9861-de7e08a6b2f5 tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-231620198" status: 404 len: 98 microversion: 2.1 time: 0.037507 Oct 15 03:38:15.039927 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 4/6] 10.222.0.30 () {58 vars in 1214 bytes} [Fri Oct 15 03:38:15 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-231620198 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 15 03:38:15.050930 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6c7fad96-9e7b-4aae-a48f-60e91c861b5d tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004041 Oct 15 03:38:15.052067 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 5/7] 10.222.0.30 () {58 vars in 1139 bytes} [Fri Oct 15 03:38:15 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 15 03:38:15.061777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8762f82b-ea07-47a8-a90a-4f5713f94311 tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004514 Oct 15 03:38:15.063593 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 6/8] 10.222.0.30 () {58 vars in 1136 bytes} [Fri Oct 15 03:38:15 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 15 03:38:15.073958 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8c820454-5664-4f91-a92d-1ae302350f2d tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] Calling method '.version_select at 0x7f4abe7cb430>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:15.108544 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-8c820454-5664-4f91-a92d-1ae302350f2d tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] HTTP exception thrown: Volume 19d88754-6ada-41b3-874b-c40bcce8fc08 could not be found. Oct 15 03:38:15.109357 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8c820454-5664-4f91-a92d-1ae302350f2d tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] Returning 404 to user: Volume 19d88754-6ada-41b3-874b-c40bcce8fc08 could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:38:15.110342 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8c820454-5664-4f91-a92d-1ae302350f2d tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/19d88754-6ada-41b3-874b-c40bcce8fc08" status: 404 len: 109 microversion: 2.1 time: 0.041304 Oct 15 03:38:15.111077 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 7/9] 10.222.0.30 () {58 vars in 1247 bytes} [Fri Oct 15 03:38:15 2021] DELETE /compute/v2.1/os-volumes/19d88754-6ada-41b3-874b-c40bcce8fc08 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 03:38:15.122402 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-546f4a84-7be6-401c-817a-2a45465966b3 tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] Calling method '.version_select at 0x7f4abe839d30>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:15.157363 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-546f4a84-7be6-401c-817a-2a45465966b3 tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] HTTP exception thrown: Volume 0b2d068e-cbdb-4abd-b828-9c8803cce316 could not be found. Oct 15 03:38:15.158486 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-546f4a84-7be6-401c-817a-2a45465966b3 tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] Returning 404 to user: Volume 0b2d068e-cbdb-4abd-b828-9c8803cce316 could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:38:15.159786 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-546f4a84-7be6-401c-817a-2a45465966b3 tempest-VolumesNegativeTest-787722669 tempest-VolumesNegativeTest-787722669-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0b2d068e-cbdb-4abd-b828-9c8803cce316" status: 404 len: 109 microversion: 2.1 time: 0.043201 Oct 15 03:38:15.160757 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 8/10] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Oct 15 03:38:15 2021] GET /compute/v2.1/os-volumes/0b2d068e-cbdb-4abd-b828-9c8803cce316 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 03:38:15.180222 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4aa51e84-d2c9-4d9f-87de-a3b6ec7d5618 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-923643728", "imageRef": "0ec12dbd-23ec-4d58-b215-4e3cd5f17594", "flavorRef": "452", "networks": [{"uuid": "ba59fb55-8ddf-41f0-8666-595747129911"}]}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:38:16.011082 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a2cfd7b2-c2cd-4523-ba92-8eafe8ea1bbb tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] Calling method '.version_select at 0x7f4abe7cbe50>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:16.250908 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a2cfd7b2-c2cd-4523-ba92-8eafe8ea1bbb tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/51098402-1495-48b8-b278-2970cbab8c76" status: 200 len: 345 microversion: 2.1 time: 0.243046 Oct 15 03:38:16.251589 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 9/11] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Oct 15 03:38:16 2021] GET /compute/v2.1/os-volumes/51098402-1495-48b8-b278-2970cbab8c76 => generated 345 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:38:16.265932 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ee0bb984-7fd4-4764-aaac-4670092ad3c6 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] Action: 'create', calling method: .version_select at 0x7f4abe7cbca0>, body: {"snapshot": {"volume_id": "51098402-1495-48b8-b278-2970cbab8c76", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1800482357"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:38:16.423383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.network.neutron [None req-4aa51e84-d2c9-4d9f-87de-a3b6ec7d5618 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] validate_networks() for [('ba59fb55-8ddf-41f0-8666-595747129911', None, None, None, None, None)] {{(pid=120897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 15 03:38:16.602429 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ee0bb984-7fd4-4764-aaac-4670092ad3c6 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.341154 Oct 15 03:38:16.603243 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 10/12] 10.222.0.30 () {60 vars in 1161 bytes} [Fri Oct 15 03:38:16 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:38:16.729550 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9bb61a6d-b321-4360-88ea-5d53de6623d5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-694673988", "imageRef": "0ec12dbd-23ec-4d58-b215-4e3cd5f17594", "flavorRef": "452", "networks": [{"uuid": "beb50f10-7a82-4ec6-9454-85dffb8b4cbb"}]}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:38:16.922876 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.network.neutron [None req-9bb61a6d-b321-4360-88ea-5d53de6623d5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] validate_networks() for [('beb50f10-7a82-4ec6-9454-85dffb8b4cbb', None, None, None, None, None)] {{(pid=120899) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 15 03:38:17.751087 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-4aa51e84-d2c9-4d9f-87de-a3b6ec7d5618 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Flavor limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 03:38:17.751651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-4aa51e84-d2c9-4d9f-87de-a3b6ec7d5618 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Image limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 03:38:17.752459 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-4aa51e84-d2c9-4d9f-87de-a3b6ec7d5618 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Flavor pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 03:38:17.753192 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-4aa51e84-d2c9-4d9f-87de-a3b6ec7d5618 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Image pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 03:38:17.753668 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-4aa51e84-d2c9-4d9f-87de-a3b6ec7d5618 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 03:38:17.779809 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4aa51e84-d2c9-4d9f-87de-a3b6ec7d5618 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:17.780305 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4aa51e84-d2c9-4d9f-87de-a3b6ec7d5618 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:17.781577 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4aa51e84-d2c9-4d9f-87de-a3b6ec7d5618 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:17.782191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4aa51e84-d2c9-4d9f-87de-a3b6ec7d5618 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:17.848080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-4aa51e84-d2c9-4d9f-87de-a3b6ec7d5618 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Getting quotas for project 0e3771e448cc4b798d048ac3fa182787. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:38:17.875652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-4aa51e84-d2c9-4d9f-87de-a3b6ec7d5618 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Getting quotas for user 8e8c979ab68548b082f33bfb215c7713 and project 0e3771e448cc4b798d048ac3fa182787. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:38:17.892088 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4aa51e84-d2c9-4d9f-87de-a3b6ec7d5618 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Going to run 1 instances... {{(pid=120897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 15 03:38:17.896346 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4aa51e84-d2c9-4d9f-87de-a3b6ec7d5618 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ec12dbd-23ec-4d58-b215-4e3cd5f17594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 15 03:38:18.056538 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4aa51e84-d2c9-4d9f-87de-a3b6ec7d5618 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.245167 Oct 15 03:38:18.058094 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 3/13] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Oct 15 03:38:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 3249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 03:38:18.067761 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-31951b66-67e3-4038-a90e-f8ae2ba49549 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] Calling method '.version_select at 0x7f4abe76aa60>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:18.277189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-31951b66-67e3-4038-a90e-f8ae2ba49549 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/f8d3ad75-6e78-4625-a02e-970dafdf21a5" status: 200 len: 287 microversion: 2.1 time: 0.215892 Oct 15 03:38:18.277850 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 4/14] 10.222.0.30 () {58 vars in 1250 bytes} [Fri Oct 15 03:38:18 2021] GET /compute/v2.1/os-snapshots/f8d3ad75-6e78-4625-a02e-970dafdf21a5 => generated 287 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:38:18.290035 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-61277939-25f6-4cbb-a6ba-762bab7efd7c tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:18.313430 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-61277939-25f6-4cbb-a6ba-762bab7efd7c tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:18.438303 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-9bb61a6d-b321-4360-88ea-5d53de6623d5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Flavor limits 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 03:38:18.444696 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-9bb61a6d-b321-4360-88ea-5d53de6623d5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Image limits 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 03:38:18.445473 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-9bb61a6d-b321-4360-88ea-5d53de6623d5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Flavor pref 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 03:38:18.446460 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-9bb61a6d-b321-4360-88ea-5d53de6623d5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Image pref 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 03:38:18.447053 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-9bb61a6d-b321-4360-88ea-5d53de6623d5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 03:38:18.497941 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bb61a6d-b321-4360-88ea-5d53de6623d5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:18.503457 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bb61a6d-b321-4360-88ea-5d53de6623d5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:18.506069 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bb61a6d-b321-4360-88ea-5d53de6623d5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:18.506712 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bb61a6d-b321-4360-88ea-5d53de6623d5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:18.615149 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-9bb61a6d-b321-4360-88ea-5d53de6623d5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Getting quotas for project fca42958bf634cd8be46887a2580f4cc. Resources: {'cores', 'instances', 'ram'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:38:18.634573 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-9bb61a6d-b321-4360-88ea-5d53de6623d5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Getting quotas for user f1f3db9250cc4edbacb392d5d0d18e08 and project fca42958bf634cd8be46887a2580f4cc. Resources: {'cores', 'instances', 'ram'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:38:18.674323 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9bb61a6d-b321-4360-88ea-5d53de6623d5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Going to run 1 instances... {{(pid=120899) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 15 03:38:18.697047 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9bb61a6d-b321-4360-88ea-5d53de6623d5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ec12dbd-23ec-4d58-b215-4e3cd5f17594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120899) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 15 03:38:18.853509 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-61277939-25f6-4cbb-a6ba-762bab7efd7c tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:18.891005 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-61277939-25f6-4cbb-a6ba-762bab7efd7c tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1214 microversion: 2.1 time: 0.603612 Oct 15 03:38:18.895769 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 5/15] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:18 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1214 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:18.911634 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-777c2775-b33e-4a4d-ad52-507d11479c06 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] Calling method '.version_select at 0x7f4abd6f81f0>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:18.963571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9bb61a6d-b321-4360-88ea-5d53de6623d5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.359189 Oct 15 03:38:18.967922 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 11/16] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Oct 15 03:38:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 2364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 03:38:18.979475 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-92244d57-489f-4f65-8753-cf44f2093337 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:18.983064 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-92244d57-489f-4f65-8753-cf44f2093337 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:19.071272 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-777c2775-b33e-4a4d-ad52-507d11479c06 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.165844 Oct 15 03:38:19.071971 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 6/17] 10.222.0.30 () {58 vars in 1139 bytes} [Fri Oct 15 03:38:18 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:38:19.087651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-380d4d26-ab27-46b7-b94c-5bcc83a4543a tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] Calling method '.version_select at 0x7f4abd68b550>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:19.133115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-92244d57-489f-4f65-8753-cf44f2093337 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:19.154149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-380d4d26-ab27-46b7-b94c-5bcc83a4543a tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/f8d3ad75-6e78-4625-a02e-970dafdf21a5" status: 200 len: 287 microversion: 2.1 time: 0.075226 Oct 15 03:38:19.155136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 7/18] 10.222.0.30 () {58 vars in 1250 bytes} [Fri Oct 15 03:38:19 2021] GET /compute/v2.1/os-snapshots/f8d3ad75-6e78-4625-a02e-970dafdf21a5 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:38:19.168500 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-92244d57-489f-4f65-8753-cf44f2093337 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1217 microversion: 2.1 time: 0.193079 Oct 15 03:38:19.170700 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 12/19] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:18 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:19.915189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a624cd09-f35c-42f4-ba08-138419599576 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:19.915909 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a624cd09-f35c-42f4-ba08-138419599576 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:20.119664 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a624cd09-f35c-42f4-ba08-138419599576 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:20.127967 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a624cd09-f35c-42f4-ba08-138419599576 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1214 microversion: 2.1 time: 0.217777 Oct 15 03:38:20.128554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 8/20] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:19 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1214 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:20.166051 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b967af71-fd7a-410a-9c05-840abb129fb1 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] Calling method '.version_select at 0x7f4abdeefdc0>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:20.186997 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7048e1ca-ddc1-43d5-bfea-f3b03e276565 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:20.187944 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7048e1ca-ddc1-43d5-bfea-f3b03e276565 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:20.231499 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b967af71-fd7a-410a-9c05-840abb129fb1 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/f8d3ad75-6e78-4625-a02e-970dafdf21a5" status: 200 len: 288 microversion: 2.1 time: 0.068581 Oct 15 03:38:20.248617 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 13/21] 10.222.0.30 () {58 vars in 1250 bytes} [Fri Oct 15 03:38:20 2021] GET /compute/v2.1/os-snapshots/f8d3ad75-6e78-4625-a02e-970dafdf21a5 => generated 288 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:38:20.259655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-03cd6406-ac84-473a-a3f9-bd56db600e4f tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] Calling method '.version_select at 0x7f4abd692040>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:20.357098 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7048e1ca-ddc1-43d5-bfea-f3b03e276565 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:20.366335 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7048e1ca-ddc1-43d5-bfea-f3b03e276565 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1217 microversion: 2.1 time: 0.183667 Oct 15 03:38:20.369428 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 9/22] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:20 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:20.425399 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-03cd6406-ac84-473a-a3f9-bd56db600e4f tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/f8d3ad75-6e78-4625-a02e-970dafdf21a5" status: 202 len: 0 microversion: 2.1 time: 0.169387 Oct 15 03:38:20.426517 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 14/23] 10.222.0.30 () {58 vars in 1253 bytes} [Fri Oct 15 03:38:20 2021] DELETE /compute/v2.1/os-snapshots/f8d3ad75-6e78-4625-a02e-970dafdf21a5 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:38:20.435745 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6e620af4-c740-419f-9485-cfab8c4fa0d4 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] Calling method '.version_select at 0x7f4abd68bee0>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:20.518283 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6e620af4-c740-419f-9485-cfab8c4fa0d4 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/f8d3ad75-6e78-4625-a02e-970dafdf21a5" status: 200 len: 287 microversion: 2.1 time: 0.087091 Oct 15 03:38:20.518894 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 10/24] 10.222.0.30 () {58 vars in 1250 bytes} [Fri Oct 15 03:38:20 2021] GET /compute/v2.1/os-snapshots/f8d3ad75-6e78-4625-a02e-970dafdf21a5 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:38:21.148432 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-77f91af5-38b1-4a8a-be9f-db0cb325adc2 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:21.149151 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-77f91af5-38b1-4a8a-be9f-db0cb325adc2 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:21.160381 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-77f91af5-38b1-4a8a-be9f-db0cb325adc2 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:21.161264 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-77f91af5-38b1-4a8a-be9f-db0cb325adc2 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:21.163918 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-77f91af5-38b1-4a8a-be9f-db0cb325adc2 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:21.165025 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-77f91af5-38b1-4a8a-be9f-db0cb325adc2 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:21.387992 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c902b978-5a2f-4ac1-b9e0-abbba20f0314 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:21.388734 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c902b978-5a2f-4ac1-b9e0-abbba20f0314 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:21.395564 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c902b978-5a2f-4ac1-b9e0-abbba20f0314 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:21.404277 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c902b978-5a2f-4ac1-b9e0-abbba20f0314 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:21.405493 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c902b978-5a2f-4ac1-b9e0-abbba20f0314 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:21.408165 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c902b978-5a2f-4ac1-b9e0-abbba20f0314 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:21.469397 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-77f91af5-38b1-4a8a-be9f-db0cb325adc2 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:21.487114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-77f91af5-38b1-4a8a-be9f-db0cb325adc2 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1266 microversion: 2.1 time: 0.343027 Oct 15 03:38:21.490333 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 15/25] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:21 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1266 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:21.530376 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f2f56882-ca97-4888-89b9-0710d9372ace tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] Calling method '.version_select at 0x7f4abd63ca60>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:21.608164 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-f2f56882-ca97-4888-89b9-0710d9372ace tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] HTTP exception thrown: Snapshot f8d3ad75-6e78-4625-a02e-970dafdf21a5 could not be found. Oct 15 03:38:21.609105 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f2f56882-ca97-4888-89b9-0710d9372ace tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] Returning 404 to user: Snapshot f8d3ad75-6e78-4625-a02e-970dafdf21a5 could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:38:21.610333 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f2f56882-ca97-4888-89b9-0710d9372ace tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/f8d3ad75-6e78-4625-a02e-970dafdf21a5" status: 404 len: 111 microversion: 2.1 time: 0.084008 Oct 15 03:38:21.611344 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 16/26] 10.222.0.30 () {58 vars in 1250 bytes} [Fri Oct 15 03:38:21 2021] GET /compute/v2.1/os-snapshots/f8d3ad75-6e78-4625-a02e-970dafdf21a5 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 03:38:21.620450 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-33402026-5550-443a-a407-0675c796fa3c tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] Calling method '.version_select at 0x7f4abd5cc0d0>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:21.859665 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-33402026-5550-443a-a407-0675c796fa3c tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/51098402-1495-48b8-b278-2970cbab8c76" status: 202 len: 0 microversion: 2.1 time: 0.243630 Oct 15 03:38:21.862233 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 17/27] 10.222.0.30 () {58 vars in 1247 bytes} [Fri Oct 15 03:38:21 2021] DELETE /compute/v2.1/os-volumes/51098402-1495-48b8-b278-2970cbab8c76 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:38:21.870979 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-45e6bfaa-bf99-4bd6-8bd6-1360d20f1510 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] Calling method '.version_select at 0x7f4abe7cb4c0>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:22.157933 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c902b978-5a2f-4ac1-b9e0-abbba20f0314 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:22.174219 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c902b978-5a2f-4ac1-b9e0-abbba20f0314 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1213 microversion: 2.1 time: 0.790274 Oct 15 03:38:22.175517 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 11/28] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:21 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1213 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:38:22.192785 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-45e6bfaa-bf99-4bd6-8bd6-1360d20f1510 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] HTTP exception thrown: Volume 51098402-1495-48b8-b278-2970cbab8c76 could not be found. Oct 15 03:38:22.193578 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-45e6bfaa-bf99-4bd6-8bd6-1360d20f1510 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] Returning 404 to user: Volume 51098402-1495-48b8-b278-2970cbab8c76 could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:38:22.194578 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-45e6bfaa-bf99-4bd6-8bd6-1360d20f1510 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/51098402-1495-48b8-b278-2970cbab8c76" status: 404 len: 109 microversion: 2.1 time: 0.328206 Oct 15 03:38:22.195557 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 18/29] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Oct 15 03:38:21 2021] GET /compute/v2.1/os-volumes/51098402-1495-48b8-b278-2970cbab8c76 => generated 109 bytes in 330 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 03:38:22.212811 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-21c36111-13e2-41df-bba7-ec65d09c8664 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] Calling method '.version_select at 0x7f4abd601a60>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:22.343474 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.wsgi [None req-21c36111-13e2-41df-bba7-ec65d09c8664 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] HTTP exception thrown: Volume 51098402-1495-48b8-b278-2970cbab8c76 could not be found. Oct 15 03:38:22.344291 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-21c36111-13e2-41df-bba7-ec65d09c8664 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] Returning 404 to user: Volume 51098402-1495-48b8-b278-2970cbab8c76 could not be found. {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:38:22.345514 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-21c36111-13e2-41df-bba7-ec65d09c8664 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/51098402-1495-48b8-b278-2970cbab8c76" status: 404 len: 109 microversion: 2.1 time: 0.144078 Oct 15 03:38:22.346164 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 12/30] 10.222.0.30 () {58 vars in 1247 bytes} [Fri Oct 15 03:38:22 2021] DELETE /compute/v2.1/os-volumes/51098402-1495-48b8-b278-2970cbab8c76 => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 03:38:22.354460 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e0298ab0-b49f-47b4-8c21-80b25f487e60 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] Calling method '.version_select at 0x7f4abd5cc280>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:22.483167 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-e0298ab0-b49f-47b4-8c21-80b25f487e60 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] HTTP exception thrown: Volume 51098402-1495-48b8-b278-2970cbab8c76 could not be found. Oct 15 03:38:22.483855 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e0298ab0-b49f-47b4-8c21-80b25f487e60 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] Returning 404 to user: Volume 51098402-1495-48b8-b278-2970cbab8c76 could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:38:22.484895 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e0298ab0-b49f-47b4-8c21-80b25f487e60 tempest-VolumesSnapshotsTestJSON-1158724845 tempest-VolumesSnapshotsTestJSON-1158724845-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/51098402-1495-48b8-b278-2970cbab8c76" status: 404 len: 109 microversion: 2.1 time: 0.134368 Oct 15 03:38:22.485786 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 19/31] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Oct 15 03:38:22 2021] GET /compute/v2.1/os-volumes/51098402-1495-48b8-b278-2970cbab8c76 => generated 109 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 03:38:22.509559 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3e5cc021-5c63-4d2b-84ef-33a58654035b tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:22.510414 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3e5cc021-5c63-4d2b-84ef-33a58654035b tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:22.529623 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3e5cc021-5c63-4d2b-84ef-33a58654035b tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:22.529623 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3e5cc021-5c63-4d2b-84ef-33a58654035b tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:22.529623 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3e5cc021-5c63-4d2b-84ef-33a58654035b tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:22.529623 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3e5cc021-5c63-4d2b-84ef-33a58654035b tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:22.778561 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3e5cc021-5c63-4d2b-84ef-33a58654035b tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:22.794334 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3e5cc021-5c63-4d2b-84ef-33a58654035b tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1272 microversion: 2.1 time: 0.288051 Oct 15 03:38:22.801302 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 13/32] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:22 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1272 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:23.192269 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-baa14639-12a6-49d5-8fc9-cd920112bba5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:23.193049 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-baa14639-12a6-49d5-8fc9-cd920112bba5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:23.208614 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baa14639-12a6-49d5-8fc9-cd920112bba5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:23.218617 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baa14639-12a6-49d5-8fc9-cd920112bba5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:23.220439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baa14639-12a6-49d5-8fc9-cd920112bba5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:23.224405 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baa14639-12a6-49d5-8fc9-cd920112bba5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:23.444460 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-baa14639-12a6-49d5-8fc9-cd920112bba5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:23.458163 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-baa14639-12a6-49d5-8fc9-cd920112bba5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1275 microversion: 2.1 time: 0.269307 Oct 15 03:38:23.470715 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 20/33] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:23 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1275 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:23.811938 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4a36e122-2c50-45d4-9cc8-c7542b0e8ebf tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:23.813351 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4a36e122-2c50-45d4-9cc8-c7542b0e8ebf tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:23.839829 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4a36e122-2c50-45d4-9cc8-c7542b0e8ebf tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:23.843401 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4a36e122-2c50-45d4-9cc8-c7542b0e8ebf tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:23.845145 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4a36e122-2c50-45d4-9cc8-c7542b0e8ebf tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:23.845591 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4a36e122-2c50-45d4-9cc8-c7542b0e8ebf tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:24.216149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4a36e122-2c50-45d4-9cc8-c7542b0e8ebf tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:24.234342 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4a36e122-2c50-45d4-9cc8-c7542b0e8ebf tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1314 microversion: 2.1 time: 0.426238 Oct 15 03:38:24.235872 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 14/34] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:23 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:24.480359 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ca274212-5a8a-47bc-80d9-f3970e123066 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:24.481796 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ca274212-5a8a-47bc-80d9-f3970e123066 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:24.492590 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca274212-5a8a-47bc-80d9-f3970e123066 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:24.497456 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca274212-5a8a-47bc-80d9-f3970e123066 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:24.504980 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca274212-5a8a-47bc-80d9-f3970e123066 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:24.509034 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca274212-5a8a-47bc-80d9-f3970e123066 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:24.708118 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ca274212-5a8a-47bc-80d9-f3970e123066 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:24.716599 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ca274212-5a8a-47bc-80d9-f3970e123066 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1275 microversion: 2.1 time: 0.240717 Oct 15 03:38:24.729167 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 21/35] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:24 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1275 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:25.258973 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3561008b-dce4-470d-98c1-2c5d8cf55a0a tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:25.260388 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3561008b-dce4-470d-98c1-2c5d8cf55a0a tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:25.276934 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3561008b-dce4-470d-98c1-2c5d8cf55a0a tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:25.280709 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3561008b-dce4-470d-98c1-2c5d8cf55a0a tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:25.284714 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3561008b-dce4-470d-98c1-2c5d8cf55a0a tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:25.285812 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3561008b-dce4-470d-98c1-2c5d8cf55a0a tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:25.428354 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-95f50de2-e1dd-458e-98a0-335e6702104f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'create', calling method: .version_select at 0x7f4abd5df8b0>, body: {"keypair": {"name": "tempest-keypair-2027734471"}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:38:25.537138 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-95f50de2-e1dd-458e-98a0-335e6702104f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Getting quotas for project 5b4923cacd2a4baea3b5dcf9522e9b54. Resources: {'key_pairs'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:38:25.544136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-95f50de2-e1dd-458e-98a0-335e6702104f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Getting quotas for user d795b4264cbe4aff82f5a2b0275ca972 and project 5b4923cacd2a4baea3b5dcf9522e9b54. Resources: {'key_pairs'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:38:25.954350 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-95f50de2-e1dd-458e-98a0-335e6702104f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Getting quotas for project 5b4923cacd2a4baea3b5dcf9522e9b54. Resources: {'key_pairs'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:38:25.966269 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-95f50de2-e1dd-458e-98a0-335e6702104f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Getting quotas for user d795b4264cbe4aff82f5a2b0275ca972 and project 5b4923cacd2a4baea3b5dcf9522e9b54. Resources: {'key_pairs'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:38:25.999388 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-95f50de2-e1dd-458e-98a0-335e6702104f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.183562 Oct 15 03:38:26.003113 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 15/36] 10.222.0.30 () {62 vars in 1198 bytes} [Fri Oct 15 03:38:24 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1188 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 15 03:38:26.008972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1f0a1089-e1a5-4496-8cc6-cc45a6b47754 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:26.044788 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1f0a1089-e1a5-4496-8cc6-cc45a6b47754 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:26.044788 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1f0a1089-e1a5-4496-8cc6-cc45a6b47754 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:26.044788 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1f0a1089-e1a5-4496-8cc6-cc45a6b47754 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:26.044788 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1f0a1089-e1a5-4496-8cc6-cc45a6b47754 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:26.053084 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1f0a1089-e1a5-4496-8cc6-cc45a6b47754 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:28.397840 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3561008b-dce4-470d-98c1-2c5d8cf55a0a tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:28.428409 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3561008b-dce4-470d-98c1-2c5d8cf55a0a tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1314 microversion: 2.1 time: 3.173504 Oct 15 03:38:28.428996 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 22/37] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:25 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1314 bytes in 3181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:38:28.457734 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1f0a1089-e1a5-4496-8cc6-cc45a6b47754 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:28.471877 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1f0a1089-e1a5-4496-8cc6-cc45a6b47754 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1317 microversion: 2.1 time: 2.463607 Oct 15 03:38:28.476754 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 16/38] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:26 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1317 bytes in 2473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:29.447115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f90ab586-5831-4557-974b-02395cf27819 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:29.448277 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f90ab586-5831-4557-974b-02395cf27819 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:29.458987 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f90ab586-5831-4557-974b-02395cf27819 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:29.460564 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f90ab586-5831-4557-974b-02395cf27819 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:29.461913 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f90ab586-5831-4557-974b-02395cf27819 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:29.462550 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f90ab586-5831-4557-974b-02395cf27819 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:29.489972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d2e2d8fb-955a-466c-b131-f517374b5f27 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:29.490457 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d2e2d8fb-955a-466c-b131-f517374b5f27 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:29.512341 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2e2d8fb-955a-466c-b131-f517374b5f27 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:29.512811 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2e2d8fb-955a-466c-b131-f517374b5f27 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:29.513703 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2e2d8fb-955a-466c-b131-f517374b5f27 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:29.514137 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2e2d8fb-955a-466c-b131-f517374b5f27 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:30.215951 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f90ab586-5831-4557-974b-02395cf27819 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:30.230721 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f90ab586-5831-4557-974b-02395cf27819 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1314 microversion: 2.1 time: 0.788210 Oct 15 03:38:30.237470 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 23/39] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:29 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1314 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:30.369895 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-c26ca926-064f-40c0-9b19-9ee824b60432 req-b053a96e-a49a-4364-9145-ef6fd672c75c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "612f42d0-d719-4a5f-bcb9-029c18112f69", "tag": "230afb5a-d538-4679-93eb-d7a4ac314ae4"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:38:30.373259 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:38:30.373259 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 03:38:30.394897 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-c26ca926-064f-40c0-9b19-9ee824b60432 req-b053a96e-a49a-4364-9145-ef6fd672c75c service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:30.395569 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-c26ca926-064f-40c0-9b19-9ee824b60432 req-b053a96e-a49a-4364-9145-ef6fd672c75c service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:30.447829 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-c26ca926-064f-40c0-9b19-9ee824b60432 req-b053a96e-a49a-4364-9145-ef6fd672c75c service nova] Creating event network-changed:230afb5a-d538-4679-93eb-d7a4ac314ae4 for instance 612f42d0-d719-4a5f-bcb9-029c18112f69 on hv-cinder-81410 Oct 15 03:38:30.449553 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-c26ca926-064f-40c0-9b19-9ee824b60432 req-b053a96e-a49a-4364-9145-ef6fd672c75c service nova] Acquired lock "compute-rpcapi-router" {{(pid=120899) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 15 03:38:30.450920 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-050e8c65-ab56-4773-a112-64f26e46692e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:30.451753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-050e8c65-ab56-4773-a112-64f26e46692e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:30.452728 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-050e8c65-ab56-4773-a112-64f26e46692e None None] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:30.462396 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-050e8c65-ab56-4773-a112-64f26e46692e None None] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:30.474784 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.compute.rpcapi [None req-050e8c65-ab56-4773-a112-64f26e46692e None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 15 03:38:30.499184 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-050e8c65-ab56-4773-a112-64f26e46692e None None] Releasing lock "compute-rpcapi-router" {{(pid=120899) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 15 03:38:30.570689 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d2e2d8fb-955a-466c-b131-f517374b5f27 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:30.588796 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d2e2d8fb-955a-466c-b131-f517374b5f27 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1317 microversion: 2.1 time: 1.098399 Oct 15 03:38:30.592383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 17/40] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:29 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1317 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:30.631330 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-050e8c65-ab56-4773-a112-64f26e46692e None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.386922 Oct 15 03:38:30.633052 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 24/41] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:38:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:38:30.826012 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-e2a65942-7a84-4b01-af98-cde33e1aa496 req-e307ba07-e691-4492-8419-2d25f2ed0e73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "479f8628-5c56-459e-8ff7-d2fee24b613a", "tag": "aa7c0da7-52ba-4e18-9d99-9b4c9b8183c4"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:38:30.828841 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:38:30.828841 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:38:30.857452 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-e2a65942-7a84-4b01-af98-cde33e1aa496 req-e307ba07-e691-4492-8419-2d25f2ed0e73 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:30.873239 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-e2a65942-7a84-4b01-af98-cde33e1aa496 req-e307ba07-e691-4492-8419-2d25f2ed0e73 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:30.928648 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-e2a65942-7a84-4b01-af98-cde33e1aa496 req-e307ba07-e691-4492-8419-2d25f2ed0e73 service nova] Creating event network-changed:aa7c0da7-52ba-4e18-9d99-9b4c9b8183c4 for instance 479f8628-5c56-459e-8ff7-d2fee24b613a on hv-cinder-81410 Oct 15 03:38:30.929367 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-e2a65942-7a84-4b01-af98-cde33e1aa496 req-e307ba07-e691-4492-8419-2d25f2ed0e73 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120897) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 15 03:38:30.931556 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45dace1c-a6a7-4e33-9dc3-f2c3d74acbf2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:30.932258 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45dace1c-a6a7-4e33-9dc3-f2c3d74acbf2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:30.934110 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45dace1c-a6a7-4e33-9dc3-f2c3d74acbf2 None None] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:30.935812 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45dace1c-a6a7-4e33-9dc3-f2c3d74acbf2 None None] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:30.954398 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.compute.rpcapi [None req-45dace1c-a6a7-4e33-9dc3-f2c3d74acbf2 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 15 03:38:30.955962 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45dace1c-a6a7-4e33-9dc3-f2c3d74acbf2 None None] Releasing lock "compute-rpcapi-router" {{(pid=120897) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 15 03:38:31.005551 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-45dace1c-a6a7-4e33-9dc3-f2c3d74acbf2 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.401971 Oct 15 03:38:31.006604 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 18/42] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:38:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:38:31.226115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-249d6a1c-d437-466e-bb24-2d725f830660 tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] Calling method '.version_select at 0x7f4abd5dd310>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:31.255012 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ab6910dd-cf3c-4339-bde5-26dbb048787e tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:31.255843 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ab6910dd-cf3c-4339-bde5-26dbb048787e tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:31.274863 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ab6910dd-cf3c-4339-bde5-26dbb048787e tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:31.281688 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ab6910dd-cf3c-4339-bde5-26dbb048787e tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:31.282790 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ab6910dd-cf3c-4339-bde5-26dbb048787e tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:31.288461 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ab6910dd-cf3c-4339-bde5-26dbb048787e tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:31.341883 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-249d6a1c-d437-466e-bb24-2d725f830660 tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/d6a49c37-08df-4b2d-9a20-d56ab3eba9b0" status: 200 len: 351 microversion: 2.1 time: 0.122022 Oct 15 03:38:31.343073 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 25/43] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Oct 15 03:38:31 2021] GET /compute/v2.1/os-volumes/d6a49c37-08df-4b2d-9a20-d56ab3eba9b0 => generated 351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:38:31.611052 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e6b0bb08-7570-4055-8dd3-40831d34dafa tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:31.611840 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e6b0bb08-7570-4055-8dd3-40831d34dafa tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:31.630468 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e6b0bb08-7570-4055-8dd3-40831d34dafa tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:31.631239 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e6b0bb08-7570-4055-8dd3-40831d34dafa tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:31.638369 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e6b0bb08-7570-4055-8dd3-40831d34dafa tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:31.639092 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e6b0bb08-7570-4055-8dd3-40831d34dafa tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:31.917342 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ab6910dd-cf3c-4339-bde5-26dbb048787e tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:31.925784 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ab6910dd-cf3c-4339-bde5-26dbb048787e tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1314 microversion: 2.1 time: 0.675344 Oct 15 03:38:31.930692 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 19/44] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:31 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1314 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:32.224160 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e6b0bb08-7570-4055-8dd3-40831d34dafa tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:32.244438 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e6b0bb08-7570-4055-8dd3-40831d34dafa tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1317 microversion: 2.1 time: 0.637281 Oct 15 03:38:32.251427 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 26/45] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:31 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1317 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:32.523424 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a721a59a-4b62-4307-b788-03d3ee04bb04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-220223733", "imageRef": "0ec12dbd-23ec-4d58-b215-4e3cd5f17594", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "830c2be1-af32-4eca-80bf-988a2f30d468"}], "security_groups": [{"name": "tempest-securitygroup--732386269"}], "key_name": "tempest-keypair-2027734471", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:38:32.652012 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.network.neutron [None req-a721a59a-4b62-4307-b788-03d3ee04bb04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] validate_networks() for [('830c2be1-af32-4eca-80bf-988a2f30d468', None, None, None, None, None)] {{(pid=120897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 15 03:38:32.943110 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2da750bb-c312-4d09-954d-33443c27006d tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:32.943826 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2da750bb-c312-4d09-954d-33443c27006d tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:32.951107 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2da750bb-c312-4d09-954d-33443c27006d tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:32.952131 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2da750bb-c312-4d09-954d-33443c27006d tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:32.952944 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2da750bb-c312-4d09-954d-33443c27006d tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:32.953380 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2da750bb-c312-4d09-954d-33443c27006d tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:33.126643 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-a721a59a-4b62-4307-b788-03d3ee04bb04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Flavor limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 03:38:33.127146 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-a721a59a-4b62-4307-b788-03d3ee04bb04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Image limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 03:38:33.127812 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-a721a59a-4b62-4307-b788-03d3ee04bb04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Flavor pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 03:38:33.128222 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-a721a59a-4b62-4307-b788-03d3ee04bb04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Image pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 03:38:33.128661 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-a721a59a-4b62-4307-b788-03d3ee04bb04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 03:38:33.138175 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a721a59a-4b62-4307-b788-03d3ee04bb04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:33.138734 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a721a59a-4b62-4307-b788-03d3ee04bb04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:33.139590 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a721a59a-4b62-4307-b788-03d3ee04bb04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:33.140514 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a721a59a-4b62-4307-b788-03d3ee04bb04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:33.147157 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2da750bb-c312-4d09-954d-33443c27006d tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:33.162392 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2da750bb-c312-4d09-954d-33443c27006d tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1314 microversion: 2.1 time: 0.222865 Oct 15 03:38:33.162754 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-a721a59a-4b62-4307-b788-03d3ee04bb04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Getting quotas for project 5b4923cacd2a4baea3b5dcf9522e9b54. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:38:33.163451 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 27/46] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:32 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:38:33.177548 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-a721a59a-4b62-4307-b788-03d3ee04bb04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Getting quotas for user d795b4264cbe4aff82f5a2b0275ca972 and project 5b4923cacd2a4baea3b5dcf9522e9b54. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:38:33.189745 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a721a59a-4b62-4307-b788-03d3ee04bb04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Going to run 1 instances... {{(pid=120897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 15 03:38:33.192199 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a721a59a-4b62-4307-b788-03d3ee04bb04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ec12dbd-23ec-4d58-b215-4e3cd5f17594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 15 03:38:33.242612 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a721a59a-4b62-4307-b788-03d3ee04bb04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.723430 Oct 15 03:38:33.248758 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 20/47] 10.222.0.30 () {62 vars in 1187 bytes} [Fri Oct 15 03:38:32 2021] POST /compute/v2.1/servers => generated 401 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 15 03:38:33.254730 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fd824de0-a3b8-4964-91f9-d541494b2a90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:33.255534 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fd824de0-a3b8-4964-91f9-d541494b2a90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:33.267813 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c2d1c61e-bc2a-46f2-b7f8-75f40d9348ae tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:33.268440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c2d1c61e-bc2a-46f2-b7f8-75f40d9348ae tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:33.282560 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c2d1c61e-bc2a-46f2-b7f8-75f40d9348ae tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:33.284078 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c2d1c61e-bc2a-46f2-b7f8-75f40d9348ae tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:33.289605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c2d1c61e-bc2a-46f2-b7f8-75f40d9348ae tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:33.290212 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c2d1c61e-bc2a-46f2-b7f8-75f40d9348ae tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:33.323118 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fd824de0-a3b8-4964-91f9-d541494b2a90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:33.333267 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fd824de0-a3b8-4964-91f9-d541494b2a90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:33.337541 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fd824de0-a3b8-4964-91f9-d541494b2a90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:33.337541 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fd824de0-a3b8-4964-91f9-d541494b2a90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1281 microversion: 2.20 time: 0.086062 Oct 15 03:38:33.337541 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 28/48] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:33 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1281 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:38:33.453191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c2d1c61e-bc2a-46f2-b7f8-75f40d9348ae tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:33.463298 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c2d1c61e-bc2a-46f2-b7f8-75f40d9348ae tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1317 microversion: 2.1 time: 0.198816 Oct 15 03:38:33.474492 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 21/49] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:33 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:38:34.179710 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2f0078c2-2197-413c-aaa4-afaa66d019bc tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:34.181120 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2f0078c2-2197-413c-aaa4-afaa66d019bc tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:34.187785 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2f0078c2-2197-413c-aaa4-afaa66d019bc tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:34.188057 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2f0078c2-2197-413c-aaa4-afaa66d019bc tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:34.188816 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2f0078c2-2197-413c-aaa4-afaa66d019bc tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:34.189253 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2f0078c2-2197-413c-aaa4-afaa66d019bc tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:34.355566 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-245b942e-399e-4f64-8890-ccb976db7adf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:34.364462 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-245b942e-399e-4f64-8890-ccb976db7adf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:34.371836 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-245b942e-399e-4f64-8890-ccb976db7adf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:34.372425 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-245b942e-399e-4f64-8890-ccb976db7adf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:34.373289 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-245b942e-399e-4f64-8890-ccb976db7adf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:34.373834 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-245b942e-399e-4f64-8890-ccb976db7adf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:34.521032 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-245b942e-399e-4f64-8890-ccb976db7adf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:34.530149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-245b942e-399e-4f64-8890-ccb976db7adf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:34.539795 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-245b942e-399e-4f64-8890-ccb976db7adf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:34.541109 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-245b942e-399e-4f64-8890-ccb976db7adf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1285 microversion: 2.20 time: 0.190261 Oct 15 03:38:34.542219 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 22/50] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:34 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1285 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:38:34.548361 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0ecd0a1e-3618-43e2-8ec6-a3c4914108bd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:34.549319 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0ecd0a1e-3618-43e2-8ec6-a3c4914108bd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:34.556507 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0ecd0a1e-3618-43e2-8ec6-a3c4914108bd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:34.556964 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0ecd0a1e-3618-43e2-8ec6-a3c4914108bd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:34.557763 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0ecd0a1e-3618-43e2-8ec6-a3c4914108bd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:34.558374 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0ecd0a1e-3618-43e2-8ec6-a3c4914108bd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:34.580406 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2f0078c2-2197-413c-aaa4-afaa66d019bc tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:34.588756 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2f0078c2-2197-413c-aaa4-afaa66d019bc tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1314 microversion: 2.1 time: 0.412927 Oct 15 03:38:34.589451 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 29/51] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:34 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:34.710233 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0ecd0a1e-3618-43e2-8ec6-a3c4914108bd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:34.724551 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0ecd0a1e-3618-43e2-8ec6-a3c4914108bd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1317 microversion: 2.1 time: 0.180176 Oct 15 03:38:34.725190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 23/52] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:34 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:35.326913 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c5e1e582-7a2c-4a16-b1f2-19122f730d97 tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] Calling method '.version_select at 0x7f4abd63c5e0>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:35.382944 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c5e1e582-7a2c-4a16-b1f2-19122f730d97 tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/be817180-710d-441b-b4db-1c97466cf01d" status: 200 len: 351 microversion: 2.1 time: 0.061024 Oct 15 03:38:35.383960 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 30/53] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Oct 15 03:38:35 2021] GET /compute/v2.1/os-volumes/be817180-710d-441b-b4db-1c97466cf01d => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:38:35.559163 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1e1400dc-39d7-4802-9831-74929d9e175d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:35.560433 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1e1400dc-39d7-4802-9831-74929d9e175d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:35.567514 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e1400dc-39d7-4802-9831-74929d9e175d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:35.569576 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e1400dc-39d7-4802-9831-74929d9e175d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:35.571987 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e1400dc-39d7-4802-9831-74929d9e175d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:35.574510 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e1400dc-39d7-4802-9831-74929d9e175d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:35.615824 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-83803057-504f-4769-ac19-baa27314a339 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:35.616492 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-83803057-504f-4769-ac19-baa27314a339 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:35.631458 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-83803057-504f-4769-ac19-baa27314a339 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:35.631458 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-83803057-504f-4769-ac19-baa27314a339 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:35.631458 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-83803057-504f-4769-ac19-baa27314a339 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:35.633279 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-83803057-504f-4769-ac19-baa27314a339 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:35.731080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1e1400dc-39d7-4802-9831-74929d9e175d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:35.753355 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1e1400dc-39d7-4802-9831-74929d9e175d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:35.765733 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1e1400dc-39d7-4802-9831-74929d9e175d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:35.772852 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1e1400dc-39d7-4802-9831-74929d9e175d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1285 microversion: 2.20 time: 0.217351 Oct 15 03:38:35.775554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 24/54] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:35 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1285 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:38:35.795851 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1c98b344-20f3-4ebd-909a-7fd18fda78d8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:35.796901 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1c98b344-20f3-4ebd-909a-7fd18fda78d8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:35.802955 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1c98b344-20f3-4ebd-909a-7fd18fda78d8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:35.803597 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1c98b344-20f3-4ebd-909a-7fd18fda78d8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:35.817059 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1c98b344-20f3-4ebd-909a-7fd18fda78d8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:35.817953 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1c98b344-20f3-4ebd-909a-7fd18fda78d8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:36.037959 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-83803057-504f-4769-ac19-baa27314a339 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:36.068614 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-83803057-504f-4769-ac19-baa27314a339 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1314 microversion: 2.1 time: 0.458369 Oct 15 03:38:36.084424 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 31/55] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:35 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:36.213276 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1c98b344-20f3-4ebd-909a-7fd18fda78d8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:36.228560 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1c98b344-20f3-4ebd-909a-7fd18fda78d8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1317 microversion: 2.1 time: 0.448462 Oct 15 03:38:36.242235 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 25/56] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:35 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:36.802561 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-64db0580-a7cf-4af5-8353-093109327f7f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:36.803172 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-64db0580-a7cf-4af5-8353-093109327f7f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:36.811377 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-64db0580-a7cf-4af5-8353-093109327f7f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:36.812208 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-64db0580-a7cf-4af5-8353-093109327f7f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:36.813216 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-64db0580-a7cf-4af5-8353-093109327f7f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:36.814146 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-64db0580-a7cf-4af5-8353-093109327f7f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:36.882395 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-64db0580-a7cf-4af5-8353-093109327f7f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:36.905778 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-64db0580-a7cf-4af5-8353-093109327f7f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:36.906073 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-64db0580-a7cf-4af5-8353-093109327f7f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:36.907194 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-64db0580-a7cf-4af5-8353-093109327f7f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1285 microversion: 2.20 time: 0.110012 Oct 15 03:38:36.907771 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 32/57] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:36 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:38:37.087258 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-585caac2-be1d-409b-9d6e-65af77d6ba17 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:37.087906 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-585caac2-be1d-409b-9d6e-65af77d6ba17 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:37.095575 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-585caac2-be1d-409b-9d6e-65af77d6ba17 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:37.096373 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-585caac2-be1d-409b-9d6e-65af77d6ba17 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:37.097596 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-585caac2-be1d-409b-9d6e-65af77d6ba17 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:37.098128 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-585caac2-be1d-409b-9d6e-65af77d6ba17 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:37.247408 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-756bf804-41a7-4e4f-b131-8741df05c053 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:37.257330 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-756bf804-41a7-4e4f-b131-8741df05c053 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:37.257330 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-756bf804-41a7-4e4f-b131-8741df05c053 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:37.257330 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-756bf804-41a7-4e4f-b131-8741df05c053 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:37.257330 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-756bf804-41a7-4e4f-b131-8741df05c053 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:37.257930 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-756bf804-41a7-4e4f-b131-8741df05c053 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:37.270954 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-585caac2-be1d-409b-9d6e-65af77d6ba17 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:37.279636 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-585caac2-be1d-409b-9d6e-65af77d6ba17 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1314 microversion: 2.1 time: 0.195898 Oct 15 03:38:37.283721 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 26/58] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:37 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:37.284983 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4aef6fd4-763c-427e-ba64-249996381f44 tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] Calling method '.version_select at 0x7f4abd6ec9d0>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:37.342035 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4aef6fd4-763c-427e-ba64-249996381f44 tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/1ae6cded-20ed-476c-92ee-7bfb74218215" status: 200 len: 351 microversion: 2.1 time: 0.060392 Oct 15 03:38:37.343264 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 27/59] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Oct 15 03:38:37 2021] GET /compute/v2.1/os-volumes/1ae6cded-20ed-476c-92ee-7bfb74218215 => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:38:37.357123 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cddc9564-539b-426b-bf89-25637037b183 tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] Calling method '.version_select at 0x7f4abcd11820>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:37.457910 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cddc9564-539b-426b-bf89-25637037b183 tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.107160 Oct 15 03:38:37.458656 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 28/60] 10.222.0.30 () {58 vars in 1133 bytes} [Fri Oct 15 03:38:37 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:38:37.473191 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-756bf804-41a7-4e4f-b131-8741df05c053 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:37.481368 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-756bf804-41a7-4e4f-b131-8741df05c053 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1317 microversion: 2.1 time: 0.237547 Oct 15 03:38:37.487503 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8c5f1eac-3905-47df-92d2-bd8e25d230e4 tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] Calling method '.version_select at 0x7f4abd5a6940>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:37.491916 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 33/61] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:37 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:38:37.585669 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8c5f1eac-3905-47df-92d2-bd8e25d230e4 tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.116869 Oct 15 03:38:37.586233 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 29/62] 10.222.0.30 () {58 vars in 1148 bytes} [Fri Oct 15 03:38:37 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:38:37.599462 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-62599de9-0f55-494b-a2ae-3ff3858ad41d tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] Calling method '.version_select at 0x7f4abd549670>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:37.698480 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-62599de9-0f55-494b-a2ae-3ff3858ad41d tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.102879 Oct 15 03:38:37.699795 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 34/63] 10.222.0.30 () {58 vars in 1133 bytes} [Fri Oct 15 03:38:37 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:37.710878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-dc9fa7d2-0701-4feb-b579-d0e41f38e730 tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] Calling method '.version_select at 0x7f4abd5b3430>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:37.815350 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-dc9fa7d2-0701-4feb-b579-d0e41f38e730 tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.108208 Oct 15 03:38:37.815938 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 30/64] 10.222.0.30 () {58 vars in 1166 bytes} [Fri Oct 15 03:38:37 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:38:37.832001 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8851dbfb-ef27-4bde-968c-95f8150082e8 tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] Calling method '.version_select at 0x7f4abd5f2f70>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:37.929739 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1491baa3-b284-423c-ac59-be911c3f0ec8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:37.930627 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1491baa3-b284-423c-ac59-be911c3f0ec8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:37.942751 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1491baa3-b284-423c-ac59-be911c3f0ec8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:37.943895 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1491baa3-b284-423c-ac59-be911c3f0ec8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:37.946291 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1491baa3-b284-423c-ac59-be911c3f0ec8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:37.949872 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1491baa3-b284-423c-ac59-be911c3f0ec8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:37.975312 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8851dbfb-ef27-4bde-968c-95f8150082e8 tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.150601 Oct 15 03:38:37.976612 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 35/65] 10.222.0.30 () {58 vars in 1169 bytes} [Fri Oct 15 03:38:37 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:38:37.989395 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f8686ec2-0e7b-4061-b9ab-c134a90347d1 tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] Calling method '.version_select at 0x7f4abd558160>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:38.221491 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1491baa3-b284-423c-ac59-be911c3f0ec8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:38.232681 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1491baa3-b284-423c-ac59-be911c3f0ec8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:38.234269 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1491baa3-b284-423c-ac59-be911c3f0ec8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:38.238781 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1491baa3-b284-423c-ac59-be911c3f0ec8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1285 microversion: 2.20 time: 0.312420 Oct 15 03:38:38.239389 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 31/66] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:37 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1285 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:38:38.264362 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f8686ec2-0e7b-4061-b9ab-c134a90347d1 tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.278533 Oct 15 03:38:38.265373 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 36/67] 10.222.0.30 () {58 vars in 1154 bytes} [Fri Oct 15 03:38:37 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:38.280096 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a7d2ce98-8b7b-411a-a2a6-eb975b2efa6c tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] Calling method '.version_select at 0x7f4abd5b39d0>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:38.300314 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b4fbfd8e-e5e8-4212-927d-b5a229185445 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:38.300914 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b4fbfd8e-e5e8-4212-927d-b5a229185445 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:38.319915 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b4fbfd8e-e5e8-4212-927d-b5a229185445 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:38.320679 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b4fbfd8e-e5e8-4212-927d-b5a229185445 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:38.323938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b4fbfd8e-e5e8-4212-927d-b5a229185445 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:38.327340 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b4fbfd8e-e5e8-4212-927d-b5a229185445 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:38.578259 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a7d2ce98-8b7b-411a-a2a6-eb975b2efa6c tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.305147 Oct 15 03:38:38.578809 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 32/68] 10.222.0.30 () {58 vars in 1187 bytes} [Fri Oct 15 03:38:38 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:38:38.598121 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4d4a269f-babc-4549-9135-dba9fcfc6e13 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:38.598776 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4d4a269f-babc-4549-9135-dba9fcfc6e13 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:38.609222 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b4fbfd8e-e5e8-4212-927d-b5a229185445 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:38.612978 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4d4a269f-babc-4549-9135-dba9fcfc6e13 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:38.613439 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4d4a269f-babc-4549-9135-dba9fcfc6e13 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:38.614197 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4d4a269f-babc-4549-9135-dba9fcfc6e13 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:38.619602 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4d4a269f-babc-4549-9135-dba9fcfc6e13 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:38.635299 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b4fbfd8e-e5e8-4212-927d-b5a229185445 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1314 microversion: 2.1 time: 0.342483 Oct 15 03:38:38.639747 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 37/69] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:38 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:38.667843 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-56aac94a-a8ed-488b-92f9-34d0a3e54b4b tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] Calling method '.version_select at 0x7f4abd5498b0>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:38.837043 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-56aac94a-a8ed-488b-92f9-34d0a3e54b4b tempest-VolumesTestJSON-354069623 tempest-VolumesTestJSON-354069623-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.193406 Oct 15 03:38:38.848184 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 38/70] 10.222.0.30 () {58 vars in 1154 bytes} [Fri Oct 15 03:38:38 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:38.973082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4d4a269f-babc-4549-9135-dba9fcfc6e13 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:38.986745 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4d4a269f-babc-4549-9135-dba9fcfc6e13 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1317 microversion: 2.1 time: 0.392303 Oct 15 03:38:38.991401 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 33/71] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:38 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:39.257944 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-cbb447b9-34d3-4cbd-9d12-40d1929db87c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:39.258999 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-cbb447b9-34d3-4cbd-9d12-40d1929db87c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:39.265290 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cbb447b9-34d3-4cbd-9d12-40d1929db87c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:39.265998 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cbb447b9-34d3-4cbd-9d12-40d1929db87c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:39.266866 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cbb447b9-34d3-4cbd-9d12-40d1929db87c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:39.267522 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cbb447b9-34d3-4cbd-9d12-40d1929db87c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:39.354361 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-cbb447b9-34d3-4cbd-9d12-40d1929db87c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:39.364583 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-cbb447b9-34d3-4cbd-9d12-40d1929db87c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:39.366136 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-cbb447b9-34d3-4cbd-9d12-40d1929db87c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:39.367403 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-cbb447b9-34d3-4cbd-9d12-40d1929db87c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1339 microversion: 2.20 time: 0.113541 Oct 15 03:38:39.367983 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 39/72] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:39 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1339 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:38:39.656461 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-259de3af-68d7-45c0-8fab-48339d2cd31c tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:39.657180 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-259de3af-68d7-45c0-8fab-48339d2cd31c tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:39.663552 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-259de3af-68d7-45c0-8fab-48339d2cd31c tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:39.664024 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-259de3af-68d7-45c0-8fab-48339d2cd31c tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:39.664806 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-259de3af-68d7-45c0-8fab-48339d2cd31c tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:39.665254 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-259de3af-68d7-45c0-8fab-48339d2cd31c tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:39.930634 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-259de3af-68d7-45c0-8fab-48339d2cd31c tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:39.944222 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-259de3af-68d7-45c0-8fab-48339d2cd31c tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1314 microversion: 2.1 time: 0.291769 Oct 15 03:38:39.956360 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 34/73] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:39 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:40.009782 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-01b4ea2b-3e49-4c43-84db-b4758ee359bf tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:40.012536 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-01b4ea2b-3e49-4c43-84db-b4758ee359bf tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:40.023629 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-01b4ea2b-3e49-4c43-84db-b4758ee359bf tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:40.027917 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-01b4ea2b-3e49-4c43-84db-b4758ee359bf tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:40.029084 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-01b4ea2b-3e49-4c43-84db-b4758ee359bf tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:40.029693 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-01b4ea2b-3e49-4c43-84db-b4758ee359bf tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:40.270291 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-01b4ea2b-3e49-4c43-84db-b4758ee359bf tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:40.279070 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-01b4ea2b-3e49-4c43-84db-b4758ee359bf tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1317 microversion: 2.1 time: 0.274665 Oct 15 03:38:40.279652 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 40/74] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:40 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:40.386645 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5e61438b-4522-4d42-98e5-bbfd1d14ad4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:40.387619 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5e61438b-4522-4d42-98e5-bbfd1d14ad4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:40.395382 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5e61438b-4522-4d42-98e5-bbfd1d14ad4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:40.396517 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5e61438b-4522-4d42-98e5-bbfd1d14ad4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:40.397583 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5e61438b-4522-4d42-98e5-bbfd1d14ad4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:40.398510 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5e61438b-4522-4d42-98e5-bbfd1d14ad4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:40.712178 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5e61438b-4522-4d42-98e5-bbfd1d14ad4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:40.731063 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5e61438b-4522-4d42-98e5-bbfd1d14ad4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:40.737748 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5e61438b-4522-4d42-98e5-bbfd1d14ad4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:40.739162 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5e61438b-4522-4d42-98e5-bbfd1d14ad4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1406 microversion: 2.20 time: 0.357235 Oct 15 03:38:40.750673 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 35/75] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:40 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1406 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:38:40.831088 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-bbfaa322-5575-48c4-8820-aaacc9c45d18 req-1977eb3b-01e1-4b49-a261-1703c4545946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3594fddd-dbb7-4731-8f30-b3512198e1a9", "tag": "0ebbb249-fedc-46b3-94a7-8e70531c6d22"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:38:40.832700 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:38:40.832700 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 03:38:40.845073 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-bbfaa322-5575-48c4-8820-aaacc9c45d18 req-1977eb3b-01e1-4b49-a261-1703c4545946 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:40.845538 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-bbfaa322-5575-48c4-8820-aaacc9c45d18 req-1977eb3b-01e1-4b49-a261-1703c4545946 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:40.868400 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-bbfaa322-5575-48c4-8820-aaacc9c45d18 req-1977eb3b-01e1-4b49-a261-1703c4545946 service nova] Creating event network-changed:0ebbb249-fedc-46b3-94a7-8e70531c6d22 for instance 3594fddd-dbb7-4731-8f30-b3512198e1a9 on hv-cinder-81410 Oct 15 03:38:40.887227 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-bbfaa322-5575-48c4-8820-aaacc9c45d18 req-1977eb3b-01e1-4b49-a261-1703c4545946 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059147 Oct 15 03:38:40.888899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 41/76] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:38:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:38:40.962350 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-06aa0618-2e28-4e6f-956b-d4144abcde28 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:40.963094 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-06aa0618-2e28-4e6f-956b-d4144abcde28 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:40.970898 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-06aa0618-2e28-4e6f-956b-d4144abcde28 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:40.971345 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-06aa0618-2e28-4e6f-956b-d4144abcde28 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:40.973524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-06aa0618-2e28-4e6f-956b-d4144abcde28 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:40.974198 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-06aa0618-2e28-4e6f-956b-d4144abcde28 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:41.298582 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4156e8cf-f438-44a1-8127-933822ecf294 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:41.300320 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4156e8cf-f438-44a1-8127-933822ecf294 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:41.308794 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4156e8cf-f438-44a1-8127-933822ecf294 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:41.309313 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4156e8cf-f438-44a1-8127-933822ecf294 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:41.310523 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4156e8cf-f438-44a1-8127-933822ecf294 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:41.311152 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4156e8cf-f438-44a1-8127-933822ecf294 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:41.344347 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-06aa0618-2e28-4e6f-956b-d4144abcde28 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:41.352505 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-06aa0618-2e28-4e6f-956b-d4144abcde28 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1314 microversion: 2.1 time: 0.393806 Oct 15 03:38:41.360825 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 36/77] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:40 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:41.543984 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4156e8cf-f438-44a1-8127-933822ecf294 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:41.552660 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4156e8cf-f438-44a1-8127-933822ecf294 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1317 microversion: 2.1 time: 0.259766 Oct 15 03:38:41.563750 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 42/78] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:41 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:41.758808 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fec535ca-fd0e-4ad1-9025-3e03c3eb57f3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:41.760220 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fec535ca-fd0e-4ad1-9025-3e03c3eb57f3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:41.770175 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fec535ca-fd0e-4ad1-9025-3e03c3eb57f3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:41.770589 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fec535ca-fd0e-4ad1-9025-3e03c3eb57f3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:41.771564 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fec535ca-fd0e-4ad1-9025-3e03c3eb57f3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:41.772027 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fec535ca-fd0e-4ad1-9025-3e03c3eb57f3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:42.065171 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fec535ca-fd0e-4ad1-9025-3e03c3eb57f3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:42.073738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fec535ca-fd0e-4ad1-9025-3e03c3eb57f3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:42.076033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fec535ca-fd0e-4ad1-9025-3e03c3eb57f3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:42.077701 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fec535ca-fd0e-4ad1-9025-3e03c3eb57f3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1406 microversion: 2.20 time: 0.323290 Oct 15 03:38:42.078254 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 37/79] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:41 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:38:42.369540 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a35d5efb-9fb7-4613-8bf3-3ddd17811de6 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:42.371930 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a35d5efb-9fb7-4613-8bf3-3ddd17811de6 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:42.378644 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a35d5efb-9fb7-4613-8bf3-3ddd17811de6 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:42.379303 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a35d5efb-9fb7-4613-8bf3-3ddd17811de6 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:42.380315 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a35d5efb-9fb7-4613-8bf3-3ddd17811de6 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:42.380974 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a35d5efb-9fb7-4613-8bf3-3ddd17811de6 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:42.550356 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-a35d5efb-9fb7-4613-8bf3-3ddd17811de6 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:42.559722 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a35d5efb-9fb7-4613-8bf3-3ddd17811de6 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1314 microversion: 2.1 time: 0.193969 Oct 15 03:38:42.560284 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 43/80] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:42 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:42.571159 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1843f50f-1c83-4252-bf8b-2b2d8e6ddfcb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:42.572008 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1843f50f-1c83-4252-bf8b-2b2d8e6ddfcb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:42.578028 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1843f50f-1c83-4252-bf8b-2b2d8e6ddfcb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:42.578583 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1843f50f-1c83-4252-bf8b-2b2d8e6ddfcb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:42.579383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1843f50f-1c83-4252-bf8b-2b2d8e6ddfcb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:42.579851 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1843f50f-1c83-4252-bf8b-2b2d8e6ddfcb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:42.704124 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1843f50f-1c83-4252-bf8b-2b2d8e6ddfcb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:42.711312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1843f50f-1c83-4252-bf8b-2b2d8e6ddfcb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1317 microversion: 2.1 time: 0.144687 Oct 15 03:38:42.712004 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 38/81] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:42 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:38:43.096521 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ce0bde31-7fb2-4697-82cd-9758227a9cb1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:43.097163 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ce0bde31-7fb2-4697-82cd-9758227a9cb1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:43.109091 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce0bde31-7fb2-4697-82cd-9758227a9cb1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:43.110430 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce0bde31-7fb2-4697-82cd-9758227a9cb1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:43.112089 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce0bde31-7fb2-4697-82cd-9758227a9cb1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:43.112781 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce0bde31-7fb2-4697-82cd-9758227a9cb1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:43.384842 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ce0bde31-7fb2-4697-82cd-9758227a9cb1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:43.400981 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ce0bde31-7fb2-4697-82cd-9758227a9cb1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:43.403480 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ce0bde31-7fb2-4697-82cd-9758227a9cb1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:43.407392 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ce0bde31-7fb2-4697-82cd-9758227a9cb1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1406 microversion: 2.20 time: 0.314405 Oct 15 03:38:43.418305 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 44/82] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:43 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1406 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:38:43.578406 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2543aeef-53c8-4735-afea-bd7325dc7ae4 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:43.579460 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2543aeef-53c8-4735-afea-bd7325dc7ae4 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:43.592994 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2543aeef-53c8-4735-afea-bd7325dc7ae4 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:43.594663 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2543aeef-53c8-4735-afea-bd7325dc7ae4 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:43.598172 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2543aeef-53c8-4735-afea-bd7325dc7ae4 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:43.598744 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2543aeef-53c8-4735-afea-bd7325dc7ae4 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:43.729352 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fe0d5b6c-2072-4efb-9156-62799712bb01 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:43.730000 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fe0d5b6c-2072-4efb-9156-62799712bb01 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:43.740000 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe0d5b6c-2072-4efb-9156-62799712bb01 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:43.741951 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe0d5b6c-2072-4efb-9156-62799712bb01 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:43.742911 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe0d5b6c-2072-4efb-9156-62799712bb01 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:43.744227 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe0d5b6c-2072-4efb-9156-62799712bb01 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:44.144776 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2543aeef-53c8-4735-afea-bd7325dc7ae4 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:44.160285 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2543aeef-53c8-4735-afea-bd7325dc7ae4 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1314 microversion: 2.1 time: 0.586064 Oct 15 03:38:44.162443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 39/83] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:43 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:44.188909 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fe0d5b6c-2072-4efb-9156-62799712bb01 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:44.196084 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fe0d5b6c-2072-4efb-9156-62799712bb01 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1317 microversion: 2.1 time: 0.471042 Oct 15 03:38:44.202378 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 45/84] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:43 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:44.434763 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-60b28f63-4742-487c-89f8-7499914226ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:44.435476 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-60b28f63-4742-487c-89f8-7499914226ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:44.443254 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-60b28f63-4742-487c-89f8-7499914226ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:44.443891 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-60b28f63-4742-487c-89f8-7499914226ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:44.444953 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-60b28f63-4742-487c-89f8-7499914226ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:44.445735 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-60b28f63-4742-487c-89f8-7499914226ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:44.526144 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-583305bd-b871-4e1b-9299-84e71cf8b633 req-8138c0bb-b62d-48fa-b5a9-1aec1510ceae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "612f42d0-d719-4a5f-bcb9-029c18112f69", "name": "network-vif-plugged", "status": "completed", "tag": "230afb5a-d538-4679-93eb-d7a4ac314ae4"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:38:44.529204 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:38:44.529204 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:38:44.549392 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-583305bd-b871-4e1b-9299-84e71cf8b633 req-8138c0bb-b62d-48fa-b5a9-1aec1510ceae service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:44.551189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-583305bd-b871-4e1b-9299-84e71cf8b633 req-8138c0bb-b62d-48fa-b5a9-1aec1510ceae service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:44.579621 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-583305bd-b871-4e1b-9299-84e71cf8b633 req-8138c0bb-b62d-48fa-b5a9-1aec1510ceae service nova] Creating event network-vif-plugged:230afb5a-d538-4679-93eb-d7a4ac314ae4 for instance 612f42d0-d719-4a5f-bcb9-029c18112f69 on hv-cinder-81410 Oct 15 03:38:44.586078 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-583305bd-b871-4e1b-9299-84e71cf8b633 req-8138c0bb-b62d-48fa-b5a9-1aec1510ceae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.420810 Oct 15 03:38:44.586817 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 40/85] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:38:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:38:44.625659 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-60b28f63-4742-487c-89f8-7499914226ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:44.638636 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-60b28f63-4742-487c-89f8-7499914226ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:44.647155 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-60b28f63-4742-487c-89f8-7499914226ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:44.648503 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-60b28f63-4742-487c-89f8-7499914226ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1406 microversion: 2.20 time: 0.223310 Oct 15 03:38:44.649455 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 46/86] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:44 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:38:45.182890 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-655ffeca-6ed2-4c23-ac22-200186609e78 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:45.185181 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-655ffeca-6ed2-4c23-ac22-200186609e78 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:45.202810 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-655ffeca-6ed2-4c23-ac22-200186609e78 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:45.203313 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-655ffeca-6ed2-4c23-ac22-200186609e78 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:45.205107 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-655ffeca-6ed2-4c23-ac22-200186609e78 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:45.205550 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-655ffeca-6ed2-4c23-ac22-200186609e78 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:45.213883 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3065f88e-ea9c-4a3f-8fad-8634db6b3f59 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:45.224207 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3065f88e-ea9c-4a3f-8fad-8634db6b3f59 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:45.239708 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3065f88e-ea9c-4a3f-8fad-8634db6b3f59 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:45.241375 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3065f88e-ea9c-4a3f-8fad-8634db6b3f59 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:45.242612 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3065f88e-ea9c-4a3f-8fad-8634db6b3f59 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:45.246506 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3065f88e-ea9c-4a3f-8fad-8634db6b3f59 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:45.514269 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-655ffeca-6ed2-4c23-ac22-200186609e78 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:45.523101 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-655ffeca-6ed2-4c23-ac22-200186609e78 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1314 microversion: 2.1 time: 0.347068 Oct 15 03:38:45.540765 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 41/87] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:45 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:45.622881 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3065f88e-ea9c-4a3f-8fad-8634db6b3f59 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:45.633036 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3065f88e-ea9c-4a3f-8fad-8634db6b3f59 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1317 microversion: 2.1 time: 0.422836 Oct 15 03:38:45.636069 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 47/88] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:45 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:38:45.666936 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a530e292-e7c3-4ac9-8b10-e9c5aea3da63 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:45.667572 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a530e292-e7c3-4ac9-8b10-e9c5aea3da63 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:45.674669 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a530e292-e7c3-4ac9-8b10-e9c5aea3da63 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:45.675346 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a530e292-e7c3-4ac9-8b10-e9c5aea3da63 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:45.679201 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a530e292-e7c3-4ac9-8b10-e9c5aea3da63 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:45.679703 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a530e292-e7c3-4ac9-8b10-e9c5aea3da63 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:45.898419 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a530e292-e7c3-4ac9-8b10-e9c5aea3da63 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:45.908111 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a530e292-e7c3-4ac9-8b10-e9c5aea3da63 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:45.911056 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a530e292-e7c3-4ac9-8b10-e9c5aea3da63 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:45.913261 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a530e292-e7c3-4ac9-8b10-e9c5aea3da63 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1406 microversion: 2.20 time: 0.249958 Oct 15 03:38:45.914769 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 42/89] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:45 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:38:46.548589 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c2b290c9-0967-4bd9-8f25-11915bc0a3fd tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:46.549418 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c2b290c9-0967-4bd9-8f25-11915bc0a3fd tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:46.555874 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c2b290c9-0967-4bd9-8f25-11915bc0a3fd tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:46.556507 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c2b290c9-0967-4bd9-8f25-11915bc0a3fd tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:46.558889 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c2b290c9-0967-4bd9-8f25-11915bc0a3fd tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:46.559599 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c2b290c9-0967-4bd9-8f25-11915bc0a3fd tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:46.603029 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-e55aaf30-7932-4378-a985-251fd6abb2c2 req-d3b07c2d-6e89-4aa2-b824-b4035d47cbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479f8628-5c56-459e-8ff7-d2fee24b613a", "name": "network-vif-plugged", "status": "completed", "tag": "aa7c0da7-52ba-4e18-9d99-9b4c9b8183c4"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:38:46.604640 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:38:46.604640 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:38:46.612142 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-e55aaf30-7932-4378-a985-251fd6abb2c2 req-d3b07c2d-6e89-4aa2-b824-b4035d47cbd3 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:46.612573 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-e55aaf30-7932-4378-a985-251fd6abb2c2 req-d3b07c2d-6e89-4aa2-b824-b4035d47cbd3 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:46.625316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-e55aaf30-7932-4378-a985-251fd6abb2c2 req-d3b07c2d-6e89-4aa2-b824-b4035d47cbd3 service nova] Creating event network-vif-plugged:aa7c0da7-52ba-4e18-9d99-9b4c9b8183c4 for instance 479f8628-5c56-459e-8ff7-d2fee24b613a on hv-cinder-81410 Oct 15 03:38:46.631508 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-e55aaf30-7932-4378-a985-251fd6abb2c2 req-d3b07c2d-6e89-4aa2-b824-b4035d47cbd3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032305 Oct 15 03:38:46.637194 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 43/90] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:38:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:38:46.655378 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3b181f14-7af7-4622-be75-447513f87809 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:46.656269 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3b181f14-7af7-4622-be75-447513f87809 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:46.691573 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b181f14-7af7-4622-be75-447513f87809 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:46.692279 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b181f14-7af7-4622-be75-447513f87809 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:46.692831 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b181f14-7af7-4622-be75-447513f87809 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:46.693282 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b181f14-7af7-4622-be75-447513f87809 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:46.808011 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c2b290c9-0967-4bd9-8f25-11915bc0a3fd tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:46.841980 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c2b290c9-0967-4bd9-8f25-11915bc0a3fd tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1314 microversion: 2.1 time: 0.288519 Oct 15 03:38:46.844534 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 48/91] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:46 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:46.942197 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-aaed0615-8e8a-4984-b905-77076ddd62e8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:46.943056 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-aaed0615-8e8a-4984-b905-77076ddd62e8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:46.956394 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aaed0615-8e8a-4984-b905-77076ddd62e8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:46.956854 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aaed0615-8e8a-4984-b905-77076ddd62e8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:46.957635 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aaed0615-8e8a-4984-b905-77076ddd62e8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:46.961878 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aaed0615-8e8a-4984-b905-77076ddd62e8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:46.975712 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3b181f14-7af7-4622-be75-447513f87809 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:46.987746 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3b181f14-7af7-4622-be75-447513f87809 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1508 microversion: 2.1 time: 0.335433 Oct 15 03:38:46.989033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 44/92] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:46 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1508 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:47.158456 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-aaed0615-8e8a-4984-b905-77076ddd62e8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:47.168571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-aaed0615-8e8a-4984-b905-77076ddd62e8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:47.171087 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-aaed0615-8e8a-4984-b905-77076ddd62e8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:47.172374 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-aaed0615-8e8a-4984-b905-77076ddd62e8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1406 microversion: 2.20 time: 0.234653 Oct 15 03:38:47.184079 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 49/93] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:46 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:38:47.851545 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f6b750c7-238f-4f7b-907c-b8e1fae997d6 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:47.855623 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f6b750c7-238f-4f7b-907c-b8e1fae997d6 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:47.869099 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6b750c7-238f-4f7b-907c-b8e1fae997d6 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:47.870096 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6b750c7-238f-4f7b-907c-b8e1fae997d6 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:47.872091 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6b750c7-238f-4f7b-907c-b8e1fae997d6 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:47.872706 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6b750c7-238f-4f7b-907c-b8e1fae997d6 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:48.036061 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f6b750c7-238f-4f7b-907c-b8e1fae997d6 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:48.055793 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f6b750c7-238f-4f7b-907c-b8e1fae997d6 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1314 microversion: 2.1 time: 0.209178 Oct 15 03:38:48.056465 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 45/94] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:47 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:48.189997 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-84d181ca-e2aa-4423-82ec-0826ddee3ffd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:48.190606 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-84d181ca-e2aa-4423-82ec-0826ddee3ffd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:48.199038 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-84d181ca-e2aa-4423-82ec-0826ddee3ffd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:48.200089 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-84d181ca-e2aa-4423-82ec-0826ddee3ffd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:48.200871 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-84d181ca-e2aa-4423-82ec-0826ddee3ffd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:48.208835 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-84d181ca-e2aa-4423-82ec-0826ddee3ffd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:48.375714 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-84d181ca-e2aa-4423-82ec-0826ddee3ffd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:48.383833 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-84d181ca-e2aa-4423-82ec-0826ddee3ffd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:48.385327 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-84d181ca-e2aa-4423-82ec-0826ddee3ffd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:48.387261 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-84d181ca-e2aa-4423-82ec-0826ddee3ffd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1406 microversion: 2.20 time: 0.200807 Oct 15 03:38:48.388144 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 50/95] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:48 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:38:48.650820 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-1a0f7040-1385-447a-81d7-07099771c568 req-84363760-e2e9-4736-9071-140c048cdc7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3594fddd-dbb7-4731-8f30-b3512198e1a9", "name": "network-vif-plugged", "status": "completed", "tag": "0ebbb249-fedc-46b3-94a7-8e70531c6d22"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:38:48.652822 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:38:48.652822 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:38:48.661284 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-1a0f7040-1385-447a-81d7-07099771c568 req-84363760-e2e9-4736-9071-140c048cdc7a service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:48.661907 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-1a0f7040-1385-447a-81d7-07099771c568 req-84363760-e2e9-4736-9071-140c048cdc7a service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:48.681290 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-1a0f7040-1385-447a-81d7-07099771c568 req-84363760-e2e9-4736-9071-140c048cdc7a service nova] Creating event network-vif-plugged:0ebbb249-fedc-46b3-94a7-8e70531c6d22 for instance 3594fddd-dbb7-4731-8f30-b3512198e1a9 on hv-cinder-81410 Oct 15 03:38:48.686145 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-1a0f7040-1385-447a-81d7-07099771c568 req-84363760-e2e9-4736-9071-140c048cdc7a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038836 Oct 15 03:38:48.687229 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 46/96] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:38:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:38:48.801782 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3a5ea1a6-4a01-4d62-8067-a5e12e867d81 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dca708c-24a9-437f-9f11-dbfd3a66e2cd"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:38:48.804216 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3a5ea1a6-4a01-4d62-8067-a5e12e867d81 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:48.818863 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a5ea1a6-4a01-4d62-8067-a5e12e867d81 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:48.819915 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a5ea1a6-4a01-4d62-8067-a5e12e867d81 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:48.821287 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a5ea1a6-4a01-4d62-8067-a5e12e867d81 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:48.821912 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a5ea1a6-4a01-4d62-8067-a5e12e867d81 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:49.075727 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f0b93154-6591-47b7-ba85-b7c1ab4b05d9 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:49.076489 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f0b93154-6591-47b7-ba85-b7c1ab4b05d9 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:49.090041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f0b93154-6591-47b7-ba85-b7c1ab4b05d9 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:49.090697 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f0b93154-6591-47b7-ba85-b7c1ab4b05d9 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:49.092608 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f0b93154-6591-47b7-ba85-b7c1ab4b05d9 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:49.093219 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f0b93154-6591-47b7-ba85-b7c1ab4b05d9 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:49.275215 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f0b93154-6591-47b7-ba85-b7c1ab4b05d9 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:49.283235 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f0b93154-6591-47b7-ba85-b7c1ab4b05d9 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1501 microversion: 2.1 time: 0.213646 Oct 15 03:38:49.284339 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 47/97] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:38:49 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1501 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:38:49.413119 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2a41d746-0469-464b-bd57-18109d45b4fa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:49.413910 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2a41d746-0469-464b-bd57-18109d45b4fa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:49.420579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2a41d746-0469-464b-bd57-18109d45b4fa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:49.421740 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2a41d746-0469-464b-bd57-18109d45b4fa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:49.422657 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2a41d746-0469-464b-bd57-18109d45b4fa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:49.423231 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2a41d746-0469-464b-bd57-18109d45b4fa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:49.604878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2a41d746-0469-464b-bd57-18109d45b4fa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:49.615422 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2a41d746-0469-464b-bd57-18109d45b4fa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:49.617025 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2a41d746-0469-464b-bd57-18109d45b4fa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:49.618209 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2a41d746-0469-464b-bd57-18109d45b4fa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1406 microversion: 2.20 time: 0.214664 Oct 15 03:38:49.618839 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 48/98] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:49 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:38:50.636113 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bfa2c6a8-58d6-4316-9b72-1490f6872d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:50.636725 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bfa2c6a8-58d6-4316-9b72-1490f6872d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:50.642533 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bfa2c6a8-58d6-4316-9b72-1490f6872d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:50.642985 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bfa2c6a8-58d6-4316-9b72-1490f6872d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:50.643773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bfa2c6a8-58d6-4316-9b72-1490f6872d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:50.644203 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bfa2c6a8-58d6-4316-9b72-1490f6872d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:50.777302 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bfa2c6a8-58d6-4316-9b72-1490f6872d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:50.785367 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bfa2c6a8-58d6-4316-9b72-1490f6872d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:50.787642 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bfa2c6a8-58d6-4316-9b72-1490f6872d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:50.789014 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bfa2c6a8-58d6-4316-9b72-1490f6872d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1406 microversion: 2.20 time: 0.156662 Oct 15 03:38:50.789762 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 49/99] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:50 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:38:51.807049 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-91bb52ab-e0b7-40ee-af6d-c81312de0773 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:51.808816 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-91bb52ab-e0b7-40ee-af6d-c81312de0773 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:51.814474 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-91bb52ab-e0b7-40ee-af6d-c81312de0773 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:51.814908 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-91bb52ab-e0b7-40ee-af6d-c81312de0773 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:51.815873 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-91bb52ab-e0b7-40ee-af6d-c81312de0773 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:51.816301 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-91bb52ab-e0b7-40ee-af6d-c81312de0773 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:51.941867 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-91bb52ab-e0b7-40ee-af6d-c81312de0773 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:51.951656 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-91bb52ab-e0b7-40ee-af6d-c81312de0773 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:51.953489 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-91bb52ab-e0b7-40ee-af6d-c81312de0773 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:51.954715 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-91bb52ab-e0b7-40ee-af6d-c81312de0773 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1406 microversion: 2.20 time: 0.151310 Oct 15 03:38:51.955334 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 50/100] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:51 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:38:52.246273 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3a5ea1a6-4a01-4d62-8067-a5e12e867d81 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "POST /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.448854 Oct 15 03:38:52.251280 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 51/101] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Oct 15 03:38:48 2021] POST /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69/os-volume_attachments => generated 194 bytes in 3451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:38:52.973159 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f4dc0a8b-f8b9-4435-b8de-850eddf49af8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:52.973758 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f4dc0a8b-f8b9-4435-b8de-850eddf49af8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:52.979268 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f4dc0a8b-f8b9-4435-b8de-850eddf49af8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:52.979737 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f4dc0a8b-f8b9-4435-b8de-850eddf49af8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:52.980498 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f4dc0a8b-f8b9-4435-b8de-850eddf49af8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:52.980918 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f4dc0a8b-f8b9-4435-b8de-850eddf49af8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:53.103640 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f4dc0a8b-f8b9-4435-b8de-850eddf49af8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:53.111814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f4dc0a8b-f8b9-4435-b8de-850eddf49af8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:53.113352 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f4dc0a8b-f8b9-4435-b8de-850eddf49af8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:53.114449 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f4dc0a8b-f8b9-4435-b8de-850eddf49af8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1406 microversion: 2.20 time: 0.145031 Oct 15 03:38:53.114993 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 51/102] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:52 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1406 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:38:54.132772 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fc448112-0e5b-4607-80d6-0e80b7a96bb4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:54.133505 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fc448112-0e5b-4607-80d6-0e80b7a96bb4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:54.141216 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fc448112-0e5b-4607-80d6-0e80b7a96bb4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:54.141664 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fc448112-0e5b-4607-80d6-0e80b7a96bb4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:54.142435 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fc448112-0e5b-4607-80d6-0e80b7a96bb4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:54.142868 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fc448112-0e5b-4607-80d6-0e80b7a96bb4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:54.259503 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fc448112-0e5b-4607-80d6-0e80b7a96bb4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:54.267782 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fc448112-0e5b-4607-80d6-0e80b7a96bb4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:54.269284 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fc448112-0e5b-4607-80d6-0e80b7a96bb4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:54.270376 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fc448112-0e5b-4607-80d6-0e80b7a96bb4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1406 microversion: 2.20 time: 0.142173 Oct 15 03:38:54.270925 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 52/103] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:54 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1406 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:38:55.291019 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-88c07cbe-af0c-44c4-89c9-5e64d9bda5ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:55.292082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-88c07cbe-af0c-44c4-89c9-5e64d9bda5ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:55.300810 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-88c07cbe-af0c-44c4-89c9-5e64d9bda5ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:55.301302 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-88c07cbe-af0c-44c4-89c9-5e64d9bda5ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:55.302531 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-88c07cbe-af0c-44c4-89c9-5e64d9bda5ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:55.303230 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-88c07cbe-af0c-44c4-89c9-5e64d9bda5ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:55.426375 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-88c07cbe-af0c-44c4-89c9-5e64d9bda5ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:55.434026 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-88c07cbe-af0c-44c4-89c9-5e64d9bda5ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:55.435512 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-88c07cbe-af0c-44c4-89c9-5e64d9bda5ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:55.436633 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-88c07cbe-af0c-44c4-89c9-5e64d9bda5ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1406 microversion: 2.20 time: 0.152204 Oct 15 03:38:55.437174 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 52/104] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:55 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:38:56.036236 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-faae502e-397b-4bb0-8266-fd16702a01ce tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce79c39a-b8ad-4f2d-a05d-9f6c02ce83c3"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:38:56.038077 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-faae502e-397b-4bb0-8266-fd16702a01ce tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:56.044657 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-faae502e-397b-4bb0-8266-fd16702a01ce tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:56.045176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-faae502e-397b-4bb0-8266-fd16702a01ce tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:56.046008 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-faae502e-397b-4bb0-8266-fd16702a01ce tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:56.047223 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-faae502e-397b-4bb0-8266-fd16702a01ce tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:56.454031 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6ab68ee2-f1c8-4b76-8383-25e2a60a12f2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:56.454648 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6ab68ee2-f1c8-4b76-8383-25e2a60a12f2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:56.460340 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6ab68ee2-f1c8-4b76-8383-25e2a60a12f2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:56.460792 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6ab68ee2-f1c8-4b76-8383-25e2a60a12f2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:56.461556 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6ab68ee2-f1c8-4b76-8383-25e2a60a12f2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:56.462077 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6ab68ee2-f1c8-4b76-8383-25e2a60a12f2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:56.625033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6ab68ee2-f1c8-4b76-8383-25e2a60a12f2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:56.632667 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6ab68ee2-f1c8-4b76-8383-25e2a60a12f2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:56.634163 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6ab68ee2-f1c8-4b76-8383-25e2a60a12f2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:56.635253 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6ab68ee2-f1c8-4b76-8383-25e2a60a12f2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1406 microversion: 2.20 time: 0.184853 Oct 15 03:38:56.636494 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 53/105] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:56 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:38:57.653104 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1c093e80-d082-4fdf-98d5-9377aae38ef8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:57.653748 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1c093e80-d082-4fdf-98d5-9377aae38ef8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:57.659408 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1c093e80-d082-4fdf-98d5-9377aae38ef8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:57.659994 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1c093e80-d082-4fdf-98d5-9377aae38ef8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:57.660743 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1c093e80-d082-4fdf-98d5-9377aae38ef8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:57.661167 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1c093e80-d082-4fdf-98d5-9377aae38ef8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:57.782632 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1c093e80-d082-4fdf-98d5-9377aae38ef8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:57.790404 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1c093e80-d082-4fdf-98d5-9377aae38ef8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:57.792008 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1c093e80-d082-4fdf-98d5-9377aae38ef8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:57.793455 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1c093e80-d082-4fdf-98d5-9377aae38ef8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1406 microversion: 2.20 time: 0.144024 Oct 15 03:38:57.793992 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 54/106] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:57 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1406 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:38:58.789069 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-faae502e-397b-4bb0-8266-fd16702a01ce tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "POST /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.755903 Oct 15 03:38:58.789680 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 53/107] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Oct 15 03:38:56 2021] POST /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a/os-volume_attachments => generated 194 bytes in 2758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:38:58.810873 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8cfdebbf-325f-46ab-8b99-6c217fee78e4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:58.811473 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8cfdebbf-325f-46ab-8b99-6c217fee78e4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:58.817190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8cfdebbf-325f-46ab-8b99-6c217fee78e4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:58.817632 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8cfdebbf-325f-46ab-8b99-6c217fee78e4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:58.818384 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8cfdebbf-325f-46ab-8b99-6c217fee78e4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:58.818814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8cfdebbf-325f-46ab-8b99-6c217fee78e4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:58.950821 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8cfdebbf-325f-46ab-8b99-6c217fee78e4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:58.958532 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8cfdebbf-325f-46ab-8b99-6c217fee78e4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:58.960059 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8cfdebbf-325f-46ab-8b99-6c217fee78e4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:38:58.970993 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8cfdebbf-325f-46ab-8b99-6c217fee78e4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1406 microversion: 2.20 time: 0.154580 Oct 15 03:38:58.970993 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 55/108] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:58 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:38:59.980064 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6ea964f2-f9f9-4b4f-831f-687db8246206 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:38:59.980760 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6ea964f2-f9f9-4b4f-831f-687db8246206 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:38:59.987489 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6ea964f2-f9f9-4b4f-831f-687db8246206 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:59.987962 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6ea964f2-f9f9-4b4f-831f-687db8246206 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:38:59.988722 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6ea964f2-f9f9-4b4f-831f-687db8246206 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:38:59.989163 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6ea964f2-f9f9-4b4f-831f-687db8246206 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:00.256344 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6ea964f2-f9f9-4b4f-831f-687db8246206 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:00.264419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6ea964f2-f9f9-4b4f-831f-687db8246206 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:00.265923 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6ea964f2-f9f9-4b4f-831f-687db8246206 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:00.267058 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6ea964f2-f9f9-4b4f-831f-687db8246206 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1598 microversion: 2.20 time: 0.290974 Oct 15 03:39:00.267613 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 54/109] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:38:59 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1598 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:39:00.288886 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b6e49440-1281-49fc-b4fa-1522ede35c12 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:00.289378 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b6e49440-1281-49fc-b4fa-1522ede35c12 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:00.296079 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b6e49440-1281-49fc-b4fa-1522ede35c12 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:00.296526 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b6e49440-1281-49fc-b4fa-1522ede35c12 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:00.297288 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b6e49440-1281-49fc-b4fa-1522ede35c12 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:00.297719 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b6e49440-1281-49fc-b4fa-1522ede35c12 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:00.410600 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b6e49440-1281-49fc-b4fa-1522ede35c12 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.125657 Oct 15 03:39:00.411189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 56/110] 10.222.0.30 () {60 vars in 1315 bytes} [Fri Oct 15 03:39:00 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:39:01.694983 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-130a4f45-2516-4e25-811e-0984066556bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:01.695976 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-130a4f45-2516-4e25-811e-0984066556bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:01.697458 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-e6c6ad43-c35b-432f-824b-d53ba12def50 req-781e321e-4c7e-4a93-8514-d4b0b85628e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3594fddd-dbb7-4731-8f30-b3512198e1a9", "tag": "0ebbb249-fedc-46b3-94a7-8e70531c6d22"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:01.700837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:39:01.700837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:39:01.703112 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-130a4f45-2516-4e25-811e-0984066556bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:01.703749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-130a4f45-2516-4e25-811e-0984066556bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:01.704699 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-130a4f45-2516-4e25-811e-0984066556bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:01.705285 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-130a4f45-2516-4e25-811e-0984066556bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:01.708527 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-e6c6ad43-c35b-432f-824b-d53ba12def50 req-781e321e-4c7e-4a93-8514-d4b0b85628e5 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:01.709034 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-e6c6ad43-c35b-432f-824b-d53ba12def50 req-781e321e-4c7e-4a93-8514-d4b0b85628e5 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:01.720763 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-e6c6ad43-c35b-432f-824b-d53ba12def50 req-781e321e-4c7e-4a93-8514-d4b0b85628e5 service nova] Creating event network-changed:0ebbb249-fedc-46b3-94a7-8e70531c6d22 for instance 3594fddd-dbb7-4731-8f30-b3512198e1a9 on hv-cinder-81410 Oct 15 03:39:01.726280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-e6c6ad43-c35b-432f-824b-d53ba12def50 req-781e321e-4c7e-4a93-8514-d4b0b85628e5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032645 Oct 15 03:39:01.727611 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 57/111] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:39:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:39:02.118738 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-130a4f45-2516-4e25-811e-0984066556bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 14 microversion: 2.20 time: 0.427424 Oct 15 03:39:02.120000 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 55/112] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:01 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 14 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:03.130669 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-675fe3e7-c436-4b28-b5df-ac56badaa0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:03.131617 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-675fe3e7-c436-4b28-b5df-ac56badaa0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:03.138004 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-675fe3e7-c436-4b28-b5df-ac56badaa0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:03.138451 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-675fe3e7-c436-4b28-b5df-ac56badaa0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:03.139209 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-675fe3e7-c436-4b28-b5df-ac56badaa0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:03.139638 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-675fe3e7-c436-4b28-b5df-ac56badaa0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:05.567338 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-675fe3e7-c436-4b28-b5df-ac56badaa0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 14 microversion: 2.20 time: 2.440402 Oct 15 03:39:05.567973 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 58/113] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:03 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 14 bytes in 2442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:06.578825 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-63c43e49-257e-4652-9a77-817c0a7ced1f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:06.579901 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-63c43e49-257e-4652-9a77-817c0a7ced1f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:06.586852 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-63c43e49-257e-4652-9a77-817c0a7ced1f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:06.587289 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-63c43e49-257e-4652-9a77-817c0a7ced1f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:06.588126 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-63c43e49-257e-4652-9a77-817c0a7ced1f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:06.588505 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-63c43e49-257e-4652-9a77-817c0a7ced1f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:06.666415 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-63c43e49-257e-4652-9a77-817c0a7ced1f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 14 microversion: 2.20 time: 0.091347 Oct 15 03:39:06.668052 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 56/114] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:06 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:07.678808 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6a3dddd2-880c-4fe9-9bb9-b54cafd1923a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:07.680837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6a3dddd2-880c-4fe9-9bb9-b54cafd1923a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:07.688715 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6a3dddd2-880c-4fe9-9bb9-b54cafd1923a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:07.689234 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6a3dddd2-880c-4fe9-9bb9-b54cafd1923a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:07.690085 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6a3dddd2-880c-4fe9-9bb9-b54cafd1923a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:07.690663 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6a3dddd2-880c-4fe9-9bb9-b54cafd1923a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:10.254702 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6a3dddd2-880c-4fe9-9bb9-b54cafd1923a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 14 microversion: 2.20 time: 2.579770 Oct 15 03:39:10.255320 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 59/115] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:07 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 14 bytes in 2581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:39:11.265610 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-59f64082-86ba-4a01-b538-83679b588b32 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:11.266703 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-59f64082-86ba-4a01-b538-83679b588b32 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:11.273196 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-59f64082-86ba-4a01-b538-83679b588b32 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:11.273807 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-59f64082-86ba-4a01-b538-83679b588b32 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:11.274459 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-59f64082-86ba-4a01-b538-83679b588b32 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:11.274891 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-59f64082-86ba-4a01-b538-83679b588b32 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:11.352133 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-59f64082-86ba-4a01-b538-83679b588b32 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 14 microversion: 2.20 time: 0.090823 Oct 15 03:39:11.352758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 57/116] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:11 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:12.366781 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-21141ff4-614f-4915-ab41-5cdf1b1273f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:12.369863 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-21141ff4-614f-4915-ab41-5cdf1b1273f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:12.388282 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-21141ff4-614f-4915-ab41-5cdf1b1273f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:12.388982 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-21141ff4-614f-4915-ab41-5cdf1b1273f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:12.389853 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-21141ff4-614f-4915-ab41-5cdf1b1273f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:12.390348 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-21141ff4-614f-4915-ab41-5cdf1b1273f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:12.460023 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-21141ff4-614f-4915-ab41-5cdf1b1273f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 14 microversion: 2.20 time: 0.101124 Oct 15 03:39:12.460973 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 60/117] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:12 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:13.472396 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-cdd52aff-01eb-4c7d-8e20-5126268d8b05 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:13.472964 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-cdd52aff-01eb-4c7d-8e20-5126268d8b05 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:13.479037 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cdd52aff-01eb-4c7d-8e20-5126268d8b05 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:13.479899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cdd52aff-01eb-4c7d-8e20-5126268d8b05 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:13.480829 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cdd52aff-01eb-4c7d-8e20-5126268d8b05 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:13.481258 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cdd52aff-01eb-4c7d-8e20-5126268d8b05 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:15.980195 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-cdd52aff-01eb-4c7d-8e20-5126268d8b05 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 15025 microversion: 2.20 time: 2.512237 Oct 15 03:39:15.980908 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 58/118] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:13 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 15025 bytes in 2514 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:16.743427 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8937b515-4278-4d2c-bc27-c05eb8ef7b6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1339051854", "imageRef": "0ec12dbd-23ec-4d58-b215-4e3cd5f17594", "flavorRef": "452", "networks": [{"uuid": "beb50f10-7a82-4ec6-9454-85dffb8b4cbb"}]}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:16.798875 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.network.neutron [None req-8937b515-4278-4d2c-bc27-c05eb8ef7b6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] validate_networks() for [('beb50f10-7a82-4ec6-9454-85dffb8b4cbb', None, None, None, None, None)] {{(pid=120897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 15 03:39:16.992155 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c6c1e032-5e70-4e64-bc2e-fccb43805d65 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:16.993323 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c6c1e032-5e70-4e64-bc2e-fccb43805d65 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:17.000453 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6c1e032-5e70-4e64-bc2e-fccb43805d65 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:17.000903 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6c1e032-5e70-4e64-bc2e-fccb43805d65 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:17.001670 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6c1e032-5e70-4e64-bc2e-fccb43805d65 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:17.002097 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6c1e032-5e70-4e64-bc2e-fccb43805d65 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:17.081599 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c6c1e032-5e70-4e64-bc2e-fccb43805d65 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 17808 microversion: 2.20 time: 0.093503 Oct 15 03:39:17.085974 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 59/119] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:16 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 17808 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 15 03:39:17.190698 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-8937b515-4278-4d2c-bc27-c05eb8ef7b6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Flavor limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 03:39:17.191357 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-8937b515-4278-4d2c-bc27-c05eb8ef7b6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Image limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 03:39:17.191949 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-8937b515-4278-4d2c-bc27-c05eb8ef7b6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Flavor pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 03:39:17.192533 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-8937b515-4278-4d2c-bc27-c05eb8ef7b6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Image pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 03:39:17.192948 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-8937b515-4278-4d2c-bc27-c05eb8ef7b6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 03:39:17.202272 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8937b515-4278-4d2c-bc27-c05eb8ef7b6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:17.202718 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8937b515-4278-4d2c-bc27-c05eb8ef7b6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:17.203516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8937b515-4278-4d2c-bc27-c05eb8ef7b6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:17.203988 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8937b515-4278-4d2c-bc27-c05eb8ef7b6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:17.221341 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-8937b515-4278-4d2c-bc27-c05eb8ef7b6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Getting quotas for project fca42958bf634cd8be46887a2580f4cc. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:39:17.225315 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-8937b515-4278-4d2c-bc27-c05eb8ef7b6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Getting quotas for user f1f3db9250cc4edbacb392d5d0d18e08 and project fca42958bf634cd8be46887a2580f4cc. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:39:17.235821 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8937b515-4278-4d2c-bc27-c05eb8ef7b6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Going to run 1 instances... {{(pid=120897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 15 03:39:17.238229 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8937b515-4278-4d2c-bc27-c05eb8ef7b6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ec12dbd-23ec-4d58-b215-4e3cd5f17594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 15 03:39:17.284633 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8937b515-4278-4d2c-bc27-c05eb8ef7b6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546251 Oct 15 03:39:17.285433 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 61/120] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Oct 15 03:39:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 03:39:17.295726 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-454b59e4-ba18-4abf-8ea8-94e101d367d7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:17.296411 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-454b59e4-ba18-4abf-8ea8-94e101d367d7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:17.354703 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-454b59e4-ba18-4abf-8ea8-94e101d367d7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:17.360975 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-454b59e4-ba18-4abf-8ea8-94e101d367d7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1218 microversion: 2.1 time: 0.069485 Oct 15 03:39:17.361515 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 60/121] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:17 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:18.095708 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-582bbcaf-e9e0-4c1f-b505-2ea45193ab7d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:18.097017 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-582bbcaf-e9e0-4c1f-b505-2ea45193ab7d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:18.104159 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-582bbcaf-e9e0-4c1f-b505-2ea45193ab7d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:18.105360 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-582bbcaf-e9e0-4c1f-b505-2ea45193ab7d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:18.106319 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-582bbcaf-e9e0-4c1f-b505-2ea45193ab7d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:18.106770 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-582bbcaf-e9e0-4c1f-b505-2ea45193ab7d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:18.377261 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-dfc8410f-73df-4429-b47b-8e722b7fa99b tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:18.377961 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-dfc8410f-73df-4429-b47b-8e722b7fa99b tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:18.385672 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dfc8410f-73df-4429-b47b-8e722b7fa99b tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:18.386157 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dfc8410f-73df-4429-b47b-8e722b7fa99b tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:18.386959 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dfc8410f-73df-4429-b47b-8e722b7fa99b tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:18.387389 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dfc8410f-73df-4429-b47b-8e722b7fa99b tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:18.456445 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-dfc8410f-73df-4429-b47b-8e722b7fa99b tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:18.464741 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-dfc8410f-73df-4429-b47b-8e722b7fa99b tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1222 microversion: 2.1 time: 0.090657 Oct 15 03:39:18.465369 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 61/122] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:18 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:19.480844 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3cc95786-23ad-4378-97d8-ed69bcccf960 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:19.481516 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3cc95786-23ad-4378-97d8-ed69bcccf960 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:19.487731 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3cc95786-23ad-4378-97d8-ed69bcccf960 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:19.488184 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3cc95786-23ad-4378-97d8-ed69bcccf960 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:19.488958 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3cc95786-23ad-4378-97d8-ed69bcccf960 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:19.489398 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3cc95786-23ad-4378-97d8-ed69bcccf960 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:19.550968 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3cc95786-23ad-4378-97d8-ed69bcccf960 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:19.558501 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3cc95786-23ad-4378-97d8-ed69bcccf960 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1222 microversion: 2.1 time: 0.081482 Oct 15 03:39:19.559078 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 62/123] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:19 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:39:20.361767 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-582bbcaf-e9e0-4c1f-b505-2ea45193ab7d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 22988 microversion: 2.20 time: 2.271177 Oct 15 03:39:20.362589 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 62/124] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:18 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 22988 bytes in 2273 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:20.575702 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c5be5b9b-cb3a-43f3-911f-9ea3634c328a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:20.576309 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c5be5b9b-cb3a-43f3-911f-9ea3634c328a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:20.582871 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c5be5b9b-cb3a-43f3-911f-9ea3634c328a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:20.583390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c5be5b9b-cb3a-43f3-911f-9ea3634c328a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:20.584183 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c5be5b9b-cb3a-43f3-911f-9ea3634c328a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:20.584614 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c5be5b9b-cb3a-43f3-911f-9ea3634c328a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:20.652586 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c5be5b9b-cb3a-43f3-911f-9ea3634c328a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:20.660349 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c5be5b9b-cb3a-43f3-911f-9ea3634c328a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1270 microversion: 2.1 time: 0.088836 Oct 15 03:39:20.661153 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 63/125] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:20 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:21.373492 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-330d974f-6635-4af7-8d3c-00bf9a4082fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:21.374515 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-330d974f-6635-4af7-8d3c-00bf9a4082fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:21.380810 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-330d974f-6635-4af7-8d3c-00bf9a4082fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:21.381254 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-330d974f-6635-4af7-8d3c-00bf9a4082fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:21.382010 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-330d974f-6635-4af7-8d3c-00bf9a4082fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:21.382432 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-330d974f-6635-4af7-8d3c-00bf9a4082fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:21.676907 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9a9a5e9d-022e-4065-8aac-912b12197b7c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:21.677515 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9a9a5e9d-022e-4065-8aac-912b12197b7c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:21.684316 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9a9a5e9d-022e-4065-8aac-912b12197b7c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:21.684761 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9a9a5e9d-022e-4065-8aac-912b12197b7c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:21.685519 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9a9a5e9d-022e-4065-8aac-912b12197b7c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:21.685948 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9a9a5e9d-022e-4065-8aac-912b12197b7c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:21.744810 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-9a9a5e9d-022e-4065-8aac-912b12197b7c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:21.752033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9a9a5e9d-022e-4065-8aac-912b12197b7c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1278 microversion: 2.1 time: 0.078652 Oct 15 03:39:21.752779 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 64/126] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:21 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1278 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:22.767571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c22a6170-33f5-4d79-97e9-ca57fc83fe5e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:22.768207 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c22a6170-33f5-4d79-97e9-ca57fc83fe5e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:22.774513 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c22a6170-33f5-4d79-97e9-ca57fc83fe5e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:22.774998 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c22a6170-33f5-4d79-97e9-ca57fc83fe5e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:22.776142 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c22a6170-33f5-4d79-97e9-ca57fc83fe5e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:22.776580 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c22a6170-33f5-4d79-97e9-ca57fc83fe5e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:22.842383 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c22a6170-33f5-4d79-97e9-ca57fc83fe5e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:22.849820 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c22a6170-33f5-4d79-97e9-ca57fc83fe5e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1278 microversion: 2.1 time: 0.085785 Oct 15 03:39:22.850766 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 65/127] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:22 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:39:23.818851 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-330d974f-6635-4af7-8d3c-00bf9a4082fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 25331 microversion: 2.20 time: 2.449157 Oct 15 03:39:23.819808 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 63/128] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:21 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 25331 bytes in 2451 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:23.866943 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d8564fe7-7237-4851-b5f3-9313e0364759 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:23.867671 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d8564fe7-7237-4851-b5f3-9313e0364759 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:23.874714 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d8564fe7-7237-4851-b5f3-9313e0364759 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:23.875368 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d8564fe7-7237-4851-b5f3-9313e0364759 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:23.876353 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d8564fe7-7237-4851-b5f3-9313e0364759 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:23.876935 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d8564fe7-7237-4851-b5f3-9313e0364759 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:23.961030 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d8564fe7-7237-4851-b5f3-9313e0364759 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:23.969121 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d8564fe7-7237-4851-b5f3-9313e0364759 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1288 microversion: 2.1 time: 0.106689 Oct 15 03:39:23.969771 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 66/129] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:23 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1288 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:24.833636 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-20ba0564-33ee-4479-a35a-d4e7661221db tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:24.834640 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-20ba0564-33ee-4479-a35a-d4e7661221db tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:24.842256 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-20ba0564-33ee-4479-a35a-d4e7661221db tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:24.842595 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-20ba0564-33ee-4479-a35a-d4e7661221db tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:24.847998 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-20ba0564-33ee-4479-a35a-d4e7661221db tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:24.848599 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-20ba0564-33ee-4479-a35a-d4e7661221db tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:24.957766 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-20ba0564-33ee-4479-a35a-d4e7661221db tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 26062 microversion: 2.20 time: 0.128302 Oct 15 03:39:24.958422 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 64/130] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:24 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 26062 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:24.986144 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9bfc8d26-4b19-4706-a5e3-0564077d8b6b tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:24.987466 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9bfc8d26-4b19-4706-a5e3-0564077d8b6b tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:24.993441 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bfc8d26-4b19-4706-a5e3-0564077d8b6b tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:24.994085 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bfc8d26-4b19-4706-a5e3-0564077d8b6b tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:24.995060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bfc8d26-4b19-4706-a5e3-0564077d8b6b tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:24.995852 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bfc8d26-4b19-4706-a5e3-0564077d8b6b tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:25.129258 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c3c71f6d-84ea-4ed7-b3e5-256e0938352a tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:25.130233 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c3c71f6d-84ea-4ed7-b3e5-256e0938352a tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:25.141707 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c3c71f6d-84ea-4ed7-b3e5-256e0938352a tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:25.143868 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c3c71f6d-84ea-4ed7-b3e5-256e0938352a tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:25.145585 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c3c71f6d-84ea-4ed7-b3e5-256e0938352a tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:25.146679 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c3c71f6d-84ea-4ed7-b3e5-256e0938352a tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:25.192732 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c3c71f6d-84ea-4ed7-b3e5-256e0938352a tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Going to try to terminate instance {{(pid=120897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 15 03:39:25.250176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-9bfc8d26-4b19-4706-a5e3-0564077d8b6b tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:25.259813 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9bfc8d26-4b19-4706-a5e3-0564077d8b6b tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1318 microversion: 2.1 time: 0.276288 Oct 15 03:39:25.263584 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 67/131] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:24 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:25.271282 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-d4f0bc8b-ec1f-448e-b916-88200b5b7c09 req-3aa8278c-12c3-42ef-8b08-76897e1a667d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b4458c-7b40-46f8-9bc9-c3304b3f4687", "tag": "191df8c4-0e08-4fa3-aaa6-fd952995c6e6"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:25.279441 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:39:25.279441 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 03:39:25.289636 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-d4f0bc8b-ec1f-448e-b916-88200b5b7c09 req-3aa8278c-12c3-42ef-8b08-76897e1a667d service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:25.290833 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-d4f0bc8b-ec1f-448e-b916-88200b5b7c09 req-3aa8278c-12c3-42ef-8b08-76897e1a667d service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:25.309875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-d4f0bc8b-ec1f-448e-b916-88200b5b7c09 req-3aa8278c-12c3-42ef-8b08-76897e1a667d service nova] Creating event network-changed:191df8c4-0e08-4fa3-aaa6-fd952995c6e6 for instance d6b4458c-7b40-46f8-9bc9-c3304b3f4687 on hv-cinder-81410 Oct 15 03:39:25.318704 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-d4f0bc8b-ec1f-448e-b916-88200b5b7c09 req-3aa8278c-12c3-42ef-8b08-76897e1a667d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052472 Oct 15 03:39:25.320114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 68/132] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:39:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:39:25.338245 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c3c71f6d-84ea-4ed7-b3e5-256e0938352a tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "DELETE /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 204 len: 0 microversion: 2.1 time: 0.218707 Oct 15 03:39:25.339729 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 65/133] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 03:39:25 2021] DELETE /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 15 03:39:25.352834 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9dc86e54-7066-4b79-8cd4-9c3d64580842 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:25.355151 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9dc86e54-7066-4b79-8cd4-9c3d64580842 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:25.369158 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9dc86e54-7066-4b79-8cd4-9c3d64580842 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:25.369976 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9dc86e54-7066-4b79-8cd4-9c3d64580842 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:25.371334 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9dc86e54-7066-4b79-8cd4-9c3d64580842 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:25.371952 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9dc86e54-7066-4b79-8cd4-9c3d64580842 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:25.595045 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-9dc86e54-7066-4b79-8cd4-9c3d64580842 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:25.605772 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9dc86e54-7066-4b79-8cd4-9c3d64580842 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1553 microversion: 2.1 time: 0.260668 Oct 15 03:39:25.606633 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 69/134] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:25 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:25.971660 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-09d8ff7e-148e-4002-b8c3-f65bb7b18e15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:25.972684 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-09d8ff7e-148e-4002-b8c3-f65bb7b18e15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:25.981388 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-09d8ff7e-148e-4002-b8c3-f65bb7b18e15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:25.981388 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-09d8ff7e-148e-4002-b8c3-f65bb7b18e15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:25.981388 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-09d8ff7e-148e-4002-b8c3-f65bb7b18e15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:25.981388 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-09d8ff7e-148e-4002-b8c3-f65bb7b18e15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:26.279204 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e4bb7d3e-5ae5-4abc-9246-f5796b0b3bb4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:26.279902 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e4bb7d3e-5ae5-4abc-9246-f5796b0b3bb4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:26.286100 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4bb7d3e-5ae5-4abc-9246-f5796b0b3bb4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:26.286547 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4bb7d3e-5ae5-4abc-9246-f5796b0b3bb4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:26.287309 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4bb7d3e-5ae5-4abc-9246-f5796b0b3bb4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:26.287773 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4bb7d3e-5ae5-4abc-9246-f5796b0b3bb4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:26.407346 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e4bb7d3e-5ae5-4abc-9246-f5796b0b3bb4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:26.414481 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e4bb7d3e-5ae5-4abc-9246-f5796b0b3bb4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1318 microversion: 2.1 time: 0.138851 Oct 15 03:39:26.415050 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 70/135] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:26 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:26.623106 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ec012b09-f4a0-415a-ab37-9dd479550eed tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:26.623740 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ec012b09-f4a0-415a-ab37-9dd479550eed tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:26.629568 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ec012b09-f4a0-415a-ab37-9dd479550eed tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:26.630055 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ec012b09-f4a0-415a-ab37-9dd479550eed tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:26.630818 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ec012b09-f4a0-415a-ab37-9dd479550eed tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:26.631257 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ec012b09-f4a0-415a-ab37-9dd479550eed tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:26.765102 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ec012b09-f4a0-415a-ab37-9dd479550eed tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:26.775363 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ec012b09-f4a0-415a-ab37-9dd479550eed tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1553 microversion: 2.1 time: 0.155355 Oct 15 03:39:26.776618 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 71/136] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:26 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:39:27.430738 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ee0b4b87-5ed5-47ee-84a3-9807ddb491f8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:27.431375 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ee0b4b87-5ed5-47ee-84a3-9807ddb491f8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:27.437774 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee0b4b87-5ed5-47ee-84a3-9807ddb491f8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:27.438217 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee0b4b87-5ed5-47ee-84a3-9807ddb491f8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:27.438970 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee0b4b87-5ed5-47ee-84a3-9807ddb491f8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:27.439395 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee0b4b87-5ed5-47ee-84a3-9807ddb491f8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:27.559899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ee0b4b87-5ed5-47ee-84a3-9807ddb491f8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:27.567959 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ee0b4b87-5ed5-47ee-84a3-9807ddb491f8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1318 microversion: 2.1 time: 0.140805 Oct 15 03:39:27.568595 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 72/137] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:27 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:39:27.793289 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4612d3d0-61f3-4b9c-8926-f8a19791ddb8 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:27.793913 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4612d3d0-61f3-4b9c-8926-f8a19791ddb8 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:27.799799 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4612d3d0-61f3-4b9c-8926-f8a19791ddb8 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:27.800329 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4612d3d0-61f3-4b9c-8926-f8a19791ddb8 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:27.801079 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4612d3d0-61f3-4b9c-8926-f8a19791ddb8 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:27.801519 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4612d3d0-61f3-4b9c-8926-f8a19791ddb8 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:27.924707 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4612d3d0-61f3-4b9c-8926-f8a19791ddb8 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:27.932897 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4612d3d0-61f3-4b9c-8926-f8a19791ddb8 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1553 microversion: 2.1 time: 0.143949 Oct 15 03:39:27.933774 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 73/138] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:27 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1553 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:39:28.584338 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ce85ffbd-3747-4139-8163-85948775b0d8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:28.587816 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ce85ffbd-3747-4139-8163-85948775b0d8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:28.594625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce85ffbd-3747-4139-8163-85948775b0d8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:28.598983 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce85ffbd-3747-4139-8163-85948775b0d8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:28.598983 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce85ffbd-3747-4139-8163-85948775b0d8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:28.598983 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce85ffbd-3747-4139-8163-85948775b0d8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:28.716887 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ce85ffbd-3747-4139-8163-85948775b0d8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:28.724581 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ce85ffbd-3747-4139-8163-85948775b0d8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1318 microversion: 2.1 time: 0.143959 Oct 15 03:39:28.725225 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 74/139] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:28 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:39:28.863339 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-09d8ff7e-148e-4002-b8c3-f65bb7b18e15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 27785 microversion: 2.20 time: 2.896235 Oct 15 03:39:28.864008 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 66/140] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:25 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 27785 bytes in 2898 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:28.948948 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b6c9bf7a-e8d2-43a7-a37a-fa1ce94d501f tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:28.949745 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b6c9bf7a-e8d2-43a7-a37a-fa1ce94d501f tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:28.956234 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b6c9bf7a-e8d2-43a7-a37a-fa1ce94d501f tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:28.956775 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b6c9bf7a-e8d2-43a7-a37a-fa1ce94d501f tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:28.957882 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b6c9bf7a-e8d2-43a7-a37a-fa1ce94d501f tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:28.958520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b6c9bf7a-e8d2-43a7-a37a-fa1ce94d501f tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:29.362594 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b6c9bf7a-e8d2-43a7-a37a-fa1ce94d501f tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:29.370926 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b6c9bf7a-e8d2-43a7-a37a-fa1ce94d501f tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1553 microversion: 2.1 time: 0.425607 Oct 15 03:39:29.372099 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 75/141] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:28 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1553 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:29.741689 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3d8a0d8b-e9c4-4e84-92cf-84f4a77755e3 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:29.742380 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3d8a0d8b-e9c4-4e84-92cf-84f4a77755e3 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:29.749526 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3d8a0d8b-e9c4-4e84-92cf-84f4a77755e3 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:29.750163 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3d8a0d8b-e9c4-4e84-92cf-84f4a77755e3 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:29.751084 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3d8a0d8b-e9c4-4e84-92cf-84f4a77755e3 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:29.751667 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3d8a0d8b-e9c4-4e84-92cf-84f4a77755e3 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:29.875807 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-cdb524d2-2571-4a6d-ba73-efeedf0712fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:29.876840 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-cdb524d2-2571-4a6d-ba73-efeedf0712fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:29.883023 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cdb524d2-2571-4a6d-ba73-efeedf0712fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:29.883572 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cdb524d2-2571-4a6d-ba73-efeedf0712fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:29.884438 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cdb524d2-2571-4a6d-ba73-efeedf0712fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:29.884930 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cdb524d2-2571-4a6d-ba73-efeedf0712fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:29.959224 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3d8a0d8b-e9c4-4e84-92cf-84f4a77755e3 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:29.966187 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-cdb524d2-2571-4a6d-ba73-efeedf0712fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 28149 microversion: 2.20 time: 0.094663 Oct 15 03:39:29.967382 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3d8a0d8b-e9c4-4e84-92cf-84f4a77755e3 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1318 microversion: 2.1 time: 0.229772 Oct 15 03:39:29.968203 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 67/142] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:29 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:29.971991 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 76/143] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:29 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 28149 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 15 03:39:30.388455 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a6f044eb-c183-428c-9a8c-65795280de93 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:30.389068 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a6f044eb-c183-428c-9a8c-65795280de93 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:30.399622 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a6f044eb-c183-428c-9a8c-65795280de93 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:30.400107 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a6f044eb-c183-428c-9a8c-65795280de93 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:30.401324 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a6f044eb-c183-428c-9a8c-65795280de93 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:30.401763 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a6f044eb-c183-428c-9a8c-65795280de93 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:30.527389 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a6f044eb-c183-428c-9a8c-65795280de93 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:30.538334 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a6f044eb-c183-428c-9a8c-65795280de93 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1553 microversion: 2.1 time: 0.153196 Oct 15 03:39:30.538783 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 68/144] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:30 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:39:30.991202 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3259ca40-69c8-4587-806a-b11a3d65ff1c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:30.992411 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3259ca40-69c8-4587-806a-b11a3d65ff1c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:30.993183 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e2f87e30-5862-4094-a888-89c79d6c8c85 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:30.994943 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e2f87e30-5862-4094-a888-89c79d6c8c85 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:30.999303 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3259ca40-69c8-4587-806a-b11a3d65ff1c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:31.000010 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3259ca40-69c8-4587-806a-b11a3d65ff1c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:31.000774 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3259ca40-69c8-4587-806a-b11a3d65ff1c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:31.001383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3259ca40-69c8-4587-806a-b11a3d65ff1c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:31.005035 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e2f87e30-5862-4094-a888-89c79d6c8c85 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:31.005631 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e2f87e30-5862-4094-a888-89c79d6c8c85 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:31.007234 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e2f87e30-5862-4094-a888-89c79d6c8c85 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:31.007984 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e2f87e30-5862-4094-a888-89c79d6c8c85 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:31.086415 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3259ca40-69c8-4587-806a-b11a3d65ff1c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 28193 microversion: 2.20 time: 0.098867 Oct 15 03:39:31.087404 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 69/145] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:30 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 28193 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:31.157522 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-0105c8f3-c8ad-411a-b32d-00c4c632445b req-56d68b7c-0707-47d2-9ee5-064c3014dad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479f8628-5c56-459e-8ff7-d2fee24b613a", "name": "network-vif-deleted", "tag": "aa7c0da7-52ba-4e18-9d99-9b4c9b8183c4"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:31.159025 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:39:31.159025 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:39:31.177753 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-0105c8f3-c8ad-411a-b32d-00c4c632445b req-56d68b7c-0707-47d2-9ee5-064c3014dad3 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:31.178247 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-0105c8f3-c8ad-411a-b32d-00c4c632445b req-56d68b7c-0707-47d2-9ee5-064c3014dad3 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:31.194827 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-0105c8f3-c8ad-411a-b32d-00c4c632445b req-56d68b7c-0707-47d2-9ee5-064c3014dad3 service nova] Creating event network-vif-deleted:aa7c0da7-52ba-4e18-9d99-9b4c9b8183c4 for instance 479f8628-5c56-459e-8ff7-d2fee24b613a on hv-cinder-81410 Oct 15 03:39:31.201146 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-0105c8f3-c8ad-411a-b32d-00c4c632445b req-56d68b7c-0707-47d2-9ee5-064c3014dad3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047132 Oct 15 03:39:31.201993 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 70/146] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:39:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:39:31.235361 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e2f87e30-5862-4094-a888-89c79d6c8c85 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:31.244968 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e2f87e30-5862-4094-a888-89c79d6c8c85 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1318 microversion: 2.1 time: 0.257000 Oct 15 03:39:31.245796 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 77/147] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:30 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:31.559545 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-84b89be5-3b02-4f72-9ff6-0111e547cdfc tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:31.560312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-84b89be5-3b02-4f72-9ff6-0111e547cdfc tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:31.575273 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84b89be5-3b02-4f72-9ff6-0111e547cdfc tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:31.576621 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84b89be5-3b02-4f72-9ff6-0111e547cdfc tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:31.577821 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84b89be5-3b02-4f72-9ff6-0111e547cdfc tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:31.578277 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84b89be5-3b02-4f72-9ff6-0111e547cdfc tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:31.722613 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-84b89be5-3b02-4f72-9ff6-0111e547cdfc tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8c979ab68548b082f33bfb215c7713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3771e448cc4b798d048ac3fa182787', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:31.755055 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-84b89be5-3b02-4f72-9ff6-0111e547cdfc tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 200 len: 1345 microversion: 2.1 time: 0.199610 Oct 15 03:39:31.756046 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 71/148] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:31 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 1345 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:32.101120 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9c58490c-3771-4a54-8513-eab4a546853a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:32.102204 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9c58490c-3771-4a54-8513-eab4a546853a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:32.109788 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9c58490c-3771-4a54-8513-eab4a546853a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:32.111008 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9c58490c-3771-4a54-8513-eab4a546853a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:32.112156 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9c58490c-3771-4a54-8513-eab4a546853a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:32.112795 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9c58490c-3771-4a54-8513-eab4a546853a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:32.215705 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9c58490c-3771-4a54-8513-eab4a546853a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 28483 microversion: 2.20 time: 0.120307 Oct 15 03:39:32.217157 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 78/149] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:32 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 28483 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:32.265367 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ea167be5-00d6-4dae-9dc8-a54b3220ec4e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:32.266048 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ea167be5-00d6-4dae-9dc8-a54b3220ec4e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:32.280830 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ea167be5-00d6-4dae-9dc8-a54b3220ec4e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:32.283050 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ea167be5-00d6-4dae-9dc8-a54b3220ec4e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:32.285818 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ea167be5-00d6-4dae-9dc8-a54b3220ec4e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:32.286278 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ea167be5-00d6-4dae-9dc8-a54b3220ec4e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:32.434797 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ea167be5-00d6-4dae-9dc8-a54b3220ec4e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:32.445744 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ea167be5-00d6-4dae-9dc8-a54b3220ec4e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1318 microversion: 2.1 time: 0.185637 Oct 15 03:39:32.446307 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 72/150] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:32 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:32.773040 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9dc7e872-1601-43cd-b447-3da63e3eb697 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:32.773793 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9dc7e872-1601-43cd-b447-3da63e3eb697 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:32.783266 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9dc7e872-1601-43cd-b447-3da63e3eb697 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:32.783742 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9dc7e872-1601-43cd-b447-3da63e3eb697 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:32.784511 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9dc7e872-1601-43cd-b447-3da63e3eb697 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:32.785176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9dc7e872-1601-43cd-b447-3da63e3eb697 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:32.799622 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-9dc7e872-1601-43cd-b447-3da63e3eb697 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] HTTP exception thrown: Instance 479f8628-5c56-459e-8ff7-d2fee24b613a could not be found. Oct 15 03:39:32.800536 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9dc7e872-1601-43cd-b447-3da63e3eb697 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Returning 404 to user: Instance 479f8628-5c56-459e-8ff7-d2fee24b613a could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:39:32.801790 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9dc7e872-1601-43cd-b447-3da63e3eb697 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 404 len: 111 microversion: 2.1 time: 0.033004 Oct 15 03:39:32.802774 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 79/151] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:32 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 03:39:32.923335 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a5487327-323d-40ba-b518-cdd7fd5ba7e3 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:32.924697 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a5487327-323d-40ba-b518-cdd7fd5ba7e3 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:32.936540 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a5487327-323d-40ba-b518-cdd7fd5ba7e3 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:32.938983 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a5487327-323d-40ba-b518-cdd7fd5ba7e3 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:32.939972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a5487327-323d-40ba-b518-cdd7fd5ba7e3 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:32.940482 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a5487327-323d-40ba-b518-cdd7fd5ba7e3 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:32.965553 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.wsgi [None req-a5487327-323d-40ba-b518-cdd7fd5ba7e3 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] HTTP exception thrown: Instance 479f8628-5c56-459e-8ff7-d2fee24b613a could not be found. Oct 15 03:39:32.966207 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a5487327-323d-40ba-b518-cdd7fd5ba7e3 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Returning 404 to user: Instance 479f8628-5c56-459e-8ff7-d2fee24b613a could not be found. {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:39:32.967026 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a5487327-323d-40ba-b518-cdd7fd5ba7e3 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050950 Oct 15 03:39:32.968145 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 73/152] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:39:32 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 03:39:33.228499 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-69712ffb-a753-4116-99cd-65439dd61bd1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:33.229617 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-69712ffb-a753-4116-99cd-65439dd61bd1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:33.235752 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-69712ffb-a753-4116-99cd-65439dd61bd1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:33.236461 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-69712ffb-a753-4116-99cd-65439dd61bd1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:33.238157 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-69712ffb-a753-4116-99cd-65439dd61bd1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:33.238854 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-69712ffb-a753-4116-99cd-65439dd61bd1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:33.312798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-69712ffb-a753-4116-99cd-65439dd61bd1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 28483 microversion: 2.20 time: 0.088135 Oct 15 03:39:33.316573 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 80/153] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:33 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 28483 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 15 03:39:33.463858 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-144714cf-1b74-4852-817b-0e7a6c8ad4ba tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:33.465726 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-144714cf-1b74-4852-817b-0e7a6c8ad4ba tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:33.474077 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-144714cf-1b74-4852-817b-0e7a6c8ad4ba tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:33.474595 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-144714cf-1b74-4852-817b-0e7a6c8ad4ba tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:33.475494 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-144714cf-1b74-4852-817b-0e7a6c8ad4ba tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:33.476016 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-144714cf-1b74-4852-817b-0e7a6c8ad4ba tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:33.631939 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-144714cf-1b74-4852-817b-0e7a6c8ad4ba tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:33.639975 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-144714cf-1b74-4852-817b-0e7a6c8ad4ba tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1318 microversion: 2.1 time: 0.179590 Oct 15 03:39:33.640721 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 74/154] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:33 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:33.715926 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-1521688a-66a1-4bdf-b92f-9f142d4edc65 req-9375faa0-390c-4d1b-93c0-c545779c6790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b4458c-7b40-46f8-9bc9-c3304b3f4687", "name": "network-vif-plugged", "status": "completed", "tag": "191df8c4-0e08-4fa3-aaa6-fd952995c6e6"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:33.717411 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:39:33.717411 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 03:39:33.737817 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-1521688a-66a1-4bdf-b92f-9f142d4edc65 req-9375faa0-390c-4d1b-93c0-c545779c6790 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:33.738553 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-1521688a-66a1-4bdf-b92f-9f142d4edc65 req-9375faa0-390c-4d1b-93c0-c545779c6790 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:33.753520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-1521688a-66a1-4bdf-b92f-9f142d4edc65 req-9375faa0-390c-4d1b-93c0-c545779c6790 service nova] Creating event network-vif-plugged:191df8c4-0e08-4fa3-aaa6-fd952995c6e6 for instance d6b4458c-7b40-46f8-9bc9-c3304b3f4687 on hv-cinder-81410 Oct 15 03:39:33.760866 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-1521688a-66a1-4bdf-b92f-9f142d4edc65 req-9375faa0-390c-4d1b-93c0-c545779c6790 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049842 Oct 15 03:39:33.762598 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 81/155] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:39:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:39:34.191200 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-36e4f800-197c-4072-9142-587752a03790 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:34.191943 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-36e4f800-197c-4072-9142-587752a03790 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:34.197661 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-36e4f800-197c-4072-9142-587752a03790 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:34.198109 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-36e4f800-197c-4072-9142-587752a03790 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:34.198915 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-36e4f800-197c-4072-9142-587752a03790 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:34.199349 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-36e4f800-197c-4072-9142-587752a03790 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:34.212712 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.wsgi [None req-36e4f800-197c-4072-9142-587752a03790 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] HTTP exception thrown: Instance 479f8628-5c56-459e-8ff7-d2fee24b613a could not be found. Oct 15 03:39:34.213352 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-36e4f800-197c-4072-9142-587752a03790 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Returning 404 to user: Instance 479f8628-5c56-459e-8ff7-d2fee24b613a could not be found. {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:39:34.214162 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-36e4f800-197c-4072-9142-587752a03790 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "DELETE /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 404 len: 111 microversion: 2.1 time: 0.026630 Oct 15 03:39:34.215121 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 75/156] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 03:39:34 2021] DELETE /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 03:39:34.223252 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-401f1a24-31ff-4002-811d-a57fd4ad7e37 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:34.223977 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-401f1a24-31ff-4002-811d-a57fd4ad7e37 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] [instance: 479f8628-5c56-459e-8ff7-d2fee24b613a] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:34.230794 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-401f1a24-31ff-4002-811d-a57fd4ad7e37 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:34.231376 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-401f1a24-31ff-4002-811d-a57fd4ad7e37 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:34.236281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-401f1a24-31ff-4002-811d-a57fd4ad7e37 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:34.236281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-401f1a24-31ff-4002-811d-a57fd4ad7e37 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:34.249570 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-401f1a24-31ff-4002-811d-a57fd4ad7e37 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] HTTP exception thrown: Instance 479f8628-5c56-459e-8ff7-d2fee24b613a could not be found. Oct 15 03:39:34.250379 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-401f1a24-31ff-4002-811d-a57fd4ad7e37 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] Returning 404 to user: Instance 479f8628-5c56-459e-8ff7-d2fee24b613a could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:39:34.251377 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-401f1a24-31ff-4002-811d-a57fd4ad7e37 tempest-DeleteServersTestJSON-548492372 tempest-DeleteServersTestJSON-548492372-project] 10.222.0.30 "GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a" status: 404 len: 111 microversion: 2.1 time: 0.031991 Oct 15 03:39:34.252512 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 82/157] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:34 2021] GET /compute/v2.1/servers/479f8628-5c56-459e-8ff7-d2fee24b613a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 03:39:34.328562 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a896ef12-ec50-4560-8485-bb715eda4a2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:34.330025 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a896ef12-ec50-4560-8485-bb715eda4a2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:34.337352 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a896ef12-ec50-4560-8485-bb715eda4a2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:34.337977 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a896ef12-ec50-4560-8485-bb715eda4a2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:34.338889 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a896ef12-ec50-4560-8485-bb715eda4a2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:34.339592 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a896ef12-ec50-4560-8485-bb715eda4a2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:34.436649 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a896ef12-ec50-4560-8485-bb715eda4a2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 28651 microversion: 2.20 time: 0.114859 Oct 15 03:39:34.437837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 76/158] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:34 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 28651 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:34.658396 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4bee8a13-61f3-47bd-af53-6f3f4f66d8c8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:34.659250 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4bee8a13-61f3-47bd-af53-6f3f4f66d8c8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:34.669912 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4bee8a13-61f3-47bd-af53-6f3f4f66d8c8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:34.672393 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4bee8a13-61f3-47bd-af53-6f3f4f66d8c8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:34.673415 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4bee8a13-61f3-47bd-af53-6f3f4f66d8c8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:34.677649 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4bee8a13-61f3-47bd-af53-6f3f4f66d8c8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:34.906048 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4bee8a13-61f3-47bd-af53-6f3f4f66d8c8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:34.914911 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4bee8a13-61f3-47bd-af53-6f3f4f66d8c8 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1318 microversion: 2.1 time: 0.261912 Oct 15 03:39:34.915489 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 83/159] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:34 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:35.450107 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-792b04b1-127a-4fed-b902-e7c985c17d6f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:35.451836 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-792b04b1-127a-4fed-b902-e7c985c17d6f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:35.460221 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-792b04b1-127a-4fed-b902-e7c985c17d6f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:35.463807 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-792b04b1-127a-4fed-b902-e7c985c17d6f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:35.466044 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-792b04b1-127a-4fed-b902-e7c985c17d6f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:35.467165 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-792b04b1-127a-4fed-b902-e7c985c17d6f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:35.535985 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-792b04b1-127a-4fed-b902-e7c985c17d6f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 28651 microversion: 2.20 time: 0.090277 Oct 15 03:39:35.536909 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 77/160] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:35 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 28651 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:35.932540 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c4dc4545-7005-46d2-9b4f-09e808e5ad65 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:35.933160 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c4dc4545-7005-46d2-9b4f-09e808e5ad65 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:35.941387 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c4dc4545-7005-46d2-9b4f-09e808e5ad65 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:35.941842 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c4dc4545-7005-46d2-9b4f-09e808e5ad65 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:35.942624 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c4dc4545-7005-46d2-9b4f-09e808e5ad65 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:35.943063 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c4dc4545-7005-46d2-9b4f-09e808e5ad65 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:36.137826 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c4dc4545-7005-46d2-9b4f-09e808e5ad65 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:36.145289 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c4dc4545-7005-46d2-9b4f-09e808e5ad65 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1508 microversion: 2.1 time: 0.216987 Oct 15 03:39:36.145852 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 84/161] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:35 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:39:36.165317 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2286801f-9d3e-43c5-8daa-635dc23ba30c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dca708c-24a9-437f-9f11-dbfd3a66e2cd"}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:36.167469 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2286801f-9d3e-43c5-8daa-635dc23ba30c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:36.174461 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2286801f-9d3e-43c5-8daa-635dc23ba30c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:36.174915 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2286801f-9d3e-43c5-8daa-635dc23ba30c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:36.175711 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2286801f-9d3e-43c5-8daa-635dc23ba30c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:36.176152 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2286801f-9d3e-43c5-8daa-635dc23ba30c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:36.284990 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.wsgi [None req-2286801f-9d3e-43c5-8daa-635dc23ba30c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] HTTP exception thrown: Invalid volume: volume 7dca708c-24a9-437f-9f11-dbfd3a66e2cd is already attached to instances: 612f42d0-d719-4a5f-bcb9-029c18112f69 Oct 15 03:39:36.285877 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2286801f-9d3e-43c5-8daa-635dc23ba30c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Returning 400 to user: Invalid volume: volume 7dca708c-24a9-437f-9f11-dbfd3a66e2cd is already attached to instances: 612f42d0-d719-4a5f-bcb9-029c18112f69 {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:39:36.286917 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2286801f-9d3e-43c5-8daa-635dc23ba30c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "POST /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.126115 Oct 15 03:39:36.291730 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 78/162] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Oct 15 03:39:36 2021] POST /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687/os-volume_attachments => generated 174 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 15 03:39:36.354737 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-13dd6dcb-eb23-46af-9b95-30bb415ed7e9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:36.355437 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-13dd6dcb-eb23-46af-9b95-30bb415ed7e9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:36.362569 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13dd6dcb-eb23-46af-9b95-30bb415ed7e9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:36.363187 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13dd6dcb-eb23-46af-9b95-30bb415ed7e9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:36.364126 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13dd6dcb-eb23-46af-9b95-30bb415ed7e9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:36.364697 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13dd6dcb-eb23-46af-9b95-30bb415ed7e9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:36.509271 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.objects.instance [None req-13dd6dcb-eb23-46af-9b95-30bb415ed7e9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lazy-loading 'services' on Instance uuid 612f42d0-d719-4a5f-bcb9-029c18112f69 {{(pid=120899) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 03:39:36.548228 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8ef71ad5-d810-4f77-b301-cc893894e747 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:36.549733 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8ef71ad5-d810-4f77-b301-cc893894e747 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:36.562481 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8ef71ad5-d810-4f77-b301-cc893894e747 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:36.562940 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8ef71ad5-d810-4f77-b301-cc893894e747 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:36.565166 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8ef71ad5-d810-4f77-b301-cc893894e747 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:36.566514 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8ef71ad5-d810-4f77-b301-cc893894e747 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:36.635659 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-13dd6dcb-eb23-46af-9b95-30bb415ed7e9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "DELETE /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69/os-volume_attachments/7dca708c-24a9-437f-9f11-dbfd3a66e2cd" status: 202 len: 0 microversion: 2.1 time: 0.285173 Oct 15 03:39:36.639749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 85/163] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Oct 15 03:39:36 2021] DELETE /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69/os-volume_attachments/7dca708c-24a9-437f-9f11-dbfd3a66e2cd => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:36.644820 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-93a1ecae-b761-4d55-abb4-258aba143751 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:36.646077 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-93a1ecae-b761-4d55-abb4-258aba143751 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:36.657281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-93a1ecae-b761-4d55-abb4-258aba143751 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:36.657959 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-93a1ecae-b761-4d55-abb4-258aba143751 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:36.659540 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-93a1ecae-b761-4d55-abb4-258aba143751 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:36.660004 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-93a1ecae-b761-4d55-abb4-258aba143751 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:36.687806 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8ef71ad5-d810-4f77-b301-cc893894e747 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 28651 microversion: 2.20 time: 0.143009 Oct 15 03:39:36.688446 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 79/164] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:36 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 28651 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:36.700743 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-93a1ecae-b761-4d55-abb4-258aba143751 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059738 Oct 15 03:39:36.705102 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 86/165] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:39:36 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:39:37.699423 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-dadd3fff-babf-42b4-983d-e477fcdda634 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:37.700462 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-dadd3fff-babf-42b4-983d-e477fcdda634 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:37.711436 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d26b8846-39e7-46e9-9598-62dddcb58d6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:37.721977 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d26b8846-39e7-46e9-9598-62dddcb58d6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:37.722805 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dadd3fff-babf-42b4-983d-e477fcdda634 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:37.723258 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dadd3fff-babf-42b4-983d-e477fcdda634 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:37.729797 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dadd3fff-babf-42b4-983d-e477fcdda634 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:37.732219 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dadd3fff-babf-42b4-983d-e477fcdda634 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:37.734012 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d26b8846-39e7-46e9-9598-62dddcb58d6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:37.734696 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d26b8846-39e7-46e9-9598-62dddcb58d6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:37.735700 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d26b8846-39e7-46e9-9598-62dddcb58d6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:37.736283 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d26b8846-39e7-46e9-9598-62dddcb58d6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:37.776945 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d26b8846-39e7-46e9-9598-62dddcb58d6f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069351 Oct 15 03:39:37.783351 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 87/166] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:39:37 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 15 03:39:37.876425 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-dadd3fff-babf-42b4-983d-e477fcdda634 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 28651 microversion: 2.20 time: 0.181303 Oct 15 03:39:37.877547 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 80/167] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:37 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 28651 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:38.047359 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d34323eb-dce4-4711-8df1-5ffa7aa9d269 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1398549675", "imageRef": "0ec12dbd-23ec-4d58-b215-4e3cd5f17594", "flavorRef": "452", "networks": [{"uuid": "beb50f10-7a82-4ec6-9454-85dffb8b4cbb"}]}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:38.160274 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.network.neutron [None req-d34323eb-dce4-4711-8df1-5ffa7aa9d269 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] validate_networks() for [('beb50f10-7a82-4ec6-9454-85dffb8b4cbb', None, None, None, None, None)] {{(pid=120899) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 15 03:39:38.791158 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-d34323eb-dce4-4711-8df1-5ffa7aa9d269 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Flavor limits 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 03:39:38.792043 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-d34323eb-dce4-4711-8df1-5ffa7aa9d269 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Image limits 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 03:39:38.792733 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-d34323eb-dce4-4711-8df1-5ffa7aa9d269 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Flavor pref 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 03:39:38.793287 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-d34323eb-dce4-4711-8df1-5ffa7aa9d269 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Image pref 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 03:39:38.793922 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-d34323eb-dce4-4711-8df1-5ffa7aa9d269 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 03:39:38.805346 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d34323eb-dce4-4711-8df1-5ffa7aa9d269 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:38.806184 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d34323eb-dce4-4711-8df1-5ffa7aa9d269 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:38.807365 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d34323eb-dce4-4711-8df1-5ffa7aa9d269 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:38.808062 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d34323eb-dce4-4711-8df1-5ffa7aa9d269 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:38.827443 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-d34323eb-dce4-4711-8df1-5ffa7aa9d269 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Getting quotas for project fca42958bf634cd8be46887a2580f4cc. Resources: {'cores', 'instances', 'ram'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:39:38.833355 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-d34323eb-dce4-4711-8df1-5ffa7aa9d269 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Getting quotas for user f1f3db9250cc4edbacb392d5d0d18e08 and project fca42958bf634cd8be46887a2580f4cc. Resources: {'cores', 'instances', 'ram'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:39:38.846856 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d34323eb-dce4-4711-8df1-5ffa7aa9d269 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Going to run 1 instances... {{(pid=120899) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 15 03:39:38.849798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d34323eb-dce4-4711-8df1-5ffa7aa9d269 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ec12dbd-23ec-4d58-b215-4e3cd5f17594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120899) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 15 03:39:38.904201 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1e0d2041-ebe0-4cb0-a263-7a70673f4e37 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:38.907023 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1e0d2041-ebe0-4cb0-a263-7a70673f4e37 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:38.928284 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e0d2041-ebe0-4cb0-a263-7a70673f4e37 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:38.930213 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e0d2041-ebe0-4cb0-a263-7a70673f4e37 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:38.934861 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e0d2041-ebe0-4cb0-a263-7a70673f4e37 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:38.935478 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e0d2041-ebe0-4cb0-a263-7a70673f4e37 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:38.945501 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d34323eb-dce4-4711-8df1-5ffa7aa9d269 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.901731 Oct 15 03:39:38.963858 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 88/168] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Oct 15 03:39:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 03:39:38.976364 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-51bd47df-102c-4e10-bfe5-e9fea95e5e09 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:38.978797 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-51bd47df-102c-4e10-bfe5-e9fea95e5e09 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:39.070972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1e0d2041-ebe0-4cb0-a263-7a70673f4e37 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 30190 microversion: 2.20 time: 0.186286 Oct 15 03:39:39.075438 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 81/169] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:38 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 30190 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:39.129222 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-51bd47df-102c-4e10-bfe5-e9fea95e5e09 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:39.149148 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-51bd47df-102c-4e10-bfe5-e9fea95e5e09 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e" status: 200 len: 1218 microversion: 2.1 time: 0.183798 Oct 15 03:39:39.150135 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 89/170] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:38 2021] GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e => generated 1218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:40.084162 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-aca34a7c-5fab-48c2-9bec-8005382d8889 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:40.085374 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-aca34a7c-5fab-48c2-9bec-8005382d8889 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:40.099902 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aca34a7c-5fab-48c2-9bec-8005382d8889 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:40.101623 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aca34a7c-5fab-48c2-9bec-8005382d8889 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:40.104622 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aca34a7c-5fab-48c2-9bec-8005382d8889 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:40.105077 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aca34a7c-5fab-48c2-9bec-8005382d8889 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:40.173164 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-635aceba-adf6-44ce-93bb-e881affc85e2 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:40.174941 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-635aceba-adf6-44ce-93bb-e881affc85e2 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:40.186882 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-635aceba-adf6-44ce-93bb-e881affc85e2 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:40.190868 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-635aceba-adf6-44ce-93bb-e881affc85e2 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:40.198856 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-635aceba-adf6-44ce-93bb-e881affc85e2 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:40.199099 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-635aceba-adf6-44ce-93bb-e881affc85e2 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:40.244923 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-aca34a7c-5fab-48c2-9bec-8005382d8889 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 31583 microversion: 2.20 time: 0.165440 Oct 15 03:39:40.245557 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 82/171] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:40 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 31583 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:40.432138 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-635aceba-adf6-44ce-93bb-e881affc85e2 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:40.445657 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-635aceba-adf6-44ce-93bb-e881affc85e2 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e" status: 200 len: 1278 microversion: 2.1 time: 0.281231 Oct 15 03:39:40.446790 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 90/172] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:40 2021] GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e => generated 1278 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:41.259104 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4cf7bc83-2221-45d9-98f7-753640bbee4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:41.260310 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4cf7bc83-2221-45d9-98f7-753640bbee4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:41.284911 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4cf7bc83-2221-45d9-98f7-753640bbee4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:41.287149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4cf7bc83-2221-45d9-98f7-753640bbee4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:41.288904 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4cf7bc83-2221-45d9-98f7-753640bbee4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:41.290379 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4cf7bc83-2221-45d9-98f7-753640bbee4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:41.436973 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4cf7bc83-2221-45d9-98f7-753640bbee4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 32947 microversion: 2.20 time: 0.183314 Oct 15 03:39:41.447469 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 83/173] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:41 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 32947 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:41.464055 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-70b4fa0d-c8bb-4a7f-a1ca-66a843352c24 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:41.465624 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-70b4fa0d-c8bb-4a7f-a1ca-66a843352c24 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:41.472271 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70b4fa0d-c8bb-4a7f-a1ca-66a843352c24 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:41.472978 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70b4fa0d-c8bb-4a7f-a1ca-66a843352c24 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:41.473971 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70b4fa0d-c8bb-4a7f-a1ca-66a843352c24 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:41.474587 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70b4fa0d-c8bb-4a7f-a1ca-66a843352c24 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:41.819904 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-70b4fa0d-c8bb-4a7f-a1ca-66a843352c24 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:41.828717 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-70b4fa0d-c8bb-4a7f-a1ca-66a843352c24 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e" status: 200 len: 1318 microversion: 2.1 time: 0.369419 Oct 15 03:39:41.833436 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 91/174] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:41 2021] GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:42.475259 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1af98a7e-f998-468b-a6e4-5a6df497cb52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:42.476362 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1af98a7e-f998-468b-a6e4-5a6df497cb52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:42.491609 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1af98a7e-f998-468b-a6e4-5a6df497cb52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:42.492098 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1af98a7e-f998-468b-a6e4-5a6df497cb52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:42.492889 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1af98a7e-f998-468b-a6e4-5a6df497cb52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:42.496385 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1af98a7e-f998-468b-a6e4-5a6df497cb52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:42.620549 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1af98a7e-f998-468b-a6e4-5a6df497cb52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 36560 microversion: 2.20 time: 0.165874 Oct 15 03:39:42.621202 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 84/175] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:42 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 36560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:42.655941 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-5946ade4-12f5-4ab2-8512-378ac8f90ac9 req-38de2a57-2e50-40b2-944f-0a131a0327be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2d67eee-7c84-408a-8c4c-7b656de9128e", "tag": "fb8475fb-53f1-444e-b92f-5a03602cc266"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:42.660857 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:39:42.660857 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 03:39:42.678102 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-5946ade4-12f5-4ab2-8512-378ac8f90ac9 req-38de2a57-2e50-40b2-944f-0a131a0327be service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:42.678762 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-5946ade4-12f5-4ab2-8512-378ac8f90ac9 req-38de2a57-2e50-40b2-944f-0a131a0327be service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:42.696184 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-5946ade4-12f5-4ab2-8512-378ac8f90ac9 req-38de2a57-2e50-40b2-944f-0a131a0327be service nova] Creating event network-changed:fb8475fb-53f1-444e-b92f-5a03602cc266 for instance b2d67eee-7c84-408a-8c4c-7b656de9128e on hv-cinder-81410 Oct 15 03:39:42.704619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-5946ade4-12f5-4ab2-8512-378ac8f90ac9 req-38de2a57-2e50-40b2-944f-0a131a0327be service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065710 Oct 15 03:39:42.705786 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 92/176] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:39:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:39:42.846807 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9d68824b-7667-4f13-86d7-54dc5e6076d9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:42.847499 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9d68824b-7667-4f13-86d7-54dc5e6076d9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:42.865840 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d68824b-7667-4f13-86d7-54dc5e6076d9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:42.866429 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d68824b-7667-4f13-86d7-54dc5e6076d9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:42.867461 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d68824b-7667-4f13-86d7-54dc5e6076d9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:42.868083 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d68824b-7667-4f13-86d7-54dc5e6076d9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:43.420395 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9d68824b-7667-4f13-86d7-54dc5e6076d9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:43.433865 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9d68824b-7667-4f13-86d7-54dc5e6076d9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e" status: 200 len: 1318 microversion: 2.1 time: 0.590719 Oct 15 03:39:43.437474 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 85/177] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:42 2021] GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e => generated 1318 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:43.634835 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1bdca20d-04f3-441e-921f-cd2412e4d820 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:43.637610 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1bdca20d-04f3-441e-921f-cd2412e4d820 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:43.675619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1bdca20d-04f3-441e-921f-cd2412e4d820 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:43.678424 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1bdca20d-04f3-441e-921f-cd2412e4d820 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:43.681265 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1bdca20d-04f3-441e-921f-cd2412e4d820 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:43.685555 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1bdca20d-04f3-441e-921f-cd2412e4d820 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:43.807575 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1bdca20d-04f3-441e-921f-cd2412e4d820 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 37077 microversion: 2.20 time: 0.177153 Oct 15 03:39:43.808725 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 93/178] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:43 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 37077 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:44.148407 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-84d33c91-c987-4819-84d7-a9b9aa6879b7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1515535510", "imageRef": "0ec12dbd-23ec-4d58-b215-4e3cd5f17594", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7200c311-17f2-4a0c-b60b-6518a1af171f"}]}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:44.263732 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.network.neutron [None req-84d33c91-c987-4819-84d7-a9b9aa6879b7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] validate_networks() for [('7200c311-17f2-4a0c-b60b-6518a1af171f', None, None, None, None, None)] {{(pid=120897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 15 03:39:44.473352 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3f590d14-6113-4274-baa9-05e6a18a4c0a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:44.474051 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3f590d14-6113-4274-baa9-05e6a18a4c0a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:44.492945 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f590d14-6113-4274-baa9-05e6a18a4c0a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:44.493382 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f590d14-6113-4274-baa9-05e6a18a4c0a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:44.496820 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f590d14-6113-4274-baa9-05e6a18a4c0a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:44.497415 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f590d14-6113-4274-baa9-05e6a18a4c0a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:44.877920 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3f590d14-6113-4274-baa9-05e6a18a4c0a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:44.895477 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3f590d14-6113-4274-baa9-05e6a18a4c0a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e" status: 200 len: 1318 microversion: 2.1 time: 0.443048 Oct 15 03:39:44.896255 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 94/179] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:44 2021] GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:44.902421 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4331be15-6869-4bb4-81dd-a7e5a5cf308d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:44.903453 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4331be15-6869-4bb4-81dd-a7e5a5cf308d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:44.933193 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4331be15-6869-4bb4-81dd-a7e5a5cf308d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:44.934805 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4331be15-6869-4bb4-81dd-a7e5a5cf308d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:44.936211 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4331be15-6869-4bb4-81dd-a7e5a5cf308d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:44.936840 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4331be15-6869-4bb4-81dd-a7e5a5cf308d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:45.045718 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4331be15-6869-4bb4-81dd-a7e5a5cf308d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 37887 microversion: 2.20 time: 0.148067 Oct 15 03:39:45.046401 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 95/180] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:44 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 37887 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:45.140583 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-84d33c91-c987-4819-84d7-a9b9aa6879b7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Flavor limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 03:39:45.141644 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-84d33c91-c987-4819-84d7-a9b9aa6879b7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Image limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 03:39:45.143073 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-84d33c91-c987-4819-84d7-a9b9aa6879b7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Flavor pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 03:39:45.143649 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-84d33c91-c987-4819-84d7-a9b9aa6879b7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Image pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 03:39:45.144262 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-84d33c91-c987-4819-84d7-a9b9aa6879b7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 03:39:45.157793 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84d33c91-c987-4819-84d7-a9b9aa6879b7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:45.159619 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84d33c91-c987-4819-84d7-a9b9aa6879b7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:45.160627 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84d33c91-c987-4819-84d7-a9b9aa6879b7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:45.161382 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84d33c91-c987-4819-84d7-a9b9aa6879b7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:45.201866 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-84d33c91-c987-4819-84d7-a9b9aa6879b7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Getting quotas for project 4687122800414ea6b0203e53a18a54ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:39:45.211508 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-84d33c91-c987-4819-84d7-a9b9aa6879b7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Getting quotas for user 1e012909f2e14c9c9e8c93d76aead42d and project 4687122800414ea6b0203e53a18a54ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:39:45.243718 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-84d33c91-c987-4819-84d7-a9b9aa6879b7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Going to run 1 instances... {{(pid=120897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 15 03:39:45.251101 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-84d33c91-c987-4819-84d7-a9b9aa6879b7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ec12dbd-23ec-4d58-b215-4e3cd5f17594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 15 03:39:45.305843 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-84d33c91-c987-4819-84d7-a9b9aa6879b7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.334007 Oct 15 03:39:45.307603 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 86/181] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Oct 15 03:39:43 2021] POST /compute/v2.1/servers => generated 383 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 03:39:45.319729 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-32d3c134-2f9d-4484-9b0f-314158bc8757 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:45.320737 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-32d3c134-2f9d-4484-9b0f-314158bc8757 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:45.397257 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-32d3c134-2f9d-4484-9b0f-314158bc8757 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:45.406265 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-32d3c134-2f9d-4484-9b0f-314158bc8757 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1222 microversion: 2.1 time: 0.091715 Oct 15 03:39:45.407299 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 96/182] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:45 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:45.547870 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c63794f0-0a95-4df4-be57-0ab75bc60ed7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-641372845", "imageRef": "0ec12dbd-23ec-4d58-b215-4e3cd5f17594", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7200c311-17f2-4a0c-b60b-6518a1af171f"}]}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:45.651509 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.network.neutron [None req-c63794f0-0a95-4df4-be57-0ab75bc60ed7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] validate_networks() for [('7200c311-17f2-4a0c-b60b-6518a1af171f', None, None, None, None, None)] {{(pid=120897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 15 03:39:45.912727 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9ce3c234-4ee3-4f26-962e-a682a6e410d6 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:45.913335 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9ce3c234-4ee3-4f26-962e-a682a6e410d6 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:45.931115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ce3c234-4ee3-4f26-962e-a682a6e410d6 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:45.932930 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ce3c234-4ee3-4f26-962e-a682a6e410d6 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:45.933737 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ce3c234-4ee3-4f26-962e-a682a6e410d6 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:45.939745 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ce3c234-4ee3-4f26-962e-a682a6e410d6 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:46.235785 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-9ce3c234-4ee3-4f26-962e-a682a6e410d6 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:46.252233 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9ce3c234-4ee3-4f26-962e-a682a6e410d6 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e" status: 200 len: 1318 microversion: 2.1 time: 0.342813 Oct 15 03:39:46.254739 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 97/183] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:45 2021] GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:39:46.269810 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-986c882c-1fdf-4300-808a-3c49f798a774 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:46.270938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-986c882c-1fdf-4300-808a-3c49f798a774 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:46.282643 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-986c882c-1fdf-4300-808a-3c49f798a774 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:46.283292 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-986c882c-1fdf-4300-808a-3c49f798a774 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:46.284440 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-986c882c-1fdf-4300-808a-3c49f798a774 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:46.285149 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-986c882c-1fdf-4300-808a-3c49f798a774 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:46.416258 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-986c882c-1fdf-4300-808a-3c49f798a774 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 38198 microversion: 2.20 time: 0.159779 Oct 15 03:39:46.417279 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 98/184] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:46 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 38198 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:46.421123 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-c63794f0-0a95-4df4-be57-0ab75bc60ed7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Flavor limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 03:39:46.421585 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-c63794f0-0a95-4df4-be57-0ab75bc60ed7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Image limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 03:39:46.422019 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-c63794f0-0a95-4df4-be57-0ab75bc60ed7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Flavor pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 03:39:46.422481 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-c63794f0-0a95-4df4-be57-0ab75bc60ed7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Image pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 03:39:46.423127 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-c63794f0-0a95-4df4-be57-0ab75bc60ed7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 03:39:46.434853 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c63794f0-0a95-4df4-be57-0ab75bc60ed7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:46.435624 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c63794f0-0a95-4df4-be57-0ab75bc60ed7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:46.437291 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c63794f0-0a95-4df4-be57-0ab75bc60ed7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:46.438688 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c63794f0-0a95-4df4-be57-0ab75bc60ed7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:46.463108 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-c63794f0-0a95-4df4-be57-0ab75bc60ed7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Getting quotas for project 4687122800414ea6b0203e53a18a54ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:39:46.470044 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-c63794f0-0a95-4df4-be57-0ab75bc60ed7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Getting quotas for user 1e012909f2e14c9c9e8c93d76aead42d and project 4687122800414ea6b0203e53a18a54ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:39:46.483937 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c63794f0-0a95-4df4-be57-0ab75bc60ed7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Going to run 1 instances... {{(pid=120897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 15 03:39:46.486675 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c63794f0-0a95-4df4-be57-0ab75bc60ed7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ec12dbd-23ec-4d58-b215-4e3cd5f17594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 15 03:39:46.546080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c63794f0-0a95-4df4-be57-0ab75bc60ed7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.002115 Oct 15 03:39:46.551705 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 87/185] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Oct 15 03:39:45 2021] POST /compute/v2.1/servers => generated 383 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 03:39:46.558665 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e4c63342-5da2-4f93-a2ec-617a1bfdb77f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:46.559463 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e4c63342-5da2-4f93-a2ec-617a1bfdb77f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:46.645902 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e4c63342-5da2-4f93-a2ec-617a1bfdb77f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:46.654975 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e4c63342-5da2-4f93-a2ec-617a1bfdb77f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1221 microversion: 2.1 time: 0.101416 Oct 15 03:39:46.655571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 99/186] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:46 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1221 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:47.273086 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-34a27f31-8a85-4a47-9c28-5bf02dda3249 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:47.274756 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-34a27f31-8a85-4a47-9c28-5bf02dda3249 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:47.302020 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-34a27f31-8a85-4a47-9c28-5bf02dda3249 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:47.302305 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-34a27f31-8a85-4a47-9c28-5bf02dda3249 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:47.303184 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-34a27f31-8a85-4a47-9c28-5bf02dda3249 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:47.303623 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-34a27f31-8a85-4a47-9c28-5bf02dda3249 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:47.429779 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-10d5cbbe-11f3-4231-9009-b5f28f9043e0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:47.432460 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-10d5cbbe-11f3-4231-9009-b5f28f9043e0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:47.449007 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10d5cbbe-11f3-4231-9009-b5f28f9043e0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:47.449998 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10d5cbbe-11f3-4231-9009-b5f28f9043e0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:47.454265 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10d5cbbe-11f3-4231-9009-b5f28f9043e0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:47.455211 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10d5cbbe-11f3-4231-9009-b5f28f9043e0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:47.534768 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-10d5cbbe-11f3-4231-9009-b5f28f9043e0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 38198 microversion: 2.20 time: 0.110200 Oct 15 03:39:47.536347 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 100/187] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:47 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 38198 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:47.676581 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-bb2e052c-4b56-4cae-87c7-295ad59a39a8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:47.684795 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-bb2e052c-4b56-4cae-87c7-295ad59a39a8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:47.692965 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bb2e052c-4b56-4cae-87c7-295ad59a39a8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:47.698370 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-34a27f31-8a85-4a47-9c28-5bf02dda3249 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:47.708142 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-34a27f31-8a85-4a47-9c28-5bf02dda3249 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e" status: 200 len: 1318 microversion: 2.1 time: 0.437601 Oct 15 03:39:47.708413 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bb2e052c-4b56-4cae-87c7-295ad59a39a8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:47.721239 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 88/188] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:47 2021] GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:47.721424 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bb2e052c-4b56-4cae-87c7-295ad59a39a8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:47.722499 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bb2e052c-4b56-4cae-87c7-295ad59a39a8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:47.908873 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-bb2e052c-4b56-4cae-87c7-295ad59a39a8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:47.922053 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-bb2e052c-4b56-4cae-87c7-295ad59a39a8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1273 microversion: 2.1 time: 0.253282 Oct 15 03:39:47.922628 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 101/189] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:47 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1273 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:39:48.547378 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2118e4b7-d8fb-4302-b902-1ffdfa6023ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:48.548460 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2118e4b7-d8fb-4302-b902-1ffdfa6023ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:48.572393 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2118e4b7-d8fb-4302-b902-1ffdfa6023ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:48.572962 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2118e4b7-d8fb-4302-b902-1ffdfa6023ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:48.577004 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2118e4b7-d8fb-4302-b902-1ffdfa6023ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:48.579332 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2118e4b7-d8fb-4302-b902-1ffdfa6023ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:48.706053 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2118e4b7-d8fb-4302-b902-1ffdfa6023ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 38198 microversion: 2.20 time: 0.162452 Oct 15 03:39:48.711841 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 89/190] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:48 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 38198 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:48.725978 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-32eb34cb-c53f-4560-9c57-7d5826c8e596 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:48.726590 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-32eb34cb-c53f-4560-9c57-7d5826c8e596 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:48.735753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-32eb34cb-c53f-4560-9c57-7d5826c8e596 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:48.736411 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-32eb34cb-c53f-4560-9c57-7d5826c8e596 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:48.737428 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-32eb34cb-c53f-4560-9c57-7d5826c8e596 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:48.738203 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-32eb34cb-c53f-4560-9c57-7d5826c8e596 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:48.951029 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b5ff6fd8-885c-480e-be89-36d825afbfa5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:48.954660 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b5ff6fd8-885c-480e-be89-36d825afbfa5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:48.960894 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-32eb34cb-c53f-4560-9c57-7d5826c8e596 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:48.973435 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b5ff6fd8-885c-480e-be89-36d825afbfa5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:48.974379 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b5ff6fd8-885c-480e-be89-36d825afbfa5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:48.977614 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b5ff6fd8-885c-480e-be89-36d825afbfa5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:48.979804 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-32eb34cb-c53f-4560-9c57-7d5826c8e596 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e" status: 200 len: 1318 microversion: 2.1 time: 0.254441 Oct 15 03:39:48.979968 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b5ff6fd8-885c-480e-be89-36d825afbfa5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:48.985479 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 102/191] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:48 2021] GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:49.090034 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b5ff6fd8-885c-480e-be89-36d825afbfa5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:49.099708 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b5ff6fd8-885c-480e-be89-36d825afbfa5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1279 microversion: 2.1 time: 0.164607 Oct 15 03:39:49.100279 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 90/192] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:48 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1279 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:39:49.719582 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-dcb11453-bc5a-4742-8336-33ac84f73007 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:49.720478 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-dcb11453-bc5a-4742-8336-33ac84f73007 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:49.730592 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dcb11453-bc5a-4742-8336-33ac84f73007 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:49.731245 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dcb11453-bc5a-4742-8336-33ac84f73007 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:49.731902 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dcb11453-bc5a-4742-8336-33ac84f73007 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:49.734021 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dcb11453-bc5a-4742-8336-33ac84f73007 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:49.836543 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-dcb11453-bc5a-4742-8336-33ac84f73007 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 38198 microversion: 2.20 time: 0.120714 Oct 15 03:39:49.836975 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 103/193] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:49 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 38198 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:49.893951 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-be83bea4-63bd-4fb8-b001-b53e9a6e65fd req-7eb833c9-54c0-467e-a20b-a3fcb7b3e29a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d67eee-7c84-408a-8c4c-7b656de9128e", "name": "network-vif-plugged", "status": "completed", "tag": "fb8475fb-53f1-444e-b92f-5a03602cc266"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:49.895574 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:39:49.895574 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:39:49.907421 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-be83bea4-63bd-4fb8-b001-b53e9a6e65fd req-7eb833c9-54c0-467e-a20b-a3fcb7b3e29a service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:49.908171 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-be83bea4-63bd-4fb8-b001-b53e9a6e65fd req-7eb833c9-54c0-467e-a20b-a3fcb7b3e29a service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:49.951169 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-be83bea4-63bd-4fb8-b001-b53e9a6e65fd req-7eb833c9-54c0-467e-a20b-a3fcb7b3e29a service nova] Creating event network-vif-plugged:fb8475fb-53f1-444e-b92f-5a03602cc266 for instance b2d67eee-7c84-408a-8c4c-7b656de9128e on hv-cinder-81410 Oct 15 03:39:49.957722 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-be83bea4-63bd-4fb8-b001-b53e9a6e65fd req-7eb833c9-54c0-467e-a20b-a3fcb7b3e29a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069791 Oct 15 03:39:49.958510 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 91/194] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:39:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:39:50.013921 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ad2c43fe-a291-4a70-b5d8-02abee237e98 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:50.031302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ad2c43fe-a291-4a70-b5d8-02abee237e98 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:50.046444 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ad2c43fe-a291-4a70-b5d8-02abee237e98 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:50.047030 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ad2c43fe-a291-4a70-b5d8-02abee237e98 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:50.048053 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ad2c43fe-a291-4a70-b5d8-02abee237e98 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:50.048562 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ad2c43fe-a291-4a70-b5d8-02abee237e98 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:50.088462 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-ab9929cf-b215-4dcb-807a-09df526a00b2 req-75ff5125-7047-443f-adc9-5f01c1ff329b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c33f5b74-7b6d-44da-870a-cff6c079605d", "tag": "4e56ff2e-025a-453b-847c-49973ba90607"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:50.090685 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:39:50.090685 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:39:50.114854 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-ab9929cf-b215-4dcb-807a-09df526a00b2 req-75ff5125-7047-443f-adc9-5f01c1ff329b service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:50.115299 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-ab9929cf-b215-4dcb-807a-09df526a00b2 req-75ff5125-7047-443f-adc9-5f01c1ff329b service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:50.145317 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-ab9929cf-b215-4dcb-807a-09df526a00b2 req-75ff5125-7047-443f-adc9-5f01c1ff329b service nova] Creating event network-changed:4e56ff2e-025a-453b-847c-49973ba90607 for instance c33f5b74-7b6d-44da-870a-cff6c079605d on hv-cinder-81410 Oct 15 03:39:50.162929 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-ab9929cf-b215-4dcb-807a-09df526a00b2 req-75ff5125-7047-443f-adc9-5f01c1ff329b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078725 Oct 15 03:39:50.164060 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 92/195] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:39:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:39:50.178131 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e4691b5e-97fd-4fb4-907a-91abc2dc3ad2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:50.180634 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e4691b5e-97fd-4fb4-907a-91abc2dc3ad2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:50.201416 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e4691b5e-97fd-4fb4-907a-91abc2dc3ad2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:50.202347 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e4691b5e-97fd-4fb4-907a-91abc2dc3ad2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:50.204023 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e4691b5e-97fd-4fb4-907a-91abc2dc3ad2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:50.205194 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e4691b5e-97fd-4fb4-907a-91abc2dc3ad2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:50.912988 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ad2c43fe-a291-4a70-b5d8-02abee237e98 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:50.926241 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ad2c43fe-a291-4a70-b5d8-02abee237e98 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e" status: 200 len: 1318 microversion: 2.1 time: 0.923650 Oct 15 03:39:50.932147 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e4691b5e-97fd-4fb4-907a-91abc2dc3ad2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:50.935909 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 104/196] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:50 2021] GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e => generated 1318 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:50.940899 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e4691b5e-97fd-4fb4-907a-91abc2dc3ad2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1321 microversion: 2.1 time: 0.774840 Oct 15 03:39:50.941506 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 93/197] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:50 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1321 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:50.941882 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4d7cc9e2-dfaa-42e3-bb87-b44688e79455 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:50.942985 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4d7cc9e2-dfaa-42e3-bb87-b44688e79455 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:50.950403 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4d7cc9e2-dfaa-42e3-bb87-b44688e79455 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:50.951091 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4d7cc9e2-dfaa-42e3-bb87-b44688e79455 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:50.952176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4d7cc9e2-dfaa-42e3-bb87-b44688e79455 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:50.952789 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4d7cc9e2-dfaa-42e3-bb87-b44688e79455 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:51.021280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-9f42c546-b1e4-422b-a6a4-56eeccc6f97d req-33c29ed7-abfa-4d53-a78d-4293f75ed937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7977d03b-ee0f-485a-a1c1-e711d9df1a46", "tag": "a8547089-bb71-4ecb-a5da-ded0a0bf878f"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:51.023594 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:39:51.023594 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:39:51.035534 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-9f42c546-b1e4-422b-a6a4-56eeccc6f97d req-33c29ed7-abfa-4d53-a78d-4293f75ed937 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:51.036008 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-9f42c546-b1e4-422b-a6a4-56eeccc6f97d req-33c29ed7-abfa-4d53-a78d-4293f75ed937 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:51.055982 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-9f42c546-b1e4-422b-a6a4-56eeccc6f97d req-33c29ed7-abfa-4d53-a78d-4293f75ed937 service nova] Creating event network-changed:a8547089-bb71-4ecb-a5da-ded0a0bf878f for instance 7977d03b-ee0f-485a-a1c1-e711d9df1a46 on hv-cinder-81410 Oct 15 03:39:51.061343 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-9f42c546-b1e4-422b-a6a4-56eeccc6f97d req-33c29ed7-abfa-4d53-a78d-4293f75ed937 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043817 Oct 15 03:39:51.061942 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 94/198] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:39:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:39:51.184753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4d7cc9e2-dfaa-42e3-bb87-b44688e79455 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 38275 microversion: 2.20 time: 0.247204 Oct 15 03:39:51.198224 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 105/199] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:50 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 38275 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:51.951107 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e0c61f5d-9147-41d1-b1ec-1ce5855c93bd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:51.954547 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e0c61f5d-9147-41d1-b1ec-1ce5855c93bd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:51.959940 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b10fce78-940c-49d1-9a40-4986fb52d881 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:51.960669 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b10fce78-940c-49d1-9a40-4986fb52d881 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:51.962071 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0c61f5d-9147-41d1-b1ec-1ce5855c93bd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:51.962701 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0c61f5d-9147-41d1-b1ec-1ce5855c93bd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:51.963633 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0c61f5d-9147-41d1-b1ec-1ce5855c93bd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:51.964782 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0c61f5d-9147-41d1-b1ec-1ce5855c93bd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:51.970138 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b10fce78-940c-49d1-9a40-4986fb52d881 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:51.972297 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b10fce78-940c-49d1-9a40-4986fb52d881 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:51.973798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b10fce78-940c-49d1-9a40-4986fb52d881 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:51.979504 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b10fce78-940c-49d1-9a40-4986fb52d881 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:52.345112 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e0c61f5d-9147-41d1-b1ec-1ce5855c93bd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:52.353813 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e0c61f5d-9147-41d1-b1ec-1ce5855c93bd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e" status: 200 len: 1318 microversion: 2.1 time: 0.409248 Oct 15 03:39:52.354399 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 95/200] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:51 2021] GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:52.364390 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5d8197c3-854c-4a05-b730-7973e6802e8f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:52.369418 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5d8197c3-854c-4a05-b730-7973e6802e8f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:52.375752 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b10fce78-940c-49d1-9a40-4986fb52d881 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:52.383191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5d8197c3-854c-4a05-b730-7973e6802e8f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:52.383635 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5d8197c3-854c-4a05-b730-7973e6802e8f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:52.383894 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b10fce78-940c-49d1-9a40-4986fb52d881 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1321 microversion: 2.1 time: 0.428770 Oct 15 03:39:52.385626 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5d8197c3-854c-4a05-b730-7973e6802e8f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:52.386076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5d8197c3-854c-4a05-b730-7973e6802e8f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:52.386896 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 106/201] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:51 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:52.481134 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5d8197c3-854c-4a05-b730-7973e6802e8f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 38337 microversion: 2.20 time: 0.125495 Oct 15 03:39:52.481786 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 96/202] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:52 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 38337 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:39:52.491713 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-696fcbc8-bd20-4a1d-8e34-0ea393a39c3b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:52.492212 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-696fcbc8-bd20-4a1d-8e34-0ea393a39c3b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:52.499218 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-696fcbc8-bd20-4a1d-8e34-0ea393a39c3b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:52.499852 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-696fcbc8-bd20-4a1d-8e34-0ea393a39c3b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:52.500726 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-696fcbc8-bd20-4a1d-8e34-0ea393a39c3b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:52.501279 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-696fcbc8-bd20-4a1d-8e34-0ea393a39c3b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:52.525934 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-696fcbc8-bd20-4a1d-8e34-0ea393a39c3b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/ips" status: 200 len: 151 microversion: 2.20 time: 0.037840 Oct 15 03:39:52.526849 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 107/203] 10.222.0.30 () {60 vars in 1288 bytes} [Fri Oct 15 03:39:52 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:39:53.372517 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d85751c9-321b-4c4a-990d-d5a65470f7a9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:53.373285 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d85751c9-321b-4c4a-990d-d5a65470f7a9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:53.384685 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d85751c9-321b-4c4a-990d-d5a65470f7a9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:53.385141 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d85751c9-321b-4c4a-990d-d5a65470f7a9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:53.386720 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d85751c9-321b-4c4a-990d-d5a65470f7a9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:53.387231 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d85751c9-321b-4c4a-990d-d5a65470f7a9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:53.402879 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4e2dc11c-47da-49a1-9f6b-5efad3a06ce1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:53.411970 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4e2dc11c-47da-49a1-9f6b-5efad3a06ce1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:53.423708 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4e2dc11c-47da-49a1-9f6b-5efad3a06ce1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:53.424173 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4e2dc11c-47da-49a1-9f6b-5efad3a06ce1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:53.424956 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4e2dc11c-47da-49a1-9f6b-5efad3a06ce1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:53.425387 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4e2dc11c-47da-49a1-9f6b-5efad3a06ce1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:53.593760 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d85751c9-321b-4c4a-990d-d5a65470f7a9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:53.602531 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d85751c9-321b-4c4a-990d-d5a65470f7a9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e" status: 200 len: 1508 microversion: 2.1 time: 0.235059 Oct 15 03:39:53.603909 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 97/204] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:53 2021] GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:53.606162 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4e2dc11c-47da-49a1-9f6b-5efad3a06ce1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:53.616369 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4e2dc11c-47da-49a1-9f6b-5efad3a06ce1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1321 microversion: 2.1 time: 0.217146 Oct 15 03:39:53.617408 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 108/205] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:53 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:39:54.635345 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-36b307e0-e289-4f75-b10f-769467c91fbc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:54.635897 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-36b307e0-e289-4f75-b10f-769467c91fbc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:54.642179 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-36b307e0-e289-4f75-b10f-769467c91fbc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:54.642645 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-36b307e0-e289-4f75-b10f-769467c91fbc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:54.643500 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-36b307e0-e289-4f75-b10f-769467c91fbc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:54.643962 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-36b307e0-e289-4f75-b10f-769467c91fbc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:54.765112 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-36b307e0-e289-4f75-b10f-769467c91fbc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:54.772336 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-36b307e0-e289-4f75-b10f-769467c91fbc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1321 microversion: 2.1 time: 0.141235 Oct 15 03:39:54.772895 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 98/206] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:54 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1321 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:55.790028 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3a1aabb2-4ef2-41c7-9a12-4c9bb9ddfc46 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:55.790736 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3a1aabb2-4ef2-41c7-9a12-4c9bb9ddfc46 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:55.796861 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a1aabb2-4ef2-41c7-9a12-4c9bb9ddfc46 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:55.797313 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a1aabb2-4ef2-41c7-9a12-4c9bb9ddfc46 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:55.798119 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a1aabb2-4ef2-41c7-9a12-4c9bb9ddfc46 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:55.798561 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a1aabb2-4ef2-41c7-9a12-4c9bb9ddfc46 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:55.949241 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3a1aabb2-4ef2-41c7-9a12-4c9bb9ddfc46 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:55.965176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3a1aabb2-4ef2-41c7-9a12-4c9bb9ddfc46 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1321 microversion: 2.1 time: 0.178973 Oct 15 03:39:55.965974 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 109/207] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:55 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:56.982675 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-14ad12a7-7ad8-48cb-b883-bde6ec8094e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:56.983426 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-14ad12a7-7ad8-48cb-b883-bde6ec8094e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:56.989982 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-14ad12a7-7ad8-48cb-b883-bde6ec8094e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:56.990549 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-14ad12a7-7ad8-48cb-b883-bde6ec8094e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:56.991416 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-14ad12a7-7ad8-48cb-b883-bde6ec8094e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:56.991978 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-14ad12a7-7ad8-48cb-b883-bde6ec8094e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:57.017280 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fecc291a-e971-4672-b2d9-9dcd50706c5e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a549638a-a9cc-4166-9c43-7f3c01fe8063"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:57.018338 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fecc291a-e971-4672-b2d9-9dcd50706c5e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:57.024176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fecc291a-e971-4672-b2d9-9dcd50706c5e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:57.024623 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fecc291a-e971-4672-b2d9-9dcd50706c5e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:57.025927 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fecc291a-e971-4672-b2d9-9dcd50706c5e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:57.026365 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fecc291a-e971-4672-b2d9-9dcd50706c5e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:57.147721 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-14ad12a7-7ad8-48cb-b883-bde6ec8094e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:57.156627 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-14ad12a7-7ad8-48cb-b883-bde6ec8094e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1321 microversion: 2.1 time: 0.178028 Oct 15 03:39:57.157511 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 99/208] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:56 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:57.352571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fecc291a-e971-4672-b2d9-9dcd50706c5e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "POST /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338846 Oct 15 03:39:57.358802 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 110/209] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Oct 15 03:39:57 2021] POST /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:39:57.857342 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-baf58ba8-b0d2-47ec-8f48-f0c8ae7d5571 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1860440030", "imageRef": "0ec12dbd-23ec-4d58-b215-4e3cd5f17594", "flavorRef": "452", "networks": [{"uuid": "62960a50-ba2c-428b-9b7b-0ec4528b288c"}]}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:57.924016 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.network.neutron [None req-baf58ba8-b0d2-47ec-8f48-f0c8ae7d5571 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] validate_networks() for [('62960a50-ba2c-428b-9b7b-0ec4528b288c', None, None, None, None, None)] {{(pid=120897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 15 03:39:58.176087 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2162cd84-c7d7-4511-9c81-d0a7e97822a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:58.176940 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2162cd84-c7d7-4511-9c81-d0a7e97822a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:58.189984 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2162cd84-c7d7-4511-9c81-d0a7e97822a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:58.190787 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2162cd84-c7d7-4511-9c81-d0a7e97822a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:58.192628 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2162cd84-c7d7-4511-9c81-d0a7e97822a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:58.193240 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2162cd84-c7d7-4511-9c81-d0a7e97822a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:58.569816 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2162cd84-c7d7-4511-9c81-d0a7e97822a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:58.586332 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2162cd84-c7d7-4511-9c81-d0a7e97822a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1321 microversion: 2.1 time: 0.413131 Oct 15 03:39:58.586947 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 111/210] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:58 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1321 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:58.595188 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-baf58ba8-b0d2-47ec-8f48-f0c8ae7d5571 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Flavor limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 03:39:58.595812 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-baf58ba8-b0d2-47ec-8f48-f0c8ae7d5571 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Image limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 03:39:58.596342 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-baf58ba8-b0d2-47ec-8f48-f0c8ae7d5571 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Flavor pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 03:39:58.597290 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-baf58ba8-b0d2-47ec-8f48-f0c8ae7d5571 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Image pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 03:39:58.598058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-baf58ba8-b0d2-47ec-8f48-f0c8ae7d5571 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 03:39:58.602777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-96054501-530f-44bf-8981-fe417a4fdb83 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:58.603928 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-96054501-530f-44bf-8981-fe417a4fdb83 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:58.612040 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-baf58ba8-b0d2-47ec-8f48-f0c8ae7d5571 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:58.613194 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-baf58ba8-b0d2-47ec-8f48-f0c8ae7d5571 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:58.614282 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-baf58ba8-b0d2-47ec-8f48-f0c8ae7d5571 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:58.615506 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-baf58ba8-b0d2-47ec-8f48-f0c8ae7d5571 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:58.618608 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-96054501-530f-44bf-8981-fe417a4fdb83 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:58.621098 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-96054501-530f-44bf-8981-fe417a4fdb83 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:58.621953 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-96054501-530f-44bf-8981-fe417a4fdb83 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:58.622398 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-96054501-530f-44bf-8981-fe417a4fdb83 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:58.652662 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-baf58ba8-b0d2-47ec-8f48-f0c8ae7d5571 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Getting quotas for project 6065f66d6938444d868fb5b3225ce1a1. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:39:58.657669 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-baf58ba8-b0d2-47ec-8f48-f0c8ae7d5571 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Getting quotas for user 1a90e3068213436498812ad167bcb19f and project 6065f66d6938444d868fb5b3225ce1a1. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:39:58.671991 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-baf58ba8-b0d2-47ec-8f48-f0c8ae7d5571 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Going to run 1 instances... {{(pid=120897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 15 03:39:58.673027 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.objects.instance [None req-96054501-530f-44bf-8981-fe417a4fdb83 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lazy-loading 'flavor' on Instance uuid 3594fddd-dbb7-4731-8f30-b3512198e1a9 {{(pid=120899) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 03:39:58.675906 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-baf58ba8-b0d2-47ec-8f48-f0c8ae7d5571 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ec12dbd-23ec-4d58-b215-4e3cd5f17594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 15 03:39:58.750239 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-baf58ba8-b0d2-47ec-8f48-f0c8ae7d5571 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.897391 Oct 15 03:39:58.751032 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 100/211] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Oct 15 03:39:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 03:39:58.761403 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1b165e1c-d13e-4b57-a0cc-ea9acc303489 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:58.762197 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1b165e1c-d13e-4b57-a0cc-ea9acc303489 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:58.934780 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1b165e1c-d13e-4b57-a0cc-ea9acc303489 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:58.954937 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1b165e1c-d13e-4b57-a0cc-ea9acc303489 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1219 microversion: 2.1 time: 0.197825 Oct 15 03:39:58.966558 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 101/212] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:58 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1219 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:39:58.974841 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-d5bb5fd5-a56c-4eba-a8c8-f1474f54edf3 req-ef4bd324-225d-489c-8ceb-96bbb9e76de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c33f5b74-7b6d-44da-870a-cff6c079605d", "name": "network-vif-plugged", "status": "completed", "tag": "4e56ff2e-025a-453b-847c-49973ba90607"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:39:58.987008 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:39:58.987008 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:39:59.000337 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-d5bb5fd5-a56c-4eba-a8c8-f1474f54edf3 req-ef4bd324-225d-489c-8ceb-96bbb9e76de9 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:59.000990 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-d5bb5fd5-a56c-4eba-a8c8-f1474f54edf3 req-ef4bd324-225d-489c-8ceb-96bbb9e76de9 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:59.022087 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-d5bb5fd5-a56c-4eba-a8c8-f1474f54edf3 req-ef4bd324-225d-489c-8ceb-96bbb9e76de9 service nova] Creating event network-vif-plugged:4e56ff2e-025a-453b-847c-49973ba90607 for instance c33f5b74-7b6d-44da-870a-cff6c079605d on hv-cinder-81410 Oct 15 03:39:59.029309 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-d5bb5fd5-a56c-4eba-a8c8-f1474f54edf3 req-ef4bd324-225d-489c-8ceb-96bbb9e76de9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061443 Oct 15 03:39:59.044649 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 102/213] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:39:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:39:59.311289 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-96054501-530f-44bf-8981-fe417a4fdb83 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 202 len: 0 microversion: 2.20 time: 0.721072 Oct 15 03:39:59.316222 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 112/214] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:39:58 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 15 03:39:59.321502 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-016d86c7-a85e-4e5c-a14a-1624f231c944 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:59.322232 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-016d86c7-a85e-4e5c-a14a-1624f231c944 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:59.330787 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-016d86c7-a85e-4e5c-a14a-1624f231c944 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:59.331232 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-016d86c7-a85e-4e5c-a14a-1624f231c944 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:59.332049 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-016d86c7-a85e-4e5c-a14a-1624f231c944 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:59.332481 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-016d86c7-a85e-4e5c-a14a-1624f231c944 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:59.518477 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-016d86c7-a85e-4e5c-a14a-1624f231c944 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:59.534924 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-016d86c7-a85e-4e5c-a14a-1624f231c944 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:59.536523 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-016d86c7-a85e-4e5c-a14a-1624f231c944 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:59.537676 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-016d86c7-a85e-4e5c-a14a-1624f231c944 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1722 microversion: 2.20 time: 0.220248 Oct 15 03:39:59.538528 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 103/215] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:39:59 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:39:59.606704 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8f7660ca-3570-4c7a-9e4e-8dcdbdd1fb17 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:59.607415 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8f7660ca-3570-4c7a-9e4e-8dcdbdd1fb17 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:59.620625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8f7660ca-3570-4c7a-9e4e-8dcdbdd1fb17 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:59.621095 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8f7660ca-3570-4c7a-9e4e-8dcdbdd1fb17 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:59.621892 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8f7660ca-3570-4c7a-9e4e-8dcdbdd1fb17 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:59.622325 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8f7660ca-3570-4c7a-9e4e-8dcdbdd1fb17 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:59.830144 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8f7660ca-3570-4c7a-9e4e-8dcdbdd1fb17 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:39:59.840123 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8f7660ca-3570-4c7a-9e4e-8dcdbdd1fb17 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1321 microversion: 2.1 time: 0.238914 Oct 15 03:39:59.840716 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 113/216] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:59 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:39:59.983850 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7a5b7177-9258-4679-ae6b-b5ba17937082 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:39:59.985370 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7a5b7177-9258-4679-ae6b-b5ba17937082 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:39:59.992590 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7a5b7177-9258-4679-ae6b-b5ba17937082 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:59.993215 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7a5b7177-9258-4679-ae6b-b5ba17937082 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:39:59.994660 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7a5b7177-9258-4679-ae6b-b5ba17937082 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:39:59.996012 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7a5b7177-9258-4679-ae6b-b5ba17937082 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:00.072828 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7a5b7177-9258-4679-ae6b-b5ba17937082 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:00.083788 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7a5b7177-9258-4679-ae6b-b5ba17937082 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1271 microversion: 2.1 time: 0.104815 Oct 15 03:40:00.094907 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 104/217] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:39:59 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1271 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:00.562246 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5507753c-99eb-4836-a00c-ffd1a761f218 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:00.563471 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5507753c-99eb-4836-a00c-ffd1a761f218 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:00.571958 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5507753c-99eb-4836-a00c-ffd1a761f218 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:00.572704 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5507753c-99eb-4836-a00c-ffd1a761f218 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:00.574143 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5507753c-99eb-4836-a00c-ffd1a761f218 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:00.574721 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5507753c-99eb-4836-a00c-ffd1a761f218 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:00.783917 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5507753c-99eb-4836-a00c-ffd1a761f218 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:00.793464 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5507753c-99eb-4836-a00c-ffd1a761f218 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:00.795753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5507753c-99eb-4836-a00c-ffd1a761f218 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:00.797057 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5507753c-99eb-4836-a00c-ffd1a761f218 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1722 microversion: 2.20 time: 0.243481 Oct 15 03:40:00.797893 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 114/218] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:00 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:00.856597 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bdfcab5d-3d0d-4bae-a5c8-d3ba39943502 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:00.857223 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bdfcab5d-3d0d-4bae-a5c8-d3ba39943502 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:00.865372 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bdfcab5d-3d0d-4bae-a5c8-d3ba39943502 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:00.865987 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bdfcab5d-3d0d-4bae-a5c8-d3ba39943502 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:00.866701 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bdfcab5d-3d0d-4bae-a5c8-d3ba39943502 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:00.867042 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bdfcab5d-3d0d-4bae-a5c8-d3ba39943502 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:01.101777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-290c0a4e-e451-423d-a0e6-cc4615abda7c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:01.103527 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-290c0a4e-e451-423d-a0e6-cc4615abda7c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:01.116764 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-290c0a4e-e451-423d-a0e6-cc4615abda7c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:01.119423 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-290c0a4e-e451-423d-a0e6-cc4615abda7c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:01.122209 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-290c0a4e-e451-423d-a0e6-cc4615abda7c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:01.122665 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-290c0a4e-e451-423d-a0e6-cc4615abda7c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:01.138032 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bdfcab5d-3d0d-4bae-a5c8-d3ba39943502 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:01.148587 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bdfcab5d-3d0d-4bae-a5c8-d3ba39943502 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1321 microversion: 2.1 time: 0.295079 Oct 15 03:40:01.150128 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 105/219] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:00 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:01.461695 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-290c0a4e-e451-423d-a0e6-cc4615abda7c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:01.469692 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-290c0a4e-e451-423d-a0e6-cc4615abda7c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1277 microversion: 2.1 time: 0.372027 Oct 15 03:40:01.480687 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 115/220] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:01 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1277 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:40:01.816226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1293a782-7ea4-4110-a32c-e174bef02f70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:01.816930 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1293a782-7ea4-4110-a32c-e174bef02f70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:01.825977 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1293a782-7ea4-4110-a32c-e174bef02f70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:01.829734 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1293a782-7ea4-4110-a32c-e174bef02f70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:01.831372 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1293a782-7ea4-4110-a32c-e174bef02f70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:01.832883 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1293a782-7ea4-4110-a32c-e174bef02f70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:02.043958 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1293a782-7ea4-4110-a32c-e174bef02f70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:02.057882 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1293a782-7ea4-4110-a32c-e174bef02f70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:02.060193 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1293a782-7ea4-4110-a32c-e174bef02f70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:02.061714 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1293a782-7ea4-4110-a32c-e174bef02f70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1722 microversion: 2.20 time: 0.249391 Oct 15 03:40:02.062968 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 106/221] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:01 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:02.166263 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2c7c4ac5-9a2b-49f3-b385-f453277a5c02 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:02.166953 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2c7c4ac5-9a2b-49f3-b385-f453277a5c02 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:02.172827 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2c7c4ac5-9a2b-49f3-b385-f453277a5c02 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:02.173281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2c7c4ac5-9a2b-49f3-b385-f453277a5c02 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:02.174047 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2c7c4ac5-9a2b-49f3-b385-f453277a5c02 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:02.174658 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2c7c4ac5-9a2b-49f3-b385-f453277a5c02 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:02.336264 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2c7c4ac5-9a2b-49f3-b385-f453277a5c02 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:02.348273 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2c7c4ac5-9a2b-49f3-b385-f453277a5c02 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1321 microversion: 2.1 time: 0.185442 Oct 15 03:40:02.353216 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 116/222] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:02 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:02.489044 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d88e5ede-ebc1-4604-b733-3cfc5a0490de tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:02.489731 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d88e5ede-ebc1-4604-b733-3cfc5a0490de tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:02.502037 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d88e5ede-ebc1-4604-b733-3cfc5a0490de tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:02.504656 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d88e5ede-ebc1-4604-b733-3cfc5a0490de tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:02.505489 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d88e5ede-ebc1-4604-b733-3cfc5a0490de tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:02.506170 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d88e5ede-ebc1-4604-b733-3cfc5a0490de tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:03.080504 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d46a439a-e9b6-475f-8c3c-c1edc7076b8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:03.081229 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d46a439a-e9b6-475f-8c3c-c1edc7076b8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:03.089966 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d46a439a-e9b6-475f-8c3c-c1edc7076b8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:03.090561 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d46a439a-e9b6-475f-8c3c-c1edc7076b8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:03.091808 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d46a439a-e9b6-475f-8c3c-c1edc7076b8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:03.092316 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d46a439a-e9b6-475f-8c3c-c1edc7076b8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:03.125943 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d88e5ede-ebc1-4604-b733-3cfc5a0490de tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:03.134001 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d88e5ede-ebc1-4604-b733-3cfc5a0490de tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1319 microversion: 2.1 time: 0.650638 Oct 15 03:40:03.135204 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 107/223] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:02 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1319 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:03.334953 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-96b3f015-3b93-4141-b6bd-a39d5a5147f7 req-bd6b9951-7b46-473a-b753-6200440d4548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7977d03b-ee0f-485a-a1c1-e711d9df1a46", "name": "network-vif-plugged", "status": "completed", "tag": "a8547089-bb71-4ecb-a5da-ded0a0bf878f"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:40:03.338136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:40:03.338136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:40:03.352264 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-96b3f015-3b93-4141-b6bd-a39d5a5147f7 req-bd6b9951-7b46-473a-b753-6200440d4548 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:03.353891 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-96b3f015-3b93-4141-b6bd-a39d5a5147f7 req-bd6b9951-7b46-473a-b753-6200440d4548 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:03.369136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-96b3f015-3b93-4141-b6bd-a39d5a5147f7 req-bd6b9951-7b46-473a-b753-6200440d4548 service nova] Creating event network-vif-plugged:a8547089-bb71-4ecb-a5da-ded0a0bf878f for instance 7977d03b-ee0f-485a-a1c1-e711d9df1a46 on hv-cinder-81410 Oct 15 03:40:03.376053 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-96b3f015-3b93-4141-b6bd-a39d5a5147f7 req-bd6b9951-7b46-473a-b753-6200440d4548 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045819 Oct 15 03:40:03.377266 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 108/224] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:40:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:40:03.380683 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d46a439a-e9b6-475f-8c3c-c1edc7076b8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:03.385960 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-74288378-c036-4f3c-a74d-bb486fcaf4c8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:03.387189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-74288378-c036-4f3c-a74d-bb486fcaf4c8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:03.389222 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d46a439a-e9b6-475f-8c3c-c1edc7076b8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:03.390716 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d46a439a-e9b6-475f-8c3c-c1edc7076b8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:03.394877 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-74288378-c036-4f3c-a74d-bb486fcaf4c8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:03.396354 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-74288378-c036-4f3c-a74d-bb486fcaf4c8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:03.397157 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d46a439a-e9b6-475f-8c3c-c1edc7076b8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1722 microversion: 2.20 time: 0.320640 Oct 15 03:40:03.397572 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-74288378-c036-4f3c-a74d-bb486fcaf4c8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:03.402386 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 117/225] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:03 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1722 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:40:03.405217 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-74288378-c036-4f3c-a74d-bb486fcaf4c8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:03.740020 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-74288378-c036-4f3c-a74d-bb486fcaf4c8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:03.755755 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-74288378-c036-4f3c-a74d-bb486fcaf4c8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1321 microversion: 2.1 time: 0.376292 Oct 15 03:40:03.765530 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 109/226] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:03 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:04.151968 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c81ff2fb-72fa-4721-8e23-b613a637d673 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:04.152843 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c81ff2fb-72fa-4721-8e23-b613a637d673 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:04.159126 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c81ff2fb-72fa-4721-8e23-b613a637d673 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:04.159903 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c81ff2fb-72fa-4721-8e23-b613a637d673 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:04.160893 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c81ff2fb-72fa-4721-8e23-b613a637d673 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:04.161563 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c81ff2fb-72fa-4721-8e23-b613a637d673 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:04.419647 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6f3b2813-c418-4b37-8406-b2dc51cd6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:04.421661 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6f3b2813-c418-4b37-8406-b2dc51cd6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:04.433088 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c81ff2fb-72fa-4721-8e23-b613a637d673 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:04.440093 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6f3b2813-c418-4b37-8406-b2dc51cd6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:04.442047 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6f3b2813-c418-4b37-8406-b2dc51cd6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:04.444215 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6f3b2813-c418-4b37-8406-b2dc51cd6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:04.445537 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6f3b2813-c418-4b37-8406-b2dc51cd6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:04.454658 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c81ff2fb-72fa-4721-8e23-b613a637d673 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1319 microversion: 2.1 time: 0.306947 Oct 15 03:40:04.460432 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 118/227] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:04 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:04.770434 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6f3b2813-c418-4b37-8406-b2dc51cd6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:04.772779 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f2976691-a1e6-44c9-9d43-19c66eb09bbd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:04.773638 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f2976691-a1e6-44c9-9d43-19c66eb09bbd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:04.783786 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f2976691-a1e6-44c9-9d43-19c66eb09bbd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:04.787229 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f2976691-a1e6-44c9-9d43-19c66eb09bbd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:04.787407 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6f3b2813-c418-4b37-8406-b2dc51cd6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:04.788346 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f2976691-a1e6-44c9-9d43-19c66eb09bbd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:04.789048 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f2976691-a1e6-44c9-9d43-19c66eb09bbd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:04.793047 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6f3b2813-c418-4b37-8406-b2dc51cd6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:04.794581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6f3b2813-c418-4b37-8406-b2dc51cd6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1722 microversion: 2.20 time: 0.382550 Oct 15 03:40:04.829679 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 110/228] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:04 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1722 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:40:05.073845 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f2976691-a1e6-44c9-9d43-19c66eb09bbd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:05.082068 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f2976691-a1e6-44c9-9d43-19c66eb09bbd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1321 microversion: 2.1 time: 0.312919 Oct 15 03:40:05.096737 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 119/229] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:04 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:40:05.481964 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-651dd789-928d-41de-aa4c-107ff9b91985 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:05.487057 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-651dd789-928d-41de-aa4c-107ff9b91985 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:05.509119 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-651dd789-928d-41de-aa4c-107ff9b91985 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:05.518764 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-651dd789-928d-41de-aa4c-107ff9b91985 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:05.520951 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-651dd789-928d-41de-aa4c-107ff9b91985 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:05.525496 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-651dd789-928d-41de-aa4c-107ff9b91985 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:05.813712 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-31de7b14-9998-4153-8269-bb16d1d1852b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:05.816023 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-31de7b14-9998-4153-8269-bb16d1d1852b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:05.830578 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-31de7b14-9998-4153-8269-bb16d1d1852b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:05.836488 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-31de7b14-9998-4153-8269-bb16d1d1852b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:05.838208 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-31de7b14-9998-4153-8269-bb16d1d1852b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:05.844421 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-31de7b14-9998-4153-8269-bb16d1d1852b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:06.436698 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-651dd789-928d-41de-aa4c-107ff9b91985 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:06.464864 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-651dd789-928d-41de-aa4c-107ff9b91985 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1319 microversion: 2.1 time: 0.978861 Oct 15 03:40:06.468033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 111/230] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:05 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1319 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:06.484761 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-087a28a4-1f23-4c75-bc25-c3e665b15287 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:06.485670 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-087a28a4-1f23-4c75-bc25-c3e665b15287 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:06.496633 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-087a28a4-1f23-4c75-bc25-c3e665b15287 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:06.497457 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-087a28a4-1f23-4c75-bc25-c3e665b15287 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:06.499399 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-087a28a4-1f23-4c75-bc25-c3e665b15287 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:06.502122 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-087a28a4-1f23-4c75-bc25-c3e665b15287 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:06.747873 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-31de7b14-9998-4153-8269-bb16d1d1852b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:06.761727 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-31de7b14-9998-4153-8269-bb16d1d1852b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:06.763434 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-31de7b14-9998-4153-8269-bb16d1d1852b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:06.764733 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-31de7b14-9998-4153-8269-bb16d1d1852b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1722 microversion: 2.20 time: 0.955177 Oct 15 03:40:06.789849 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 120/231] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:05 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1722 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:06.813640 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-0b971919-e986-4230-a3f3-5974c48a6ccd req-ceb55328-9b5f-42eb-b3e7-ad0e5add25b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "828d646d-36c6-41b2-9e74-56a8ac3c1a73", "tag": "de7e38b1-f501-40e5-8e8e-f969ae95d240"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:40:06.822172 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:40:06.822172 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 03:40:06.859425 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-0b971919-e986-4230-a3f3-5974c48a6ccd req-ceb55328-9b5f-42eb-b3e7-ad0e5add25b1 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:06.864433 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-0b971919-e986-4230-a3f3-5974c48a6ccd req-ceb55328-9b5f-42eb-b3e7-ad0e5add25b1 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:06.914836 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-0b971919-e986-4230-a3f3-5974c48a6ccd req-ceb55328-9b5f-42eb-b3e7-ad0e5add25b1 service nova] Creating event network-changed:de7e38b1-f501-40e5-8e8e-f969ae95d240 for instance 828d646d-36c6-41b2-9e74-56a8ac3c1a73 on hv-cinder-81410 Oct 15 03:40:06.932220 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-0b971919-e986-4230-a3f3-5974c48a6ccd req-ceb55328-9b5f-42eb-b3e7-ad0e5add25b1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136573 Oct 15 03:40:06.933102 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 121/232] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:40:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:40:07.265229 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-087a28a4-1f23-4c75-bc25-c3e665b15287 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:07.282685 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-087a28a4-1f23-4c75-bc25-c3e665b15287 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1321 microversion: 2.1 time: 0.809602 Oct 15 03:40:07.284390 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 112/233] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:06 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1321 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:07.429613 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2b3f0bf9-3e18-4b98-8dd4-9a6867ff0ecf tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a549638a-a9cc-4166-9c43-7f3c01fe8063"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:40:07.431829 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2b3f0bf9-3e18-4b98-8dd4-9a6867ff0ecf tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:07.444089 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b3f0bf9-3e18-4b98-8dd4-9a6867ff0ecf tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:07.444768 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b3f0bf9-3e18-4b98-8dd4-9a6867ff0ecf tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:07.445750 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b3f0bf9-3e18-4b98-8dd4-9a6867ff0ecf tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:07.446342 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b3f0bf9-3e18-4b98-8dd4-9a6867ff0ecf tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:07.487381 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a00b5088-8b10-45ec-ab21-828c40d24439 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:07.489127 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a00b5088-8b10-45ec-ab21-828c40d24439 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:07.499890 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a00b5088-8b10-45ec-ab21-828c40d24439 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:07.500754 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a00b5088-8b10-45ec-ab21-828c40d24439 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:07.508519 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a00b5088-8b10-45ec-ab21-828c40d24439 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:07.509270 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a00b5088-8b10-45ec-ab21-828c40d24439 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:07.659035 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-2b3f0bf9-3e18-4b98-8dd4-9a6867ff0ecf tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] HTTP exception thrown: Invalid volume: volume a549638a-a9cc-4166-9c43-7f3c01fe8063 is already attached to instances: b2d67eee-7c84-408a-8c4c-7b656de9128e Oct 15 03:40:07.659649 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2b3f0bf9-3e18-4b98-8dd4-9a6867ff0ecf tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Returning 400 to user: Invalid volume: volume a549638a-a9cc-4166-9c43-7f3c01fe8063 is already attached to instances: b2d67eee-7c84-408a-8c4c-7b656de9128e {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:40:07.660617 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2b3f0bf9-3e18-4b98-8dd4-9a6867ff0ecf tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "POST /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.236700 Oct 15 03:40:07.661224 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 122/234] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Oct 15 03:40:07 2021] POST /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e/os-volume_attachments => generated 174 bytes in 239 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 15 03:40:07.738601 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-da347ee7-776d-4bcf-a94e-390ead4c90e4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:07.739104 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-da347ee7-776d-4bcf-a94e-390ead4c90e4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:07.751205 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-da347ee7-776d-4bcf-a94e-390ead4c90e4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:07.751655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-da347ee7-776d-4bcf-a94e-390ead4c90e4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:07.752629 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-da347ee7-776d-4bcf-a94e-390ead4c90e4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:07.753068 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-da347ee7-776d-4bcf-a94e-390ead4c90e4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:07.839908 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a00b5088-8b10-45ec-ab21-828c40d24439 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:07.851583 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a00b5088-8b10-45ec-ab21-828c40d24439 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1319 microversion: 2.1 time: 0.370478 Oct 15 03:40:07.852395 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 113/235] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:07 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1319 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:07.862678 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f4917a1d-8d58-4451-9bc0-ecd4bb890ba6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:07.866307 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f4917a1d-8d58-4451-9bc0-ecd4bb890ba6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:07.885280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f4917a1d-8d58-4451-9bc0-ecd4bb890ba6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:07.887107 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f4917a1d-8d58-4451-9bc0-ecd4bb890ba6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:07.891527 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f4917a1d-8d58-4451-9bc0-ecd4bb890ba6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:07.893210 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f4917a1d-8d58-4451-9bc0-ecd4bb890ba6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:07.926136 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.objects.instance [None req-da347ee7-776d-4bcf-a94e-390ead4c90e4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lazy-loading 'services' on Instance uuid b2d67eee-7c84-408a-8c4c-7b656de9128e {{(pid=120899) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 03:40:08.034505 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-da347ee7-776d-4bcf-a94e-390ead4c90e4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e/os-volume_attachments/a549638a-a9cc-4166-9c43-7f3c01fe8063" status: 202 len: 0 microversion: 2.1 time: 0.299332 Oct 15 03:40:08.035431 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 123/236] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Oct 15 03:40:07 2021] DELETE /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e/os-volume_attachments/a549638a-a9cc-4166-9c43-7f3c01fe8063 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:40:08.053370 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9371da70-6d4f-4626-8fa0-6a58a209a408 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:08.057919 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9371da70-6d4f-4626-8fa0-6a58a209a408 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:08.073529 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9371da70-6d4f-4626-8fa0-6a58a209a408 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:08.075390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9371da70-6d4f-4626-8fa0-6a58a209a408 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:08.076661 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9371da70-6d4f-4626-8fa0-6a58a209a408 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:08.077324 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9371da70-6d4f-4626-8fa0-6a58a209a408 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:08.132702 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9371da70-6d4f-4626-8fa0-6a58a209a408 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090599 Oct 15 03:40:08.137688 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 124/237] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:40:08 2021] GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:40:08.302134 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-767c0b0f-b7e4-4893-9232-96023fe799a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:08.303146 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-767c0b0f-b7e4-4893-9232-96023fe799a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:08.313641 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-767c0b0f-b7e4-4893-9232-96023fe799a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:08.314464 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-767c0b0f-b7e4-4893-9232-96023fe799a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:08.315790 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-767c0b0f-b7e4-4893-9232-96023fe799a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:08.316459 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-767c0b0f-b7e4-4893-9232-96023fe799a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:08.467488 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f4917a1d-8d58-4451-9bc0-ecd4bb890ba6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:08.475400 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f4917a1d-8d58-4451-9bc0-ecd4bb890ba6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:08.477141 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f4917a1d-8d58-4451-9bc0-ecd4bb890ba6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:08.479262 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f4917a1d-8d58-4451-9bc0-ecd4bb890ba6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1722 microversion: 2.20 time: 0.622389 Oct 15 03:40:08.480072 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 114/238] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:07 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1722 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:08.600720 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-767c0b0f-b7e4-4893-9232-96023fe799a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:08.615551 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-767c0b0f-b7e4-4893-9232-96023fe799a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1516 microversion: 2.1 time: 0.319127 Oct 15 03:40:08.631782 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 125/239] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:08 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1516 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:40:08.647339 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7d8d195d-e690-4ad2-a8b8-5d84675a0d67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:40:08.648776 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7d8d195d-e690-4ad2-a8b8-5d84675a0d67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:08.663714 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7d8d195d-e690-4ad2-a8b8-5d84675a0d67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:08.664256 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7d8d195d-e690-4ad2-a8b8-5d84675a0d67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:08.665645 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7d8d195d-e690-4ad2-a8b8-5d84675a0d67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:08.666156 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7d8d195d-e690-4ad2-a8b8-5d84675a0d67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:08.734343 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.objects.instance [None req-7d8d195d-e690-4ad2-a8b8-5d84675a0d67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lazy-loading 'flavor' on Instance uuid 7977d03b-ee0f-485a-a1c1-e711d9df1a46 {{(pid=120897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 03:40:08.870337 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-18b82ef6-a62d-47b2-924f-b57066f78640 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:08.871195 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-18b82ef6-a62d-47b2-924f-b57066f78640 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:08.888615 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18b82ef6-a62d-47b2-924f-b57066f78640 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:08.891901 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18b82ef6-a62d-47b2-924f-b57066f78640 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:08.894971 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18b82ef6-a62d-47b2-924f-b57066f78640 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:08.898676 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18b82ef6-a62d-47b2-924f-b57066f78640 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:09.098911 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7d8d195d-e690-4ad2-a8b8-5d84675a0d67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "POST /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46/action" status: 200 len: 32 microversion: 2.1 time: 0.455244 Oct 15 03:40:09.104300 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 115/240] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 03:40:08 2021] POST /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46/action => generated 32 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 03:40:09.122322 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-67cee2b7-9f0e-4f5f-bd3b-611a17029778 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:09.125163 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-67cee2b7-9f0e-4f5f-bd3b-611a17029778 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:09.153978 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-67cee2b7-9f0e-4f5f-bd3b-611a17029778 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:09.155645 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-67cee2b7-9f0e-4f5f-bd3b-611a17029778 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:09.158404 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-67cee2b7-9f0e-4f5f-bd3b-611a17029778 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:09.159269 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-67cee2b7-9f0e-4f5f-bd3b-611a17029778 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:09.657889 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-18b82ef6-a62d-47b2-924f-b57066f78640 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:09.666635 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-18b82ef6-a62d-47b2-924f-b57066f78640 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1319 microversion: 2.1 time: 0.801208 Oct 15 03:40:09.679789 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 126/241] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:08 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1319 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:40:09.684921 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fdc401f3-35d9-4a44-a9d4-c550e1090277 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:09.694693 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fdc401f3-35d9-4a44-a9d4-c550e1090277 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:09.710046 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fdc401f3-35d9-4a44-a9d4-c550e1090277 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:09.710507 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fdc401f3-35d9-4a44-a9d4-c550e1090277 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:09.711307 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fdc401f3-35d9-4a44-a9d4-c550e1090277 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:09.715858 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fdc401f3-35d9-4a44-a9d4-c550e1090277 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:09.787076 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fdc401f3-35d9-4a44-a9d4-c550e1090277 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.105004 Oct 15 03:40:09.798472 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 127/242] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:40:09 2021] GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 03:40:09.803238 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-70c769a2-3116-4be4-a073-6af65317e22b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:09.803761 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-70c769a2-3116-4be4-a073-6af65317e22b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:09.824912 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70c769a2-3116-4be4-a073-6af65317e22b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:09.825562 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70c769a2-3116-4be4-a073-6af65317e22b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:09.827369 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70c769a2-3116-4be4-a073-6af65317e22b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:09.827755 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70c769a2-3116-4be4-a073-6af65317e22b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:10.068135 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-67cee2b7-9f0e-4f5f-bd3b-611a17029778 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:10.081248 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-67cee2b7-9f0e-4f5f-bd3b-611a17029778 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.972189 Oct 15 03:40:10.082717 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 116/243] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:09 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:40:10.099234 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a9390227-a87f-487d-9880-918aec36c36a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-145862374", "imageRef": "0ec12dbd-23ec-4d58-b215-4e3cd5f17594", "flavorRef": "452", "networks": [{"uuid": "beb50f10-7a82-4ec6-9454-85dffb8b4cbb"}]}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:40:10.172015 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-70c769a2-3116-4be4-a073-6af65317e22b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:10.184442 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-70c769a2-3116-4be4-a073-6af65317e22b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:10.190086 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-70c769a2-3116-4be4-a073-6af65317e22b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:10.191559 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-70c769a2-3116-4be4-a073-6af65317e22b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1722 microversion: 2.20 time: 0.392135 Oct 15 03:40:10.192564 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 128/244] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:09 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1722 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:10.230671 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.network.neutron [None req-a9390227-a87f-487d-9880-918aec36c36a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] validate_networks() for [('beb50f10-7a82-4ec6-9454-85dffb8b4cbb', None, None, None, None, None)] {{(pid=120897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 15 03:40:10.613022 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-340bc78f-312f-4270-9a84-235409f85adf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Action: 'create', calling method: .version_select at 0x7f4abd386700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-878614080"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:40:10.670339 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-340bc78f-312f-4270-9a84-235409f85adf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Getting quotas for project de088af04e804d909ae6daa141302d4c. Resources: {'key_pairs'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:40:10.683445 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-340bc78f-312f-4270-9a84-235409f85adf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Getting quotas for user d1bb22a3461a47e5afeb229038cb4a8d and project de088af04e804d909ae6daa141302d4c. Resources: {'key_pairs'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:40:10.888399 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-340bc78f-312f-4270-9a84-235409f85adf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Getting quotas for project de088af04e804d909ae6daa141302d4c. Resources: {'key_pairs'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:40:10.894749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-340bc78f-312f-4270-9a84-235409f85adf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Getting quotas for user d1bb22a3461a47e5afeb229038cb4a8d and project de088af04e804d909ae6daa141302d4c. Resources: {'key_pairs'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:40:10.933825 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-340bc78f-312f-4270-9a84-235409f85adf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.559592 Oct 15 03:40:10.939898 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 129/245] 10.222.0.30 () {60 vars in 1157 bytes} [Fri Oct 15 03:40:10 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:10.945461 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-60564d90-16ea-47b5-8853-d88339cd708c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:10.946846 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-60564d90-16ea-47b5-8853-d88339cd708c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:10.955378 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-60564d90-16ea-47b5-8853-d88339cd708c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:10.956118 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-60564d90-16ea-47b5-8853-d88339cd708c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:10.957266 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-60564d90-16ea-47b5-8853-d88339cd708c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:10.957866 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-60564d90-16ea-47b5-8853-d88339cd708c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:11.204369 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-60564d90-16ea-47b5-8853-d88339cd708c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:11.211075 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-60564d90-16ea-47b5-8853-d88339cd708c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1319 microversion: 2.1 time: 0.269814 Oct 15 03:40:11.220711 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 130/246] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:10 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:11.226371 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1bacddce-21a4-4a57-a880-6e20f7a2ac7a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:11.226987 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1bacddce-21a4-4a57-a880-6e20f7a2ac7a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:11.242534 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1bacddce-21a4-4a57-a880-6e20f7a2ac7a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:11.242988 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1bacddce-21a4-4a57-a880-6e20f7a2ac7a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:11.249399 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1bacddce-21a4-4a57-a880-6e20f7a2ac7a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:11.249849 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1bacddce-21a4-4a57-a880-6e20f7a2ac7a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:11.444419 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-a9390227-a87f-487d-9880-918aec36c36a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Flavor limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 03:40:11.445419 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-a9390227-a87f-487d-9880-918aec36c36a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Image limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 03:40:11.446092 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-a9390227-a87f-487d-9880-918aec36c36a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Flavor pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 03:40:11.447401 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-a9390227-a87f-487d-9880-918aec36c36a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Image pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 03:40:11.448150 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-a9390227-a87f-487d-9880-918aec36c36a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 03:40:11.483249 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a9390227-a87f-487d-9880-918aec36c36a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:11.485851 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a9390227-a87f-487d-9880-918aec36c36a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:11.489489 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a9390227-a87f-487d-9880-918aec36c36a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:11.494756 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a9390227-a87f-487d-9880-918aec36c36a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:11.504824 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-1bacddce-21a4-4a57-a880-6e20f7a2ac7a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:11.520607 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1bacddce-21a4-4a57-a880-6e20f7a2ac7a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.307351 Oct 15 03:40:11.532137 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 131/247] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:11 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:11.538221 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-be0b51da-cdee-420e-bbc7-c6e9d23a8eea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:11.539014 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-be0b51da-cdee-420e-bbc7-c6e9d23a8eea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:11.549233 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-be0b51da-cdee-420e-bbc7-c6e9d23a8eea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:11.549919 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-be0b51da-cdee-420e-bbc7-c6e9d23a8eea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:11.550890 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-be0b51da-cdee-420e-bbc7-c6e9d23a8eea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:11.551565 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-be0b51da-cdee-420e-bbc7-c6e9d23a8eea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:11.557141 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-a9390227-a87f-487d-9880-918aec36c36a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Getting quotas for project fca42958bf634cd8be46887a2580f4cc. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:40:11.572457 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-a9390227-a87f-487d-9880-918aec36c36a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Getting quotas for user f1f3db9250cc4edbacb392d5d0d18e08 and project fca42958bf634cd8be46887a2580f4cc. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:40:11.586973 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a9390227-a87f-487d-9880-918aec36c36a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Going to run 1 instances... {{(pid=120897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 15 03:40:11.591139 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a9390227-a87f-487d-9880-918aec36c36a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ec12dbd-23ec-4d58-b215-4e3cd5f17594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 15 03:40:11.664208 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a9390227-a87f-487d-9880-918aec36c36a tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.576409 Oct 15 03:40:11.666699 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 117/248] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Oct 15 03:40:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 03:40:11.685909 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-07fe4581-b0b9-422f-9957-a119551d154f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:11.687197 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-07fe4581-b0b9-422f-9957-a119551d154f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:11.829052 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-07fe4581-b0b9-422f-9957-a119551d154f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:11.837567 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-07fe4581-b0b9-422f-9957-a119551d154f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 200 len: 1217 microversion: 2.1 time: 0.159135 Oct 15 03:40:11.855138 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 118/249] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:11 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:12.045796 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-be0b51da-cdee-420e-bbc7-c6e9d23a8eea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:12.091000 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-be0b51da-cdee-420e-bbc7-c6e9d23a8eea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:12.101800 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-be0b51da-cdee-420e-bbc7-c6e9d23a8eea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:12.107636 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-be0b51da-cdee-420e-bbc7-c6e9d23a8eea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1722 microversion: 2.20 time: 0.569282 Oct 15 03:40:12.108444 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 132/250] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:11 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1722 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:12.228168 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d6b77b1f-1f53-4339-9785-1f3adbefa860 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:12.228877 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d6b77b1f-1f53-4339-9785-1f3adbefa860 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:12.235296 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6b77b1f-1f53-4339-9785-1f3adbefa860 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:12.235771 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6b77b1f-1f53-4339-9785-1f3adbefa860 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:12.246604 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6b77b1f-1f53-4339-9785-1f3adbefa860 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:12.251844 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6b77b1f-1f53-4339-9785-1f3adbefa860 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:12.538936 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ffbdc837-960f-4bcb-a189-23285399644b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:12.541808 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ffbdc837-960f-4bcb-a189-23285399644b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:12.551789 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ffbdc837-960f-4bcb-a189-23285399644b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:12.553473 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ffbdc837-960f-4bcb-a189-23285399644b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:12.556903 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ffbdc837-960f-4bcb-a189-23285399644b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:12.557614 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ffbdc837-960f-4bcb-a189-23285399644b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:12.613891 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d6b77b1f-1f53-4339-9785-1f3adbefa860 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:12.629410 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d6b77b1f-1f53-4339-9785-1f3adbefa860 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1319 microversion: 2.1 time: 0.402814 Oct 15 03:40:12.632101 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 119/251] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:12 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:12.861530 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f7e192cf-861a-4848-8f9d-5e413e406e29 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:12.862522 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f7e192cf-861a-4848-8f9d-5e413e406e29 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:12.875566 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f7e192cf-861a-4848-8f9d-5e413e406e29 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:12.876162 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f7e192cf-861a-4848-8f9d-5e413e406e29 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:12.878551 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f7e192cf-861a-4848-8f9d-5e413e406e29 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:12.881045 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f7e192cf-861a-4848-8f9d-5e413e406e29 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:13.247241 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f7e192cf-861a-4848-8f9d-5e413e406e29 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:13.277443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f7e192cf-861a-4848-8f9d-5e413e406e29 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 200 len: 1213 microversion: 2.1 time: 0.420808 Oct 15 03:40:13.291911 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 120/252] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:12 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 1213 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:13.314257 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c7933a0b-48ff-49bc-b088-1fa1a6964e6c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:13.314257 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c7933a0b-48ff-49bc-b088-1fa1a6964e6c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:13.330179 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c7933a0b-48ff-49bc-b088-1fa1a6964e6c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:13.330981 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c7933a0b-48ff-49bc-b088-1fa1a6964e6c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:13.332120 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c7933a0b-48ff-49bc-b088-1fa1a6964e6c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:13.334877 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c7933a0b-48ff-49bc-b088-1fa1a6964e6c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:13.700288 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ffbdc837-960f-4bcb-a189-23285399644b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:13.708868 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ffbdc837-960f-4bcb-a189-23285399644b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 1.175220 Oct 15 03:40:13.709331 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 133/253] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:12 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:13.718709 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6b627330-599e-4d4d-bf7c-596bdcc63076 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:13.719750 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6b627330-599e-4d4d-bf7c-596bdcc63076 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:13.748877 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b627330-599e-4d4d-bf7c-596bdcc63076 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:13.754825 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b627330-599e-4d4d-bf7c-596bdcc63076 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:13.755860 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b627330-599e-4d4d-bf7c-596bdcc63076 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:13.756993 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b627330-599e-4d4d-bf7c-596bdcc63076 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:14.278252 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c7933a0b-48ff-49bc-b088-1fa1a6964e6c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:14.288864 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c7933a0b-48ff-49bc-b088-1fa1a6964e6c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:14.303959 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c7933a0b-48ff-49bc-b088-1fa1a6964e6c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:14.306664 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c7933a0b-48ff-49bc-b088-1fa1a6964e6c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1722 microversion: 2.20 time: 1.013641 Oct 15 03:40:14.310454 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 121/254] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:13 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1722 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:14.329306 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0dd7bf78-fa28-4555-9b77-b3d115f72582 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:14.337597 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0dd7bf78-fa28-4555-9b77-b3d115f72582 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:14.344892 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0dd7bf78-fa28-4555-9b77-b3d115f72582 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:14.345673 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0dd7bf78-fa28-4555-9b77-b3d115f72582 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:14.346549 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0dd7bf78-fa28-4555-9b77-b3d115f72582 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:14.347084 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0dd7bf78-fa28-4555-9b77-b3d115f72582 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:14.465762 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0dd7bf78-fa28-4555-9b77-b3d115f72582 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:14.493245 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0dd7bf78-fa28-4555-9b77-b3d115f72582 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 200 len: 1275 microversion: 2.1 time: 0.167276 Oct 15 03:40:14.493821 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 122/255] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:14 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 1275 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:14.543833 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6b627330-599e-4d4d-bf7c-596bdcc63076 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:14.555952 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6b627330-599e-4d4d-bf7c-596bdcc63076 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1319 microversion: 2.1 time: 0.845308 Oct 15 03:40:14.557639 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 134/256] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:13 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1319 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:14.726200 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-edcd8d8a-6151-4bfc-a57b-999512f9de0c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:14.727160 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-edcd8d8a-6151-4bfc-a57b-999512f9de0c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:14.733137 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edcd8d8a-6151-4bfc-a57b-999512f9de0c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:14.733782 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edcd8d8a-6151-4bfc-a57b-999512f9de0c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:14.734811 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edcd8d8a-6151-4bfc-a57b-999512f9de0c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:14.735537 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edcd8d8a-6151-4bfc-a57b-999512f9de0c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:14.884190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-edcd8d8a-6151-4bfc-a57b-999512f9de0c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:14.892186 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-edcd8d8a-6151-4bfc-a57b-999512f9de0c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.169509 Oct 15 03:40:14.892748 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 123/257] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:14 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:15.327794 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-97fed595-22bb-4547-bff1-a2e4e6eebb50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:15.329628 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-97fed595-22bb-4547-bff1-a2e4e6eebb50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:15.338301 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-97fed595-22bb-4547-bff1-a2e4e6eebb50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:15.339506 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-97fed595-22bb-4547-bff1-a2e4e6eebb50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:15.340625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-97fed595-22bb-4547-bff1-a2e4e6eebb50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:15.342530 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-97fed595-22bb-4547-bff1-a2e4e6eebb50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:15.501988 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-97fed595-22bb-4547-bff1-a2e4e6eebb50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:15.513419 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-988e5ac9-bc7a-4779-9db2-f2dfb0be214c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:15.513871 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-97fed595-22bb-4547-bff1-a2e4e6eebb50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:15.514883 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-988e5ac9-bc7a-4779-9db2-f2dfb0be214c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:15.515364 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-97fed595-22bb-4547-bff1-a2e4e6eebb50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:15.516946 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-97fed595-22bb-4547-bff1-a2e4e6eebb50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1722 microversion: 2.20 time: 0.192728 Oct 15 03:40:15.528952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-988e5ac9-bc7a-4779-9db2-f2dfb0be214c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:15.528952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-988e5ac9-bc7a-4779-9db2-f2dfb0be214c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:15.528952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-988e5ac9-bc7a-4779-9db2-f2dfb0be214c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:15.528952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-988e5ac9-bc7a-4779-9db2-f2dfb0be214c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:15.545802 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 135/258] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:15 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:15.573717 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ceb205fb-3613-4134-a863-fc1fdfc9d91f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:15.574248 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ceb205fb-3613-4134-a863-fc1fdfc9d91f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:15.589215 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ceb205fb-3613-4134-a863-fc1fdfc9d91f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:15.590178 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ceb205fb-3613-4134-a863-fc1fdfc9d91f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:15.591886 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ceb205fb-3613-4134-a863-fc1fdfc9d91f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:15.593463 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ceb205fb-3613-4134-a863-fc1fdfc9d91f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:15.801620 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ceb205fb-3613-4134-a863-fc1fdfc9d91f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:15.811549 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ceb205fb-3613-4134-a863-fc1fdfc9d91f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1319 microversion: 2.1 time: 0.241984 Oct 15 03:40:15.812878 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 136/259] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:15 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:40:15.889072 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-988e5ac9-bc7a-4779-9db2-f2dfb0be214c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:15.899807 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-988e5ac9-bc7a-4779-9db2-f2dfb0be214c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 200 len: 1317 microversion: 2.1 time: 0.391835 Oct 15 03:40:15.900385 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 124/260] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:15 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:15.919330 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-25956208-1d02-4918-8e3c-a0f31df5e4ce tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:15.920126 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-25956208-1d02-4918-8e3c-a0f31df5e4ce tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:15.927624 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-25956208-1d02-4918-8e3c-a0f31df5e4ce tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:15.928166 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-25956208-1d02-4918-8e3c-a0f31df5e4ce tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:15.928947 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-25956208-1d02-4918-8e3c-a0f31df5e4ce tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:15.929828 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-25956208-1d02-4918-8e3c-a0f31df5e4ce tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:16.114712 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-25956208-1d02-4918-8e3c-a0f31df5e4ce tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:16.124977 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-25956208-1d02-4918-8e3c-a0f31df5e4ce tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.219281 Oct 15 03:40:16.125682 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 137/261] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:15 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:16.535322 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3751cf91-84b5-4aef-91d5-d2d3ebac4ee2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:16.535961 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3751cf91-84b5-4aef-91d5-d2d3ebac4ee2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:16.542186 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3751cf91-84b5-4aef-91d5-d2d3ebac4ee2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:16.542777 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3751cf91-84b5-4aef-91d5-d2d3ebac4ee2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:16.543852 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3751cf91-84b5-4aef-91d5-d2d3ebac4ee2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:16.544283 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3751cf91-84b5-4aef-91d5-d2d3ebac4ee2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:16.544661 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-9364b5f5-775c-4630-b8c9-83d0aa537016 req-6ed9f2ab-3b6c-4d9c-b953-7706d8be655f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e144d287-ed8a-4d89-9170-fd7a015fc126", "tag": "dee6750f-ed7d-48f9-a119-20f4369f477d"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:40:16.546435 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:40:16.546435 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 03:40:16.556431 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-9364b5f5-775c-4630-b8c9-83d0aa537016 req-6ed9f2ab-3b6c-4d9c-b953-7706d8be655f service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:16.556994 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-9364b5f5-775c-4630-b8c9-83d0aa537016 req-6ed9f2ab-3b6c-4d9c-b953-7706d8be655f service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:16.575123 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-9364b5f5-775c-4630-b8c9-83d0aa537016 req-6ed9f2ab-3b6c-4d9c-b953-7706d8be655f service nova] Creating event network-changed:dee6750f-ed7d-48f9-a119-20f4369f477d for instance e144d287-ed8a-4d89-9170-fd7a015fc126 on hv-cinder-81410 Oct 15 03:40:16.581660 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-9364b5f5-775c-4630-b8c9-83d0aa537016 req-6ed9f2ab-3b6c-4d9c-b953-7706d8be655f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039503 Oct 15 03:40:16.581660 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 138/262] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:40:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:40:16.731830 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3751cf91-84b5-4aef-91d5-d2d3ebac4ee2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:16.740771 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3751cf91-84b5-4aef-91d5-d2d3ebac4ee2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:16.742487 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3751cf91-84b5-4aef-91d5-d2d3ebac4ee2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:16.744331 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3751cf91-84b5-4aef-91d5-d2d3ebac4ee2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1722 microversion: 2.20 time: 0.212718 Oct 15 03:40:16.754099 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 125/263] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:16 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:16.830250 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-37adc6bf-7f49-4b51-aeb3-dc4f813260d7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:16.831323 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-37adc6bf-7f49-4b51-aeb3-dc4f813260d7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:16.840699 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-37adc6bf-7f49-4b51-aeb3-dc4f813260d7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:16.841312 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-37adc6bf-7f49-4b51-aeb3-dc4f813260d7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:16.842388 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-37adc6bf-7f49-4b51-aeb3-dc4f813260d7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:16.843033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-37adc6bf-7f49-4b51-aeb3-dc4f813260d7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:16.917480 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9e02e47e-556e-4674-bf62-b5be513ef7dd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:16.918712 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9e02e47e-556e-4674-bf62-b5be513ef7dd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:16.925536 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9e02e47e-556e-4674-bf62-b5be513ef7dd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:16.926751 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9e02e47e-556e-4674-bf62-b5be513ef7dd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:16.927821 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9e02e47e-556e-4674-bf62-b5be513ef7dd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:16.928405 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9e02e47e-556e-4674-bf62-b5be513ef7dd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:17.093903 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-37adc6bf-7f49-4b51-aeb3-dc4f813260d7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:17.119889 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-37adc6bf-7f49-4b51-aeb3-dc4f813260d7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1319 microversion: 2.1 time: 0.294509 Oct 15 03:40:17.122561 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 139/264] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:16 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:17.138139 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-d9b3b377-c74e-4934-a170-9c929d2ae1b1 req-27a856fa-fb00-4f20-8ea8-670d1856323b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828d646d-36c6-41b2-9e74-56a8ac3c1a73", "name": "network-vif-plugged", "status": "completed", "tag": "de7e38b1-f501-40e5-8e8e-f969ae95d240"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:40:17.140096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:40:17.140096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 03:40:17.147881 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-d9b3b377-c74e-4934-a170-9c929d2ae1b1 req-27a856fa-fb00-4f20-8ea8-670d1856323b service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:17.148595 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-d9b3b377-c74e-4934-a170-9c929d2ae1b1 req-27a856fa-fb00-4f20-8ea8-670d1856323b service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:17.163661 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-d9b3b377-c74e-4934-a170-9c929d2ae1b1 req-27a856fa-fb00-4f20-8ea8-670d1856323b service nova] Creating event network-vif-plugged:de7e38b1-f501-40e5-8e8e-f969ae95d240 for instance 828d646d-36c6-41b2-9e74-56a8ac3c1a73 on hv-cinder-81410 Oct 15 03:40:17.169302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-d9b3b377-c74e-4934-a170-9c929d2ae1b1 req-27a856fa-fb00-4f20-8ea8-670d1856323b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047070 Oct 15 03:40:17.170312 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 140/265] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:40:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:40:17.176708 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d3f47618-dbb9-4d27-836e-283291666e22 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:17.177653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d3f47618-dbb9-4d27-836e-283291666e22 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:17.178829 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9e02e47e-556e-4674-bf62-b5be513ef7dd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:17.184468 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3f47618-dbb9-4d27-836e-283291666e22 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:17.185208 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3f47618-dbb9-4d27-836e-283291666e22 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:17.186195 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3f47618-dbb9-4d27-836e-283291666e22 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:17.186911 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3f47618-dbb9-4d27-836e-283291666e22 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:17.189170 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9e02e47e-556e-4674-bf62-b5be513ef7dd tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 200 len: 1317 microversion: 2.1 time: 0.276291 Oct 15 03:40:17.190464 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 126/266] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:16 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:17.365395 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d3f47618-dbb9-4d27-836e-283291666e22 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:17.373299 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d3f47618-dbb9-4d27-836e-283291666e22 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.201788 Oct 15 03:40:17.374447 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 141/267] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:17 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:17.774012 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b25beb67-ff51-4a30-86ad-18a4fc78b176 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:17.775203 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b25beb67-ff51-4a30-86ad-18a4fc78b176 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:17.792125 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b25beb67-ff51-4a30-86ad-18a4fc78b176 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:17.793343 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b25beb67-ff51-4a30-86ad-18a4fc78b176 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:17.797279 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b25beb67-ff51-4a30-86ad-18a4fc78b176 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:17.798857 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b25beb67-ff51-4a30-86ad-18a4fc78b176 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:18.023934 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b25beb67-ff51-4a30-86ad-18a4fc78b176 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:18.032605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b25beb67-ff51-4a30-86ad-18a4fc78b176 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:18.035441 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b25beb67-ff51-4a30-86ad-18a4fc78b176 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:18.038240 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b25beb67-ff51-4a30-86ad-18a4fc78b176 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1722 microversion: 2.20 time: 0.269946 Oct 15 03:40:18.040500 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 127/268] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:17 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:18.136726 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a2dc8773-3230-4292-8d1f-95d15f6c88a7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:18.137523 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a2dc8773-3230-4292-8d1f-95d15f6c88a7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:18.144102 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a2dc8773-3230-4292-8d1f-95d15f6c88a7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:18.144773 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a2dc8773-3230-4292-8d1f-95d15f6c88a7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:18.146198 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a2dc8773-3230-4292-8d1f-95d15f6c88a7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:18.146935 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a2dc8773-3230-4292-8d1f-95d15f6c88a7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:18.206764 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d480910a-da35-44ad-bd4f-f325c4a2b2f0 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:18.207381 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d480910a-da35-44ad-bd4f-f325c4a2b2f0 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:18.214053 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d480910a-da35-44ad-bd4f-f325c4a2b2f0 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:18.214718 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d480910a-da35-44ad-bd4f-f325c4a2b2f0 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:18.215718 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d480910a-da35-44ad-bd4f-f325c4a2b2f0 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:18.216319 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d480910a-da35-44ad-bd4f-f325c4a2b2f0 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:18.421121 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d480910a-da35-44ad-bd4f-f325c4a2b2f0 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:18.423599 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-a2dc8773-3230-4292-8d1f-95d15f6c88a7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:18.431244 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d480910a-da35-44ad-bd4f-f325c4a2b2f0 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 200 len: 1317 microversion: 2.1 time: 0.227597 Oct 15 03:40:18.431638 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a2dc8773-3230-4292-8d1f-95d15f6c88a7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1319 microversion: 2.1 time: 0.298764 Oct 15 03:40:18.432261 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 128/269] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:18 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:40:18.433225 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 142/270] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:18 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:18.445591 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-27ba0778-0e91-428d-b056-008e714732ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:18.446988 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-27ba0778-0e91-428d-b056-008e714732ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:18.454141 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-27ba0778-0e91-428d-b056-008e714732ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:18.454794 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-27ba0778-0e91-428d-b056-008e714732ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:18.455660 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-27ba0778-0e91-428d-b056-008e714732ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:18.456210 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-27ba0778-0e91-428d-b056-008e714732ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:18.631270 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-27ba0778-0e91-428d-b056-008e714732ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:18.652628 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-27ba0778-0e91-428d-b056-008e714732ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.214321 Oct 15 03:40:18.653738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 129/271] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:18 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:19.060597 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ef5c1a38-65d7-42d9-b429-e4ed5fe6d7bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:19.061372 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ef5c1a38-65d7-42d9-b429-e4ed5fe6d7bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:19.076643 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ef5c1a38-65d7-42d9-b429-e4ed5fe6d7bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:19.079606 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ef5c1a38-65d7-42d9-b429-e4ed5fe6d7bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:19.085970 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ef5c1a38-65d7-42d9-b429-e4ed5fe6d7bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:19.086513 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ef5c1a38-65d7-42d9-b429-e4ed5fe6d7bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:19.349255 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ef5c1a38-65d7-42d9-b429-e4ed5fe6d7bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:19.364466 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ef5c1a38-65d7-42d9-b429-e4ed5fe6d7bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:19.368563 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ef5c1a38-65d7-42d9-b429-e4ed5fe6d7bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:19.372104 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ef5c1a38-65d7-42d9-b429-e4ed5fe6d7bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1722 microversion: 2.20 time: 0.318067 Oct 15 03:40:19.373831 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 143/272] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:19 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1722 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:19.450037 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-03997d11-696a-4dd9-8291-1fa6a5b83e15 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:19.450477 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-03997d11-696a-4dd9-8291-1fa6a5b83e15 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:19.454004 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7eb91f4c-a4a4-4db5-acd5-204d79755ebc tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:19.454976 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7eb91f4c-a4a4-4db5-acd5-204d79755ebc tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:19.460643 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-03997d11-696a-4dd9-8291-1fa6a5b83e15 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:19.461376 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-03997d11-696a-4dd9-8291-1fa6a5b83e15 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:19.463146 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7eb91f4c-a4a4-4db5-acd5-204d79755ebc tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:19.463613 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7eb91f4c-a4a4-4db5-acd5-204d79755ebc tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:19.464694 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7eb91f4c-a4a4-4db5-acd5-204d79755ebc tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:19.464962 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-03997d11-696a-4dd9-8291-1fa6a5b83e15 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:19.465135 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7eb91f4c-a4a4-4db5-acd5-204d79755ebc tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:19.465688 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-03997d11-696a-4dd9-8291-1fa6a5b83e15 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:19.756725 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-03997d11-696a-4dd9-8291-1fa6a5b83e15 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:19.763563 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-03997d11-696a-4dd9-8291-1fa6a5b83e15 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 200 len: 1317 microversion: 2.1 time: 0.317782 Oct 15 03:40:19.764169 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 130/273] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:19 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:19.765825 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7eb91f4c-a4a4-4db5-acd5-204d79755ebc tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:19.776972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-486a8e3f-0db5-4bd9-a150-9b9e2955e180 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:19.777578 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-486a8e3f-0db5-4bd9-a150-9b9e2955e180 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:19.780386 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7eb91f4c-a4a4-4db5-acd5-204d79755ebc tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1507 microversion: 2.1 time: 0.332591 Oct 15 03:40:19.781042 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 144/274] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:19 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1507 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:19.804490 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-486a8e3f-0db5-4bd9-a150-9b9e2955e180 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:19.812099 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-486a8e3f-0db5-4bd9-a150-9b9e2955e180 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:19.813275 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-486a8e3f-0db5-4bd9-a150-9b9e2955e180 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:19.814054 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-486a8e3f-0db5-4bd9-a150-9b9e2955e180 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:20.064615 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-486a8e3f-0db5-4bd9-a150-9b9e2955e180 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:20.073414 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-486a8e3f-0db5-4bd9-a150-9b9e2955e180 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.308192 Oct 15 03:40:20.073924 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 131/275] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:19 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:20.397198 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3cefd635-b024-4271-83c1-53dd1182e39d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:20.400562 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3cefd635-b024-4271-83c1-53dd1182e39d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:20.413568 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3cefd635-b024-4271-83c1-53dd1182e39d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:20.416642 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3cefd635-b024-4271-83c1-53dd1182e39d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:20.417671 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3cefd635-b024-4271-83c1-53dd1182e39d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:20.420468 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3cefd635-b024-4271-83c1-53dd1182e39d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:20.794076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-eef12074-9887-4d3b-964c-4f6722e7bde6 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:20.794702 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-eef12074-9887-4d3b-964c-4f6722e7bde6 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:20.812110 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eef12074-9887-4d3b-964c-4f6722e7bde6 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:20.817094 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eef12074-9887-4d3b-964c-4f6722e7bde6 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:20.819825 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eef12074-9887-4d3b-964c-4f6722e7bde6 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:20.821063 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eef12074-9887-4d3b-964c-4f6722e7bde6 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:20.822392 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3cefd635-b024-4271-83c1-53dd1182e39d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:20.839863 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3cefd635-b024-4271-83c1-53dd1182e39d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:20.843638 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3cefd635-b024-4271-83c1-53dd1182e39d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:20.849602 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3cefd635-b024-4271-83c1-53dd1182e39d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1743 microversion: 2.20 time: 0.461327 Oct 15 03:40:20.862005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 145/276] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:20 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1743 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:21.090294 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-355b41a5-bf3c-4fb9-8421-7af50d1d1af5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:21.091168 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-355b41a5-bf3c-4fb9-8421-7af50d1d1af5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:21.091971 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-eef12074-9887-4d3b-964c-4f6722e7bde6 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:21.101282 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-355b41a5-bf3c-4fb9-8421-7af50d1d1af5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:21.101744 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-355b41a5-bf3c-4fb9-8421-7af50d1d1af5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:21.101890 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-eef12074-9887-4d3b-964c-4f6722e7bde6 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 200 len: 1317 microversion: 2.1 time: 0.310210 Oct 15 03:40:21.103074 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-355b41a5-bf3c-4fb9-8421-7af50d1d1af5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:21.111760 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 132/277] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:20 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:21.116435 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-355b41a5-bf3c-4fb9-8421-7af50d1d1af5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:21.319815 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-355b41a5-bf3c-4fb9-8421-7af50d1d1af5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:21.330995 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-355b41a5-bf3c-4fb9-8421-7af50d1d1af5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.244048 Oct 15 03:40:21.332236 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 146/278] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:21 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:21.863076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-30454524-95df-4f67-ab36-8940296bba2c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Action: 'create', calling method: .version_select at 0x7f4abcbc1d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1243066600"}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:40:21.869322 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5c1bcfcd-a1bb-4759-a328-2d474fb7f1b8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:21.870037 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5c1bcfcd-a1bb-4759-a328-2d474fb7f1b8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:21.883070 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c1bcfcd-a1bb-4759-a328-2d474fb7f1b8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:21.883585 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c1bcfcd-a1bb-4759-a328-2d474fb7f1b8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:21.887802 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c1bcfcd-a1bb-4759-a328-2d474fb7f1b8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:21.888250 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c1bcfcd-a1bb-4759-a328-2d474fb7f1b8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:21.897964 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-30454524-95df-4f67-ab36-8940296bba2c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Getting quotas for project 2e70b7afa65b45d19294e3a06917a51d. Resources: {'key_pairs'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:40:21.902972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-30454524-95df-4f67-ab36-8940296bba2c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Getting quotas for user 8eb29072473e4c198148b0059eb1bc3e and project 2e70b7afa65b45d19294e3a06917a51d. Resources: {'key_pairs'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:40:21.998085 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-30454524-95df-4f67-ab36-8940296bba2c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Getting quotas for project 2e70b7afa65b45d19294e3a06917a51d. Resources: {'key_pairs'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:40:22.002119 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-30454524-95df-4f67-ab36-8940296bba2c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Getting quotas for user 8eb29072473e4c198148b0059eb1bc3e and project 2e70b7afa65b45d19294e3a06917a51d. Resources: {'key_pairs'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:40:22.032653 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-30454524-95df-4f67-ab36-8940296bba2c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.331993 Oct 15 03:40:22.033526 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 133/279] 10.222.0.30 () {60 vars in 1157 bytes} [Fri Oct 15 03:40:21 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:22.036153 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5c1bcfcd-a1bb-4759-a328-2d474fb7f1b8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:22.045649 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5c1bcfcd-a1bb-4759-a328-2d474fb7f1b8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:22.047153 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5c1bcfcd-a1bb-4759-a328-2d474fb7f1b8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:22.048655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5c1bcfcd-a1bb-4759-a328-2d474fb7f1b8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1743 microversion: 2.20 time: 0.183677 Oct 15 03:40:22.049211 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 147/280] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:21 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1743 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:40:22.118736 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-94abf591-7e19-4507-b6e1-da1e7be27824 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:22.119352 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-94abf591-7e19-4507-b6e1-da1e7be27824 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:22.130627 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-94abf591-7e19-4507-b6e1-da1e7be27824 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:22.131081 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-94abf591-7e19-4507-b6e1-da1e7be27824 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:22.131965 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-94abf591-7e19-4507-b6e1-da1e7be27824 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:22.132404 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-94abf591-7e19-4507-b6e1-da1e7be27824 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:22.297207 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-94abf591-7e19-4507-b6e1-da1e7be27824 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:22.305512 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-94abf591-7e19-4507-b6e1-da1e7be27824 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 200 len: 1317 microversion: 2.1 time: 0.190760 Oct 15 03:40:22.306068 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 134/281] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:22 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:22.349093 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-225bb0e1-c432-4ddf-9d5d-2494749a5721 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:22.357580 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-225bb0e1-c432-4ddf-9d5d-2494749a5721 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:22.374181 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-225bb0e1-c432-4ddf-9d5d-2494749a5721 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:22.374626 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-225bb0e1-c432-4ddf-9d5d-2494749a5721 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:22.375440 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-225bb0e1-c432-4ddf-9d5d-2494749a5721 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:22.375896 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-225bb0e1-c432-4ddf-9d5d-2494749a5721 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:22.503123 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-225bb0e1-c432-4ddf-9d5d-2494749a5721 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:22.511755 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-225bb0e1-c432-4ddf-9d5d-2494749a5721 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.166955 Oct 15 03:40:22.512701 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 148/282] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:22 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:23.066181 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5c143978-ad8b-408c-b29a-33d33fc5e1ad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:23.066859 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5c143978-ad8b-408c-b29a-33d33fc5e1ad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:23.073214 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c143978-ad8b-408c-b29a-33d33fc5e1ad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:23.073834 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c143978-ad8b-408c-b29a-33d33fc5e1ad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:23.074689 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c143978-ad8b-408c-b29a-33d33fc5e1ad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:23.075189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c143978-ad8b-408c-b29a-33d33fc5e1ad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:23.199388 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5c143978-ad8b-408c-b29a-33d33fc5e1ad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:23.208256 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5c143978-ad8b-408c-b29a-33d33fc5e1ad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:23.209780 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5c143978-ad8b-408c-b29a-33d33fc5e1ad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:23.211014 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5c143978-ad8b-408c-b29a-33d33fc5e1ad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1743 microversion: 2.20 time: 0.148774 Oct 15 03:40:23.211557 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 135/283] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:23 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1743 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:23.323040 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-38197f62-276c-4cc9-8d38-5e09aca05cc4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:23.323645 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-38197f62-276c-4cc9-8d38-5e09aca05cc4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:23.329274 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-38197f62-276c-4cc9-8d38-5e09aca05cc4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:23.329722 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-38197f62-276c-4cc9-8d38-5e09aca05cc4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:23.330483 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-38197f62-276c-4cc9-8d38-5e09aca05cc4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:23.330915 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-38197f62-276c-4cc9-8d38-5e09aca05cc4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:23.452441 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-38197f62-276c-4cc9-8d38-5e09aca05cc4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:23.459510 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-38197f62-276c-4cc9-8d38-5e09aca05cc4 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 200 len: 1317 microversion: 2.1 time: 0.140895 Oct 15 03:40:23.460111 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 149/284] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:23 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:23.528318 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0a4a1971-25ec-49a3-8d01-539ebcb4a369 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:23.528925 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0a4a1971-25ec-49a3-8d01-539ebcb4a369 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:23.535738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0a4a1971-25ec-49a3-8d01-539ebcb4a369 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:23.536301 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0a4a1971-25ec-49a3-8d01-539ebcb4a369 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:23.537291 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0a4a1971-25ec-49a3-8d01-539ebcb4a369 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:23.537827 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0a4a1971-25ec-49a3-8d01-539ebcb4a369 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:23.668696 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0a4a1971-25ec-49a3-8d01-539ebcb4a369 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:23.675752 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0a4a1971-25ec-49a3-8d01-539ebcb4a369 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.151078 Oct 15 03:40:23.676301 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 136/285] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:23 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:24.231150 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d50d34be-ba78-4439-96ed-965f4ecbb6d0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:24.231795 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d50d34be-ba78-4439-96ed-965f4ecbb6d0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:24.238133 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d50d34be-ba78-4439-96ed-965f4ecbb6d0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:24.238785 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d50d34be-ba78-4439-96ed-965f4ecbb6d0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:24.239770 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d50d34be-ba78-4439-96ed-965f4ecbb6d0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:24.240215 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d50d34be-ba78-4439-96ed-965f4ecbb6d0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:24.369659 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d50d34be-ba78-4439-96ed-965f4ecbb6d0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:24.377477 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d50d34be-ba78-4439-96ed-965f4ecbb6d0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:24.378987 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d50d34be-ba78-4439-96ed-965f4ecbb6d0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:24.380186 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d50d34be-ba78-4439-96ed-965f4ecbb6d0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.153831 Oct 15 03:40:24.380767 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 150/286] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:24 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:24.476489 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-526d7779-2468-417a-833f-94024327b1c2 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:24.477685 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-526d7779-2468-417a-833f-94024327b1c2 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:24.483554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-526d7779-2468-417a-833f-94024327b1c2 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:24.484199 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-526d7779-2468-417a-833f-94024327b1c2 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:24.484833 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-526d7779-2468-417a-833f-94024327b1c2 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:24.485281 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-526d7779-2468-417a-833f-94024327b1c2 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:24.621097 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-526d7779-2468-417a-833f-94024327b1c2 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:24.628432 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-526d7779-2468-417a-833f-94024327b1c2 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 200 len: 1317 microversion: 2.1 time: 0.155655 Oct 15 03:40:24.628993 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 137/287] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:24 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:24.693040 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-cfd25df0-e43f-4a82-be02-d57c16b9aa8f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:24.693745 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-cfd25df0-e43f-4a82-be02-d57c16b9aa8f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:24.699603 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cfd25df0-e43f-4a82-be02-d57c16b9aa8f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:24.700159 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cfd25df0-e43f-4a82-be02-d57c16b9aa8f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:24.700922 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cfd25df0-e43f-4a82-be02-d57c16b9aa8f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:24.701351 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cfd25df0-e43f-4a82-be02-d57c16b9aa8f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:24.827281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-cfd25df0-e43f-4a82-be02-d57c16b9aa8f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:24.838461 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-cfd25df0-e43f-4a82-be02-d57c16b9aa8f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.148732 Oct 15 03:40:24.839307 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 151/288] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:24 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:25.340295 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-bea2ffef-8abf-4fd4-bc26-77d7b8908042 req-73a34a04-2990-4917-a925-ace715d490fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e144d287-ed8a-4d89-9170-fd7a015fc126", "name": "network-vif-plugged", "status": "completed", "tag": "dee6750f-ed7d-48f9-a119-20f4369f477d"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:40:25.341872 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:40:25.341872 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:40:25.348997 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-bea2ffef-8abf-4fd4-bc26-77d7b8908042 req-73a34a04-2990-4917-a925-ace715d490fc service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:25.349735 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-bea2ffef-8abf-4fd4-bc26-77d7b8908042 req-73a34a04-2990-4917-a925-ace715d490fc service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:25.360632 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-bea2ffef-8abf-4fd4-bc26-77d7b8908042 req-73a34a04-2990-4917-a925-ace715d490fc service nova] Creating event network-vif-plugged:dee6750f-ed7d-48f9-a119-20f4369f477d for instance e144d287-ed8a-4d89-9170-fd7a015fc126 on hv-cinder-81410 Oct 15 03:40:25.367040 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-bea2ffef-8abf-4fd4-bc26-77d7b8908042 req-73a34a04-2990-4917-a925-ace715d490fc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031212 Oct 15 03:40:25.367940 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 138/289] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:40:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:40:25.398981 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-eb7295ad-c14e-4a96-bf64-1ffc6ff1eb4e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:25.400310 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-eb7295ad-c14e-4a96-bf64-1ffc6ff1eb4e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:25.406624 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eb7295ad-c14e-4a96-bf64-1ffc6ff1eb4e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:25.407072 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eb7295ad-c14e-4a96-bf64-1ffc6ff1eb4e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:25.407875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eb7295ad-c14e-4a96-bf64-1ffc6ff1eb4e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:25.408308 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eb7295ad-c14e-4a96-bf64-1ffc6ff1eb4e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:25.570800 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-eb7295ad-c14e-4a96-bf64-1ffc6ff1eb4e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:25.581599 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-eb7295ad-c14e-4a96-bf64-1ffc6ff1eb4e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:25.583084 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-eb7295ad-c14e-4a96-bf64-1ffc6ff1eb4e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:25.584346 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-eb7295ad-c14e-4a96-bf64-1ffc6ff1eb4e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.189898 Oct 15 03:40:25.585193 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 152/290] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:25 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:25.645817 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c52c3e15-862d-4180-a5ca-55ee0d9cfb0e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:25.646521 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c52c3e15-862d-4180-a5ca-55ee0d9cfb0e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:25.653426 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c52c3e15-862d-4180-a5ca-55ee0d9cfb0e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:25.653878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c52c3e15-862d-4180-a5ca-55ee0d9cfb0e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:25.654660 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c52c3e15-862d-4180-a5ca-55ee0d9cfb0e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:25.655094 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c52c3e15-862d-4180-a5ca-55ee0d9cfb0e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:25.785915 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c52c3e15-862d-4180-a5ca-55ee0d9cfb0e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:25.793795 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c52c3e15-862d-4180-a5ca-55ee0d9cfb0e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 200 len: 1317 microversion: 2.1 time: 0.152050 Oct 15 03:40:25.794364 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 139/291] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:25 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:40:25.855367 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-233e00de-13f5-40b7-8a99-1e4d7ba33762 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:25.856377 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-233e00de-13f5-40b7-8a99-1e4d7ba33762 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:25.862413 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-233e00de-13f5-40b7-8a99-1e4d7ba33762 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:25.862856 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-233e00de-13f5-40b7-8a99-1e4d7ba33762 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:25.863906 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-233e00de-13f5-40b7-8a99-1e4d7ba33762 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:25.864533 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-233e00de-13f5-40b7-8a99-1e4d7ba33762 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:26.057384 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-233e00de-13f5-40b7-8a99-1e4d7ba33762 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:26.066708 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-233e00de-13f5-40b7-8a99-1e4d7ba33762 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.214094 Oct 15 03:40:26.076792 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 153/292] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:25 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:26.621038 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-07206d82-5650-4f12-8181-d2df98a66ddb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:26.622048 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-07206d82-5650-4f12-8181-d2df98a66ddb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:26.637602 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-07206d82-5650-4f12-8181-d2df98a66ddb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:26.638147 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-07206d82-5650-4f12-8181-d2df98a66ddb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:26.639074 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-07206d82-5650-4f12-8181-d2df98a66ddb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:26.639583 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-07206d82-5650-4f12-8181-d2df98a66ddb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:26.773440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-07206d82-5650-4f12-8181-d2df98a66ddb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:26.784508 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-07206d82-5650-4f12-8181-d2df98a66ddb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:26.787636 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-07206d82-5650-4f12-8181-d2df98a66ddb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:26.789166 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-07206d82-5650-4f12-8181-d2df98a66ddb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.188821 Oct 15 03:40:26.790407 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 140/293] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:26 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:26.814105 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5cdbd637-b825-4570-8c5e-f366254f3b9f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:26.814714 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5cdbd637-b825-4570-8c5e-f366254f3b9f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:26.820749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5cdbd637-b825-4570-8c5e-f366254f3b9f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:26.821291 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5cdbd637-b825-4570-8c5e-f366254f3b9f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:26.822130 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5cdbd637-b825-4570-8c5e-f366254f3b9f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:26.822627 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5cdbd637-b825-4570-8c5e-f366254f3b9f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:26.955397 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5cdbd637-b825-4570-8c5e-f366254f3b9f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:26.963292 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5cdbd637-b825-4570-8c5e-f366254f3b9f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 200 len: 1317 microversion: 2.1 time: 0.152891 Oct 15 03:40:26.964142 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 154/294] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:26 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:27.083822 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-716eb63f-d5ba-455e-a2be-8051db93f658 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:27.084437 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-716eb63f-d5ba-455e-a2be-8051db93f658 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:27.090448 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-716eb63f-d5ba-455e-a2be-8051db93f658 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:27.090896 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-716eb63f-d5ba-455e-a2be-8051db93f658 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:27.091661 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-716eb63f-d5ba-455e-a2be-8051db93f658 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:27.092127 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-716eb63f-d5ba-455e-a2be-8051db93f658 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:27.209778 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-716eb63f-d5ba-455e-a2be-8051db93f658 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:27.217144 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-716eb63f-d5ba-455e-a2be-8051db93f658 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.136912 Oct 15 03:40:27.217714 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 141/295] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:27 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:27.417028 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-a5b9fca6-6490-4f7a-b0a1-4d33d79454c8 req-29ca7492-0eb2-4a36-8d43-f645c72addb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3594fddd-dbb7-4731-8f30-b3512198e1a9", "name": "network-vif-plugged", "status": "completed", "tag": "0ebbb249-fedc-46b3-94a7-8e70531c6d22"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:40:27.418701 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:40:27.418701 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 03:40:27.426095 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-a5b9fca6-6490-4f7a-b0a1-4d33d79454c8 req-29ca7492-0eb2-4a36-8d43-f645c72addb3 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:27.426797 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-a5b9fca6-6490-4f7a-b0a1-4d33d79454c8 req-29ca7492-0eb2-4a36-8d43-f645c72addb3 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:27.438730 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-a5b9fca6-6490-4f7a-b0a1-4d33d79454c8 req-29ca7492-0eb2-4a36-8d43-f645c72addb3 service nova] Creating event network-vif-plugged:0ebbb249-fedc-46b3-94a7-8e70531c6d22 for instance 3594fddd-dbb7-4731-8f30-b3512198e1a9 on hv-cinder-81410 Oct 15 03:40:27.443731 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-a5b9fca6-6490-4f7a-b0a1-4d33d79454c8 req-29ca7492-0eb2-4a36-8d43-f645c72addb3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030279 Oct 15 03:40:27.444334 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 155/296] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:40:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:40:27.807653 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ac3b695a-6fae-4769-a2ec-7ee7cf933f4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:27.808272 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ac3b695a-6fae-4769-a2ec-7ee7cf933f4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:27.814057 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ac3b695a-6fae-4769-a2ec-7ee7cf933f4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:27.814493 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ac3b695a-6fae-4769-a2ec-7ee7cf933f4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:27.815268 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ac3b695a-6fae-4769-a2ec-7ee7cf933f4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:27.815714 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ac3b695a-6fae-4769-a2ec-7ee7cf933f4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:27.935260 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ac3b695a-6fae-4769-a2ec-7ee7cf933f4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:27.942798 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ac3b695a-6fae-4769-a2ec-7ee7cf933f4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:27.944374 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ac3b695a-6fae-4769-a2ec-7ee7cf933f4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:27.945529 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ac3b695a-6fae-4769-a2ec-7ee7cf933f4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.141653 Oct 15 03:40:27.946580 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 142/297] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:27 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:27.981924 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-31e81c06-a97d-4e62-ba94-a44ba049b49f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:27.982653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-31e81c06-a97d-4e62-ba94-a44ba049b49f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:27.988677 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-31e81c06-a97d-4e62-ba94-a44ba049b49f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:27.989124 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-31e81c06-a97d-4e62-ba94-a44ba049b49f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:27.989884 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-31e81c06-a97d-4e62-ba94-a44ba049b49f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:27.990326 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-31e81c06-a97d-4e62-ba94-a44ba049b49f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:28.143067 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-31e81c06-a97d-4e62-ba94-a44ba049b49f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:28.150896 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-31e81c06-a97d-4e62-ba94-a44ba049b49f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 200 len: 1508 microversion: 2.1 time: 0.172922 Oct 15 03:40:28.151395 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 156/298] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:27 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:28.239791 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-378cdbd6-3c1f-4981-bffb-663b62ad86a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:28.240416 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-378cdbd6-3c1f-4981-bffb-663b62ad86a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:28.246831 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-378cdbd6-3c1f-4981-bffb-663b62ad86a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:28.247334 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-378cdbd6-3c1f-4981-bffb-663b62ad86a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:28.248148 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-378cdbd6-3c1f-4981-bffb-663b62ad86a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:28.248585 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-378cdbd6-3c1f-4981-bffb-663b62ad86a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:28.381679 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-378cdbd6-3c1f-4981-bffb-663b62ad86a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:28.391380 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-378cdbd6-3c1f-4981-bffb-663b62ad86a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.160705 Oct 15 03:40:28.392842 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 143/299] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:28 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:28.964476 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d45dbe8b-55e7-4887-b0dd-57bb03337205 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:28.965026 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d45dbe8b-55e7-4887-b0dd-57bb03337205 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:28.971129 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d45dbe8b-55e7-4887-b0dd-57bb03337205 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:28.971574 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d45dbe8b-55e7-4887-b0dd-57bb03337205 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:28.972362 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d45dbe8b-55e7-4887-b0dd-57bb03337205 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:28.972791 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d45dbe8b-55e7-4887-b0dd-57bb03337205 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:29.095182 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d45dbe8b-55e7-4887-b0dd-57bb03337205 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:29.102838 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d45dbe8b-55e7-4887-b0dd-57bb03337205 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:29.104370 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d45dbe8b-55e7-4887-b0dd-57bb03337205 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:29.105714 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d45dbe8b-55e7-4887-b0dd-57bb03337205 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.145499 Oct 15 03:40:29.106265 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 157/300] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:28 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:29.407805 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-34f2aee3-a1bc-49fa-bbad-cfa7813bc9d5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:29.408435 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-34f2aee3-a1bc-49fa-bbad-cfa7813bc9d5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:29.414210 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-34f2aee3-a1bc-49fa-bbad-cfa7813bc9d5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:29.414657 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-34f2aee3-a1bc-49fa-bbad-cfa7813bc9d5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:29.415411 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-34f2aee3-a1bc-49fa-bbad-cfa7813bc9d5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:29.415878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-34f2aee3-a1bc-49fa-bbad-cfa7813bc9d5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:29.468444 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-70025be2-25c7-4049-bae4-ebfb80554694 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4fed45a-8bd7-4fd3-bd6c-8cd5aa3d8ef0"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:40:29.469529 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-70025be2-25c7-4049-bae4-ebfb80554694 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:29.475485 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70025be2-25c7-4049-bae4-ebfb80554694 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:29.476039 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70025be2-25c7-4049-bae4-ebfb80554694 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:29.476906 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70025be2-25c7-4049-bae4-ebfb80554694 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:29.477351 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70025be2-25c7-4049-bae4-ebfb80554694 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:29.537834 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-34f2aee3-a1bc-49fa-bbad-cfa7813bc9d5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:29.545629 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-34f2aee3-a1bc-49fa-bbad-cfa7813bc9d5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.141495 Oct 15 03:40:29.546218 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 144/301] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:29 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:29.723624 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-70025be2-25c7-4049-bae4-ebfb80554694 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "POST /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258740 Oct 15 03:40:29.724564 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 158/302] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Oct 15 03:40:29 2021] POST /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:40:30.123777 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-364b0e9d-3d67-453c-9780-eb28f47687f4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:30.124410 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-364b0e9d-3d67-453c-9780-eb28f47687f4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:30.130143 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-364b0e9d-3d67-453c-9780-eb28f47687f4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:30.130644 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-364b0e9d-3d67-453c-9780-eb28f47687f4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:30.131443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-364b0e9d-3d67-453c-9780-eb28f47687f4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:30.131905 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-364b0e9d-3d67-453c-9780-eb28f47687f4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:30.252500 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-364b0e9d-3d67-453c-9780-eb28f47687f4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:30.260639 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-364b0e9d-3d67-453c-9780-eb28f47687f4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:30.262152 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-364b0e9d-3d67-453c-9780-eb28f47687f4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:30.263297 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-364b0e9d-3d67-453c-9780-eb28f47687f4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.143344 Oct 15 03:40:30.263882 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 145/303] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:30 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:30.562931 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-668e5eed-30eb-432d-8e0a-bb277067fb31 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:30.563558 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-668e5eed-30eb-432d-8e0a-bb277067fb31 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:30.569766 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-668e5eed-30eb-432d-8e0a-bb277067fb31 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:30.570213 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-668e5eed-30eb-432d-8e0a-bb277067fb31 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:30.570976 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-668e5eed-30eb-432d-8e0a-bb277067fb31 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:30.571408 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-668e5eed-30eb-432d-8e0a-bb277067fb31 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:30.696416 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-668e5eed-30eb-432d-8e0a-bb277067fb31 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:30.703671 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-668e5eed-30eb-432d-8e0a-bb277067fb31 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.144965 Oct 15 03:40:30.704258 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 159/304] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:30 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:31.281429 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7582414a-7afe-45e0-a868-20b2e3f4b505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:31.282019 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7582414a-7afe-45e0-a868-20b2e3f4b505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:31.287825 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7582414a-7afe-45e0-a868-20b2e3f4b505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:31.288280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7582414a-7afe-45e0-a868-20b2e3f4b505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:31.289037 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7582414a-7afe-45e0-a868-20b2e3f4b505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:31.289471 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7582414a-7afe-45e0-a868-20b2e3f4b505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:31.415074 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7582414a-7afe-45e0-a868-20b2e3f4b505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:31.422605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7582414a-7afe-45e0-a868-20b2e3f4b505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:31.424111 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7582414a-7afe-45e0-a868-20b2e3f4b505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:31.425237 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7582414a-7afe-45e0-a868-20b2e3f4b505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.147553 Oct 15 03:40:31.425773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 146/305] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:31 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:31.721087 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-12473011-cc85-4116-b187-ed14fa8ad5e7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:31.721622 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-12473011-cc85-4116-b187-ed14fa8ad5e7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:31.727341 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-12473011-cc85-4116-b187-ed14fa8ad5e7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:31.727811 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-12473011-cc85-4116-b187-ed14fa8ad5e7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:31.728565 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-12473011-cc85-4116-b187-ed14fa8ad5e7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:31.728990 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-12473011-cc85-4116-b187-ed14fa8ad5e7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:31.849209 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-12473011-cc85-4116-b187-ed14fa8ad5e7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:31.856571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-12473011-cc85-4116-b187-ed14fa8ad5e7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.139282 Oct 15 03:40:31.857137 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 160/306] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:31 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:32.443576 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d1616125-0850-4a2d-b4f5-d2332550c452 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:32.444239 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d1616125-0850-4a2d-b4f5-d2332550c452 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:32.450439 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1616125-0850-4a2d-b4f5-d2332550c452 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:32.450883 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1616125-0850-4a2d-b4f5-d2332550c452 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:32.451638 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1616125-0850-4a2d-b4f5-d2332550c452 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:32.452241 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1616125-0850-4a2d-b4f5-d2332550c452 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:32.568576 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d1616125-0850-4a2d-b4f5-d2332550c452 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:32.576642 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d1616125-0850-4a2d-b4f5-d2332550c452 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:32.578146 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d1616125-0850-4a2d-b4f5-d2332550c452 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:32.579284 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d1616125-0850-4a2d-b4f5-d2332550c452 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.139341 Oct 15 03:40:32.580054 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 147/307] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:32 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:32.873674 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-812c5299-4b89-40a4-94b5-0a70a8bbe8da tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:32.874277 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-812c5299-4b89-40a4-94b5-0a70a8bbe8da tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:32.880708 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-812c5299-4b89-40a4-94b5-0a70a8bbe8da tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:32.881163 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-812c5299-4b89-40a4-94b5-0a70a8bbe8da tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:32.881966 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-812c5299-4b89-40a4-94b5-0a70a8bbe8da tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:32.882405 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-812c5299-4b89-40a4-94b5-0a70a8bbe8da tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:33.003804 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-812c5299-4b89-40a4-94b5-0a70a8bbe8da tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:33.011438 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-812c5299-4b89-40a4-94b5-0a70a8bbe8da tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.141309 Oct 15 03:40:33.012071 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 161/308] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:32 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:33.597659 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d8d09f14-0a62-4e9c-bd02-8ebeb8d6a466 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:33.598260 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d8d09f14-0a62-4e9c-bd02-8ebeb8d6a466 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:33.603945 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d8d09f14-0a62-4e9c-bd02-8ebeb8d6a466 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:33.604389 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d8d09f14-0a62-4e9c-bd02-8ebeb8d6a466 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:33.605140 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d8d09f14-0a62-4e9c-bd02-8ebeb8d6a466 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:33.605568 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d8d09f14-0a62-4e9c-bd02-8ebeb8d6a466 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:33.726743 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d8d09f14-0a62-4e9c-bd02-8ebeb8d6a466 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:33.734226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d8d09f14-0a62-4e9c-bd02-8ebeb8d6a466 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:33.735724 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d8d09f14-0a62-4e9c-bd02-8ebeb8d6a466 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:33.736853 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d8d09f14-0a62-4e9c-bd02-8ebeb8d6a466 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.143068 Oct 15 03:40:33.737396 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 148/309] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:33 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:34.028063 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c7d508f1-89c3-4733-a2e9-975cb12c2c0c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:34.028703 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c7d508f1-89c3-4733-a2e9-975cb12c2c0c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:34.034532 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c7d508f1-89c3-4733-a2e9-975cb12c2c0c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:34.034981 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c7d508f1-89c3-4733-a2e9-975cb12c2c0c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:34.035769 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c7d508f1-89c3-4733-a2e9-975cb12c2c0c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:34.036208 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c7d508f1-89c3-4733-a2e9-975cb12c2c0c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:34.157694 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c7d508f1-89c3-4733-a2e9-975cb12c2c0c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:34.168060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c7d508f1-89c3-4733-a2e9-975cb12c2c0c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.143497 Oct 15 03:40:34.168641 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 162/310] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:34 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:34.758610 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-dfcabb3c-dfaf-4c39-bcc7-39889189e838 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:34.759150 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-dfcabb3c-dfaf-4c39-bcc7-39889189e838 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:34.764955 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfcabb3c-dfaf-4c39-bcc7-39889189e838 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:34.765440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfcabb3c-dfaf-4c39-bcc7-39889189e838 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:34.766170 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfcabb3c-dfaf-4c39-bcc7-39889189e838 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:34.766621 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfcabb3c-dfaf-4c39-bcc7-39889189e838 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:34.894751 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-dfcabb3c-dfaf-4c39-bcc7-39889189e838 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:34.903458 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-dfcabb3c-dfaf-4c39-bcc7-39889189e838 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:34.904715 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-dfcabb3c-dfaf-4c39-bcc7-39889189e838 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:34.905862 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-dfcabb3c-dfaf-4c39-bcc7-39889189e838 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.151044 Oct 15 03:40:34.906404 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 149/311] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:34 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:35.185195 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5d0591ff-b535-434d-94f4-442b14fd31fc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:35.186385 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5d0591ff-b535-434d-94f4-442b14fd31fc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:35.196265 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5d0591ff-b535-434d-94f4-442b14fd31fc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:35.196727 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5d0591ff-b535-434d-94f4-442b14fd31fc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:35.197600 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5d0591ff-b535-434d-94f4-442b14fd31fc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:35.204491 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5d0591ff-b535-434d-94f4-442b14fd31fc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:35.340357 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5d0591ff-b535-434d-94f4-442b14fd31fc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:35.350995 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5d0591ff-b535-434d-94f4-442b14fd31fc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.169725 Oct 15 03:40:35.352692 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 163/312] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:35 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:35.924532 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fbd78cdf-f71a-4dcf-85ae-f54fa2d4d183 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:35.925890 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fbd78cdf-f71a-4dcf-85ae-f54fa2d4d183 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:35.937695 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fbd78cdf-f71a-4dcf-85ae-f54fa2d4d183 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:35.938436 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fbd78cdf-f71a-4dcf-85ae-f54fa2d4d183 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:35.939394 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fbd78cdf-f71a-4dcf-85ae-f54fa2d4d183 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:35.940050 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fbd78cdf-f71a-4dcf-85ae-f54fa2d4d183 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:36.185100 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fbd78cdf-f71a-4dcf-85ae-f54fa2d4d183 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:36.193706 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fbd78cdf-f71a-4dcf-85ae-f54fa2d4d183 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:36.195563 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fbd78cdf-f71a-4dcf-85ae-f54fa2d4d183 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:36.197235 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fbd78cdf-f71a-4dcf-85ae-f54fa2d4d183 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.277584 Oct 15 03:40:36.197777 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 150/313] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:35 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:36.369181 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1b565235-9fe2-4cf9-af2a-393e6f3562a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:36.370423 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1b565235-9fe2-4cf9-af2a-393e6f3562a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:36.379050 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1b565235-9fe2-4cf9-af2a-393e6f3562a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:36.379842 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1b565235-9fe2-4cf9-af2a-393e6f3562a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:36.380846 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1b565235-9fe2-4cf9-af2a-393e6f3562a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:36.381456 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1b565235-9fe2-4cf9-af2a-393e6f3562a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:36.541847 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-1b565235-9fe2-4cf9-af2a-393e6f3562a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:36.550066 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1b565235-9fe2-4cf9-af2a-393e6f3562a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.184776 Oct 15 03:40:36.561267 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 164/314] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:36 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:37.216020 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-90d4e7d1-fb28-4e88-b575-1e85004a950e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:37.217022 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-90d4e7d1-fb28-4e88-b575-1e85004a950e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:37.222757 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-90d4e7d1-fb28-4e88-b575-1e85004a950e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:37.223204 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-90d4e7d1-fb28-4e88-b575-1e85004a950e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:37.224010 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-90d4e7d1-fb28-4e88-b575-1e85004a950e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:37.224439 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-90d4e7d1-fb28-4e88-b575-1e85004a950e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:37.395869 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-90d4e7d1-fb28-4e88-b575-1e85004a950e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:37.402705 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7a272ee8-4435-4c53-8e6d-42142cbf7b85 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:37.403311 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7a272ee8-4435-4c53-8e6d-42142cbf7b85 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:37.409761 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7a272ee8-4435-4c53-8e6d-42142cbf7b85 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:37.410368 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7a272ee8-4435-4c53-8e6d-42142cbf7b85 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:37.411256 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7a272ee8-4435-4c53-8e6d-42142cbf7b85 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:37.411833 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7a272ee8-4435-4c53-8e6d-42142cbf7b85 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:37.422026 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-90d4e7d1-fb28-4e88-b575-1e85004a950e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:37.423536 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-90d4e7d1-fb28-4e88-b575-1e85004a950e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:37.424731 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-90d4e7d1-fb28-4e88-b575-1e85004a950e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.212576 Oct 15 03:40:37.431129 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 151/315] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:37 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:37.519614 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.objects.instance [None req-7a272ee8-4435-4c53-8e6d-42142cbf7b85 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lazy-loading 'services' on Instance uuid e144d287-ed8a-4d89-9170-fd7a015fc126 {{(pid=120899) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 03:40:37.571784 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-54e4ca2c-b9eb-4d31-a749-cc2546378589 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:37.572398 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-54e4ca2c-b9eb-4d31-a749-cc2546378589 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:37.578815 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-54e4ca2c-b9eb-4d31-a749-cc2546378589 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:37.579329 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-54e4ca2c-b9eb-4d31-a749-cc2546378589 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:37.580948 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-54e4ca2c-b9eb-4d31-a749-cc2546378589 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:37.581795 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-54e4ca2c-b9eb-4d31-a749-cc2546378589 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:37.609368 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7a272ee8-4435-4c53-8e6d-42142cbf7b85 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126/os-volume_attachments/c4fed45a-8bd7-4fd3-bd6c-8cd5aa3d8ef0" status: 202 len: 0 microversion: 2.1 time: 0.211913 Oct 15 03:40:37.609985 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 165/316] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Oct 15 03:40:37 2021] DELETE /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126/os-volume_attachments/c4fed45a-8bd7-4fd3-bd6c-8cd5aa3d8ef0 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:40:37.643671 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1b596cc0-17bd-4782-a602-cf078e55856c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:37.648384 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1b596cc0-17bd-4782-a602-cf078e55856c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:37.658660 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1b596cc0-17bd-4782-a602-cf078e55856c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:37.659535 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1b596cc0-17bd-4782-a602-cf078e55856c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:37.660596 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1b596cc0-17bd-4782-a602-cf078e55856c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:37.661284 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1b596cc0-17bd-4782-a602-cf078e55856c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:37.721113 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1b596cc0-17bd-4782-a602-cf078e55856c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082649 Oct 15 03:40:37.722138 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 166/317] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:40:37 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:40:37.757194 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-54e4ca2c-b9eb-4d31-a749-cc2546378589 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:37.765835 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-54e4ca2c-b9eb-4d31-a749-cc2546378589 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.202503 Oct 15 03:40:37.778506 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 152/318] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:37 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:40:38.450979 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c6b56c4a-641c-4b86-b725-e70e7dc3e5a0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:38.451714 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c6b56c4a-641c-4b86-b725-e70e7dc3e5a0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:38.457900 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6b56c4a-641c-4b86-b725-e70e7dc3e5a0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:38.458459 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6b56c4a-641c-4b86-b725-e70e7dc3e5a0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:38.459340 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6b56c4a-641c-4b86-b725-e70e7dc3e5a0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:38.459898 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6b56c4a-641c-4b86-b725-e70e7dc3e5a0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:38.629032 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c6b56c4a-641c-4b86-b725-e70e7dc3e5a0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:38.644711 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c6b56c4a-641c-4b86-b725-e70e7dc3e5a0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:38.646578 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c6b56c4a-641c-4b86-b725-e70e7dc3e5a0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:38.649504 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c6b56c4a-641c-4b86-b725-e70e7dc3e5a0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.201063 Oct 15 03:40:38.650693 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 167/319] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:38 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:38.733080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-47ac621d-a903-4fe0-99ee-dce9d8806fe7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:38.735775 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-47ac621d-a903-4fe0-99ee-dce9d8806fe7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:38.742840 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-47ac621d-a903-4fe0-99ee-dce9d8806fe7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:38.743410 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-47ac621d-a903-4fe0-99ee-dce9d8806fe7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:38.744688 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-47ac621d-a903-4fe0-99ee-dce9d8806fe7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:38.746030 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-47ac621d-a903-4fe0-99ee-dce9d8806fe7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:38.783024 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-47ac621d-a903-4fe0-99ee-dce9d8806fe7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053676 Oct 15 03:40:38.784295 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 153/320] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:40:38 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:40:38.789749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2e3381f4-3b85-410b-9da6-417aa1af7d5d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:38.790748 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2e3381f4-3b85-410b-9da6-417aa1af7d5d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:38.801490 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2e3381f4-3b85-410b-9da6-417aa1af7d5d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:38.802181 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2e3381f4-3b85-410b-9da6-417aa1af7d5d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:38.803215 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2e3381f4-3b85-410b-9da6-417aa1af7d5d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:38.804670 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2e3381f4-3b85-410b-9da6-417aa1af7d5d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:38.982852 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2e3381f4-3b85-410b-9da6-417aa1af7d5d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:38.991616 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2e3381f4-3b85-410b-9da6-417aa1af7d5d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.209810 Oct 15 03:40:38.993184 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 168/321] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:38 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:40:39.668848 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3ee51aa4-9ceb-4b96-9cc8-47c722d763f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:39.669467 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3ee51aa4-9ceb-4b96-9cc8-47c722d763f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:39.676044 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3ee51aa4-9ceb-4b96-9cc8-47c722d763f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:39.676585 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3ee51aa4-9ceb-4b96-9cc8-47c722d763f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:39.677449 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3ee51aa4-9ceb-4b96-9cc8-47c722d763f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:39.678334 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3ee51aa4-9ceb-4b96-9cc8-47c722d763f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:39.797426 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ee24d2e3-7e5b-44ad-a9cf-463f224ebc98 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:39.798539 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ee24d2e3-7e5b-44ad-a9cf-463f224ebc98 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:39.810282 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee24d2e3-7e5b-44ad-a9cf-463f224ebc98 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:39.810754 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee24d2e3-7e5b-44ad-a9cf-463f224ebc98 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:39.819775 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee24d2e3-7e5b-44ad-a9cf-463f224ebc98 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:39.820285 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee24d2e3-7e5b-44ad-a9cf-463f224ebc98 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:39.828504 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3ee51aa4-9ceb-4b96-9cc8-47c722d763f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:39.837780 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3ee51aa4-9ceb-4b96-9cc8-47c722d763f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:39.839810 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3ee51aa4-9ceb-4b96-9cc8-47c722d763f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:39.841128 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3ee51aa4-9ceb-4b96-9cc8-47c722d763f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.176880 Oct 15 03:40:39.851399 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 154/322] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:39 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:39.886056 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ee24d2e3-7e5b-44ad-a9cf-463f224ebc98 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093213 Oct 15 03:40:39.890856 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 169/323] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:40:39 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 03:40:40.017383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bef011c2-ffbd-4edd-bd5b-44489ae8b246 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:40.018266 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bef011c2-ffbd-4edd-bd5b-44489ae8b246 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:40.031936 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bef011c2-ffbd-4edd-bd5b-44489ae8b246 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:40.032694 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bef011c2-ffbd-4edd-bd5b-44489ae8b246 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:40.033704 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bef011c2-ffbd-4edd-bd5b-44489ae8b246 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:40.037429 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bef011c2-ffbd-4edd-bd5b-44489ae8b246 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:40.226441 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bef011c2-ffbd-4edd-bd5b-44489ae8b246 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:40.247700 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bef011c2-ffbd-4edd-bd5b-44489ae8b246 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.234192 Oct 15 03:40:40.248274 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 155/324] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:40 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:40.858768 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-213c1300-9330-4d73-8d4f-e990730199bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:40.860068 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-213c1300-9330-4d73-8d4f-e990730199bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:40.866971 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-213c1300-9330-4d73-8d4f-e990730199bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:40.868186 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-213c1300-9330-4d73-8d4f-e990730199bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:40.869130 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-213c1300-9330-4d73-8d4f-e990730199bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:40.869715 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-213c1300-9330-4d73-8d4f-e990730199bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:41.089993 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-213c1300-9330-4d73-8d4f-e990730199bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:41.098644 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-213c1300-9330-4d73-8d4f-e990730199bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:41.100271 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-213c1300-9330-4d73-8d4f-e990730199bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:41.101797 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-213c1300-9330-4d73-8d4f-e990730199bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.246727 Oct 15 03:40:41.113907 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 170/325] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:40 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:41.155701 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4a06dd80-7ddb-4ed5-a2bd-3efdf6b1e64c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:41.156497 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4a06dd80-7ddb-4ed5-a2bd-3efdf6b1e64c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:41.162582 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4a06dd80-7ddb-4ed5-a2bd-3efdf6b1e64c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:41.163042 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4a06dd80-7ddb-4ed5-a2bd-3efdf6b1e64c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:41.163856 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4a06dd80-7ddb-4ed5-a2bd-3efdf6b1e64c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:41.164354 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4a06dd80-7ddb-4ed5-a2bd-3efdf6b1e64c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:41.194408 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4a06dd80-7ddb-4ed5-a2bd-3efdf6b1e64c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Going to try to terminate instance {{(pid=120897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 15 03:40:41.263734 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-186dda34-b54d-4ecd-b28f-e15df8ac3e54 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:41.264630 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-186dda34-b54d-4ecd-b28f-e15df8ac3e54 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:41.270957 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-186dda34-b54d-4ecd-b28f-e15df8ac3e54 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:41.271656 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-186dda34-b54d-4ecd-b28f-e15df8ac3e54 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:41.272677 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-186dda34-b54d-4ecd-b28f-e15df8ac3e54 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:41.276620 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-186dda34-b54d-4ecd-b28f-e15df8ac3e54 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:41.311785 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4a06dd80-7ddb-4ed5-a2bd-3efdf6b1e64c tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 204 len: 0 microversion: 2.1 time: 0.159215 Oct 15 03:40:41.312529 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 156/326] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 03:40:41 2021] DELETE /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 03:40:41.323579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b832229b-e509-42a9-bd9d-fc81ee5c852e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:41.324378 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b832229b-e509-42a9-bd9d-fc81ee5c852e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:41.330388 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b832229b-e509-42a9-bd9d-fc81ee5c852e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:41.330833 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b832229b-e509-42a9-bd9d-fc81ee5c852e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:41.331604 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b832229b-e509-42a9-bd9d-fc81ee5c852e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:41.332063 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b832229b-e509-42a9-bd9d-fc81ee5c852e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:41.522110 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-186dda34-b54d-4ecd-b28f-e15df8ac3e54 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:41.532266 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-186dda34-b54d-4ecd-b28f-e15df8ac3e54 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.272063 Oct 15 03:40:41.542233 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b832229b-e509-42a9-bd9d-fc81ee5c852e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:41.543363 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 171/327] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:41 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:40:41.548463 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b832229b-e509-42a9-bd9d-fc81ee5c852e tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 200 len: 1514 microversion: 2.1 time: 0.229439 Oct 15 03:40:41.549045 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 157/328] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:41 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 1514 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:42.121296 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b7726dff-f3ba-4a77-9187-e317372a5843 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:42.121906 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b7726dff-f3ba-4a77-9187-e317372a5843 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:42.135596 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b7726dff-f3ba-4a77-9187-e317372a5843 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:42.136073 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b7726dff-f3ba-4a77-9187-e317372a5843 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:42.137096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b7726dff-f3ba-4a77-9187-e317372a5843 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:42.137776 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b7726dff-f3ba-4a77-9187-e317372a5843 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:42.286236 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b7726dff-f3ba-4a77-9187-e317372a5843 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:42.295096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b7726dff-f3ba-4a77-9187-e317372a5843 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:42.296625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b7726dff-f3ba-4a77-9187-e317372a5843 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:42.297928 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b7726dff-f3ba-4a77-9187-e317372a5843 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.180352 Oct 15 03:40:42.298484 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 172/329] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:42 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:42.549483 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f35548a3-eecb-4417-984d-b1b718b32e9b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:42.550828 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f35548a3-eecb-4417-984d-b1b718b32e9b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:42.556960 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f35548a3-eecb-4417-984d-b1b718b32e9b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:42.557700 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f35548a3-eecb-4417-984d-b1b718b32e9b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:42.558714 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f35548a3-eecb-4417-984d-b1b718b32e9b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:42.559388 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f35548a3-eecb-4417-984d-b1b718b32e9b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:42.567590 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-73a6b4f5-c585-41c0-a19d-e3a15720fb78 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:42.568670 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-73a6b4f5-c585-41c0-a19d-e3a15720fb78 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:42.577187 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-73a6b4f5-c585-41c0-a19d-e3a15720fb78 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:42.577653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-73a6b4f5-c585-41c0-a19d-e3a15720fb78 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:42.578470 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-73a6b4f5-c585-41c0-a19d-e3a15720fb78 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:42.578871 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-73a6b4f5-c585-41c0-a19d-e3a15720fb78 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:43.012147 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f35548a3-eecb-4417-984d-b1b718b32e9b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:43.019973 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f35548a3-eecb-4417-984d-b1b718b32e9b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.474030 Oct 15 03:40:43.030835 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 158/330] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:42 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:43.087408 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-73a6b4f5-c585-41c0-a19d-e3a15720fb78 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:43.096597 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-73a6b4f5-c585-41c0-a19d-e3a15720fb78 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 200 len: 1514 microversion: 2.1 time: 0.531801 Oct 15 03:40:43.106068 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 173/331] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:42 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 1514 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:43.334537 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-af55f06f-4f3b-44e6-a4c2-0a6f1a73052b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:43.335466 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-af55f06f-4f3b-44e6-a4c2-0a6f1a73052b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:43.345376 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-af55f06f-4f3b-44e6-a4c2-0a6f1a73052b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:43.346132 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-af55f06f-4f3b-44e6-a4c2-0a6f1a73052b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:43.347282 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-af55f06f-4f3b-44e6-a4c2-0a6f1a73052b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:43.347830 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-af55f06f-4f3b-44e6-a4c2-0a6f1a73052b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:43.478966 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-af55f06f-4f3b-44e6-a4c2-0a6f1a73052b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:43.487119 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-af55f06f-4f3b-44e6-a4c2-0a6f1a73052b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:43.488940 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-af55f06f-4f3b-44e6-a4c2-0a6f1a73052b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:43.490069 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-af55f06f-4f3b-44e6-a4c2-0a6f1a73052b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.172236 Oct 15 03:40:43.490807 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 159/332] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:43 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:44.037771 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-570e2374-22f4-4aaa-8c9a-99a446bd1e7a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:44.039005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-570e2374-22f4-4aaa-8c9a-99a446bd1e7a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:44.045055 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-570e2374-22f4-4aaa-8c9a-99a446bd1e7a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:44.045372 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-570e2374-22f4-4aaa-8c9a-99a446bd1e7a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:44.046613 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-570e2374-22f4-4aaa-8c9a-99a446bd1e7a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:44.047256 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-570e2374-22f4-4aaa-8c9a-99a446bd1e7a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:44.119252 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0e339244-af1e-435b-aea4-b2d40efcb7e3 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:44.120721 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0e339244-af1e-435b-aea4-b2d40efcb7e3 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:44.128408 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0e339244-af1e-435b-aea4-b2d40efcb7e3 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:44.128854 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0e339244-af1e-435b-aea4-b2d40efcb7e3 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:44.135626 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0e339244-af1e-435b-aea4-b2d40efcb7e3 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:44.137062 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0e339244-af1e-435b-aea4-b2d40efcb7e3 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:44.350173 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0e339244-af1e-435b-aea4-b2d40efcb7e3 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:44.365170 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0e339244-af1e-435b-aea4-b2d40efcb7e3 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 200 len: 1514 microversion: 2.1 time: 0.250653 Oct 15 03:40:44.366254 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 160/333] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:44 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 1514 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:44.385483 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-570e2374-22f4-4aaa-8c9a-99a446bd1e7a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:44.394653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-570e2374-22f4-4aaa-8c9a-99a446bd1e7a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.359380 Oct 15 03:40:44.399025 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 174/334] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:44 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:44.514351 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-aaa58f91-71e4-42ba-9b80-978349896779 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:44.515116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-aaa58f91-71e4-42ba-9b80-978349896779 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:44.541464 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aaa58f91-71e4-42ba-9b80-978349896779 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:44.542063 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aaa58f91-71e4-42ba-9b80-978349896779 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:44.542960 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aaa58f91-71e4-42ba-9b80-978349896779 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:44.543614 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aaa58f91-71e4-42ba-9b80-978349896779 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:44.594518 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-b185bf2d-6520-4103-b5a1-eb4aba268fd6 req-a1789e1a-8cd2-416d-95b3-b736c13fb7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e144d287-ed8a-4d89-9170-fd7a015fc126", "name": "network-vif-deleted", "tag": "dee6750f-ed7d-48f9-a119-20f4369f477d"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:40:44.596258 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:40:44.596258 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 03:40:44.608911 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-b185bf2d-6520-4103-b5a1-eb4aba268fd6 req-a1789e1a-8cd2-416d-95b3-b736c13fb7f2 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:44.612512 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-b185bf2d-6520-4103-b5a1-eb4aba268fd6 req-a1789e1a-8cd2-416d-95b3-b736c13fb7f2 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:44.650735 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-b185bf2d-6520-4103-b5a1-eb4aba268fd6 req-a1789e1a-8cd2-416d-95b3-b736c13fb7f2 service nova] Creating event network-vif-deleted:dee6750f-ed7d-48f9-a119-20f4369f477d for instance e144d287-ed8a-4d89-9170-fd7a015fc126 on hv-cinder-81410 Oct 15 03:40:44.680956 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-b185bf2d-6520-4103-b5a1-eb4aba268fd6 req-a1789e1a-8cd2-416d-95b3-b736c13fb7f2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089110 Oct 15 03:40:44.682153 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 175/335] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:40:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:40:44.776997 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-aaa58f91-71e4-42ba-9b80-978349896779 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:44.786644 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-aaa58f91-71e4-42ba-9b80-978349896779 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:44.788536 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-aaa58f91-71e4-42ba-9b80-978349896779 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:44.790067 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-aaa58f91-71e4-42ba-9b80-978349896779 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.279510 Oct 15 03:40:44.790624 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 161/336] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:44 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:45.391181 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f6f5cbca-2bf1-467f-ba8e-fa9ca6decfe5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:45.391994 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f6f5cbca-2bf1-467f-ba8e-fa9ca6decfe5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:45.397933 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f6f5cbca-2bf1-467f-ba8e-fa9ca6decfe5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:45.398378 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f6f5cbca-2bf1-467f-ba8e-fa9ca6decfe5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:45.399668 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f6f5cbca-2bf1-467f-ba8e-fa9ca6decfe5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:45.400125 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f6f5cbca-2bf1-467f-ba8e-fa9ca6decfe5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:45.419910 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5e00ccc0-3175-4e70-a762-555cec6f270b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:45.420749 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5e00ccc0-3175-4e70-a762-555cec6f270b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:45.431434 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5e00ccc0-3175-4e70-a762-555cec6f270b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:45.432460 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5e00ccc0-3175-4e70-a762-555cec6f270b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:45.433416 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5e00ccc0-3175-4e70-a762-555cec6f270b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:45.433983 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5e00ccc0-3175-4e70-a762-555cec6f270b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:45.445919 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f6f5cbca-2bf1-467f-ba8e-fa9ca6decfe5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:45.446662 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f6f5cbca-2bf1-467f-ba8e-fa9ca6decfe5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:45.447302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.objects.instance [None req-f6f5cbca-2bf1-467f-ba8e-fa9ca6decfe5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lazy-loading 'fault' on Instance uuid e144d287-ed8a-4d89-9170-fd7a015fc126 {{(pid=120899) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 03:40:45.514323 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f6f5cbca-2bf1-467f-ba8e-fa9ca6decfe5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:45.521345 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f6f5cbca-2bf1-467f-ba8e-fa9ca6decfe5 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 200 len: 1307 microversion: 2.1 time: 0.142578 Oct 15 03:40:45.522257 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 176/337] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:45 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 1307 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:45.606989 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5e00ccc0-3175-4e70-a762-555cec6f270b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:45.614446 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5e00ccc0-3175-4e70-a762-555cec6f270b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.198648 Oct 15 03:40:45.615008 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 162/338] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:45 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:45.808541 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8554032e-9230-4ee0-95e3-0fde2fa1f925 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:45.809149 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8554032e-9230-4ee0-95e3-0fde2fa1f925 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:45.814949 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8554032e-9230-4ee0-95e3-0fde2fa1f925 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:45.815400 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8554032e-9230-4ee0-95e3-0fde2fa1f925 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:45.816207 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8554032e-9230-4ee0-95e3-0fde2fa1f925 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:45.816641 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8554032e-9230-4ee0-95e3-0fde2fa1f925 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:45.946709 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8554032e-9230-4ee0-95e3-0fde2fa1f925 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:45.954495 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8554032e-9230-4ee0-95e3-0fde2fa1f925 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:45.956061 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8554032e-9230-4ee0-95e3-0fde2fa1f925 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:45.957241 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8554032e-9230-4ee0-95e3-0fde2fa1f925 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.152531 Oct 15 03:40:45.957804 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 177/339] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:45 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:46.538675 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-02015faa-9df8-40da-87e0-df9c816588f7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:46.539204 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-02015faa-9df8-40da-87e0-df9c816588f7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: e144d287-ed8a-4d89-9170-fd7a015fc126] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:46.544980 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-02015faa-9df8-40da-87e0-df9c816588f7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:46.545444 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-02015faa-9df8-40da-87e0-df9c816588f7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:46.546178 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-02015faa-9df8-40da-87e0-df9c816588f7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:46.546607 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-02015faa-9df8-40da-87e0-df9c816588f7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:46.561346 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.wsgi [None req-02015faa-9df8-40da-87e0-df9c816588f7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] HTTP exception thrown: Instance e144d287-ed8a-4d89-9170-fd7a015fc126 could not be found. Oct 15 03:40:46.561921 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-02015faa-9df8-40da-87e0-df9c816588f7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Returning 404 to user: Instance e144d287-ed8a-4d89-9170-fd7a015fc126 could not be found. {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:40:46.562710 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-02015faa-9df8-40da-87e0-df9c816588f7 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126" status: 404 len: 111 microversion: 2.1 time: 0.027822 Oct 15 03:40:46.563213 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 163/340] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:46 2021] GET /compute/v2.1/servers/e144d287-ed8a-4d89-9170-fd7a015fc126 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 03:40:46.630850 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-09464354-6677-466e-b2db-2d0b93e7b8e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:46.631465 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-09464354-6677-466e-b2db-2d0b93e7b8e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:46.637188 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09464354-6677-466e-b2db-2d0b93e7b8e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:46.637765 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09464354-6677-466e-b2db-2d0b93e7b8e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:46.638532 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09464354-6677-466e-b2db-2d0b93e7b8e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:46.638963 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09464354-6677-466e-b2db-2d0b93e7b8e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:46.758088 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-09464354-6677-466e-b2db-2d0b93e7b8e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:46.765265 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-09464354-6677-466e-b2db-2d0b93e7b8e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.138079 Oct 15 03:40:46.765835 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 178/341] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:46 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:46.975870 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-943572d0-d623-40c5-953d-ac9b5f19b3a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:46.976477 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-943572d0-d623-40c5-953d-ac9b5f19b3a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:46.982782 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-943572d0-d623-40c5-953d-ac9b5f19b3a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:46.983233 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-943572d0-d623-40c5-953d-ac9b5f19b3a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:46.984024 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-943572d0-d623-40c5-953d-ac9b5f19b3a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:46.984475 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-943572d0-d623-40c5-953d-ac9b5f19b3a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:47.100757 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-943572d0-d623-40c5-953d-ac9b5f19b3a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:47.108903 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-943572d0-d623-40c5-953d-ac9b5f19b3a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:47.110396 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-943572d0-d623-40c5-953d-ac9b5f19b3a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:47.111530 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-943572d0-d623-40c5-953d-ac9b5f19b3a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.139399 Oct 15 03:40:47.112110 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 164/342] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:46 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:47.691587 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c1debb2e-2a22-4be2-90a1-85542236ae14 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:47.692103 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c1debb2e-2a22-4be2-90a1-85542236ae14 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:47.698285 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c1debb2e-2a22-4be2-90a1-85542236ae14 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:47.698726 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c1debb2e-2a22-4be2-90a1-85542236ae14 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:47.699479 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c1debb2e-2a22-4be2-90a1-85542236ae14 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:47.699941 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c1debb2e-2a22-4be2-90a1-85542236ae14 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:47.723304 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c1debb2e-2a22-4be2-90a1-85542236ae14 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Going to try to terminate instance {{(pid=120899) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 15 03:40:47.781039 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-05d86312-cf25-4eda-bc27-e334b64dce4a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:47.781707 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-05d86312-cf25-4eda-bc27-e334b64dce4a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:47.788559 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-05d86312-cf25-4eda-bc27-e334b64dce4a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:47.789208 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-05d86312-cf25-4eda-bc27-e334b64dce4a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:47.789997 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-05d86312-cf25-4eda-bc27-e334b64dce4a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:47.790436 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-05d86312-cf25-4eda-bc27-e334b64dce4a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:47.806570 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c1debb2e-2a22-4be2-90a1-85542236ae14 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e" status: 204 len: 0 microversion: 2.1 time: 0.118279 Oct 15 03:40:47.810546 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 179/343] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 03:40:47 2021] DELETE /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 03:40:47.815571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-87b4b03f-bff3-45e6-8e01-6b66772b2694 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:47.816310 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-87b4b03f-bff3-45e6-8e01-6b66772b2694 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:47.822665 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-87b4b03f-bff3-45e6-8e01-6b66772b2694 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:47.823118 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-87b4b03f-bff3-45e6-8e01-6b66772b2694 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:47.823914 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-87b4b03f-bff3-45e6-8e01-6b66772b2694 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:47.824356 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-87b4b03f-bff3-45e6-8e01-6b66772b2694 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:47.975651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-05d86312-cf25-4eda-bc27-e334b64dce4a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:47.982318 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-87b4b03f-bff3-45e6-8e01-6b66772b2694 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:47.983148 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-05d86312-cf25-4eda-bc27-e334b64dce4a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.205824 Oct 15 03:40:47.983980 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 165/344] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:47 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:40:47.989683 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-87b4b03f-bff3-45e6-8e01-6b66772b2694 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e" status: 200 len: 1514 microversion: 2.1 time: 0.178002 Oct 15 03:40:47.990270 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 180/345] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:47 2021] GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:40:48.128922 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a09e44d5-96dc-47f8-851e-b4a2069aa6e5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:48.129437 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a09e44d5-96dc-47f8-851e-b4a2069aa6e5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:48.135734 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a09e44d5-96dc-47f8-851e-b4a2069aa6e5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:48.136189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a09e44d5-96dc-47f8-851e-b4a2069aa6e5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:48.136971 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a09e44d5-96dc-47f8-851e-b4a2069aa6e5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:48.137403 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a09e44d5-96dc-47f8-851e-b4a2069aa6e5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:48.254434 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a09e44d5-96dc-47f8-851e-b4a2069aa6e5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:48.266514 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a09e44d5-96dc-47f8-851e-b4a2069aa6e5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:48.268123 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a09e44d5-96dc-47f8-851e-b4a2069aa6e5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:48.270288 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a09e44d5-96dc-47f8-851e-b4a2069aa6e5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.144897 Oct 15 03:40:48.271274 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 166/346] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:48 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:48.999888 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-beff08d8-63fe-4922-8e92-8dbcc98dc55a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:49.001342 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-beff08d8-63fe-4922-8e92-8dbcc98dc55a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:49.006398 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-199644b7-84e0-4a3a-82dc-316a9a06bd18 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:49.007009 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-199644b7-84e0-4a3a-82dc-316a9a06bd18 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:49.007394 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-beff08d8-63fe-4922-8e92-8dbcc98dc55a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:49.007899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-beff08d8-63fe-4922-8e92-8dbcc98dc55a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:49.008662 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-beff08d8-63fe-4922-8e92-8dbcc98dc55a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:49.009093 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-beff08d8-63fe-4922-8e92-8dbcc98dc55a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:49.012717 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-199644b7-84e0-4a3a-82dc-316a9a06bd18 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:49.013160 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-199644b7-84e0-4a3a-82dc-316a9a06bd18 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:49.014120 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-199644b7-84e0-4a3a-82dc-316a9a06bd18 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:49.014732 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-199644b7-84e0-4a3a-82dc-316a9a06bd18 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:49.181567 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-beff08d8-63fe-4922-8e92-8dbcc98dc55a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:49.189715 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-199644b7-84e0-4a3a-82dc-316a9a06bd18 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:49.189927 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-beff08d8-63fe-4922-8e92-8dbcc98dc55a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.192519 Oct 15 03:40:49.189927 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 181/347] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:48 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:49.196124 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-199644b7-84e0-4a3a-82dc-316a9a06bd18 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e" status: 200 len: 1514 microversion: 2.1 time: 0.193149 Oct 15 03:40:49.196797 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 167/348] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:49 2021] GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:40:49.291084 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0afe4f50-1fd0-4001-9fdd-c814558c30a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:49.291660 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0afe4f50-1fd0-4001-9fdd-c814558c30a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:49.297505 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0afe4f50-1fd0-4001-9fdd-c814558c30a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:49.297953 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0afe4f50-1fd0-4001-9fdd-c814558c30a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:49.298712 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0afe4f50-1fd0-4001-9fdd-c814558c30a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:49.299140 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0afe4f50-1fd0-4001-9fdd-c814558c30a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:49.416457 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0afe4f50-1fd0-4001-9fdd-c814558c30a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:49.424181 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0afe4f50-1fd0-4001-9fdd-c814558c30a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:49.425875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0afe4f50-1fd0-4001-9fdd-c814558c30a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:49.427117 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0afe4f50-1fd0-4001-9fdd-c814558c30a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.140359 Oct 15 03:40:49.427665 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 182/349] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:49 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:50.205318 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-42167b6c-01ed-4b71-9b25-f9d134a6d5e7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:50.205950 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-42167b6c-01ed-4b71-9b25-f9d134a6d5e7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:50.212823 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-604e21fa-9554-4033-852c-e180f4f70947 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:50.213547 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-42167b6c-01ed-4b71-9b25-f9d134a6d5e7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:50.213547 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-42167b6c-01ed-4b71-9b25-f9d134a6d5e7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:50.213997 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-604e21fa-9554-4033-852c-e180f4f70947 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:50.214268 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-42167b6c-01ed-4b71-9b25-f9d134a6d5e7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:50.214692 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-42167b6c-01ed-4b71-9b25-f9d134a6d5e7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:50.220243 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-604e21fa-9554-4033-852c-e180f4f70947 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:50.220958 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-604e21fa-9554-4033-852c-e180f4f70947 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:50.221973 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-604e21fa-9554-4033-852c-e180f4f70947 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:50.222642 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-604e21fa-9554-4033-852c-e180f4f70947 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:50.436882 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-604e21fa-9554-4033-852c-e180f4f70947 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:50.442050 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-42167b6c-01ed-4b71-9b25-f9d134a6d5e7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:50.445858 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-604e21fa-9554-4033-852c-e180f4f70947 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e" status: 200 len: 1514 microversion: 2.1 time: 0.236444 Oct 15 03:40:50.447777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 183/350] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:50 2021] GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e => generated 1514 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:40:50.454880 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-a167cb7c-9379-468e-928e-2cff72066bcf req-3c633008-f3d1-45f5-b5ba-254ee65e316a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d67eee-7c84-408a-8c4c-7b656de9128e", "name": "network-vif-deleted", "tag": "fb8475fb-53f1-444e-b92f-5a03602cc266"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:40:50.460016 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:40:50.460016 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 03:40:50.467822 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-a167cb7c-9379-468e-928e-2cff72066bcf req-3c633008-f3d1-45f5-b5ba-254ee65e316a service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:50.468268 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-a167cb7c-9379-468e-928e-2cff72066bcf req-3c633008-f3d1-45f5-b5ba-254ee65e316a service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:50.474937 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-42167b6c-01ed-4b71-9b25-f9d134a6d5e7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.273156 Oct 15 03:40:50.475515 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 168/351] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:50 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:50.479284 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-a167cb7c-9379-468e-928e-2cff72066bcf req-3c633008-f3d1-45f5-b5ba-254ee65e316a service nova] Creating event network-vif-deleted:fb8475fb-53f1-444e-b92f-5a03602cc266 for instance b2d67eee-7c84-408a-8c4c-7b656de9128e on hv-cinder-81410 Oct 15 03:40:50.486767 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-a167cb7c-9379-468e-928e-2cff72066bcf req-3c633008-f3d1-45f5-b5ba-254ee65e316a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037632 Oct 15 03:40:50.487907 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 184/352] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:40:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:40:50.488245 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2a7cde26-ba73-452f-ab94-e1767e882d3b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:50.488867 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2a7cde26-ba73-452f-ab94-e1767e882d3b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:50.495421 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2a7cde26-ba73-452f-ab94-e1767e882d3b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:50.496018 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2a7cde26-ba73-452f-ab94-e1767e882d3b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:50.496720 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2a7cde26-ba73-452f-ab94-e1767e882d3b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:50.497512 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2a7cde26-ba73-452f-ab94-e1767e882d3b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:50.668143 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2a7cde26-ba73-452f-ab94-e1767e882d3b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:50.675711 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2a7cde26-ba73-452f-ab94-e1767e882d3b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:50.677188 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2a7cde26-ba73-452f-ab94-e1767e882d3b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:50.678315 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2a7cde26-ba73-452f-ab94-e1767e882d3b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.201593 Oct 15 03:40:50.678856 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 169/353] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:50 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:51.464394 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1eaf3c9b-8dbb-4881-a431-53722be07492 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:51.465099 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1eaf3c9b-8dbb-4881-a431-53722be07492 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: b2d67eee-7c84-408a-8c4c-7b656de9128e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:51.471341 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1eaf3c9b-8dbb-4881-a431-53722be07492 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:51.471816 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1eaf3c9b-8dbb-4881-a431-53722be07492 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:51.472582 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1eaf3c9b-8dbb-4881-a431-53722be07492 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:51.473011 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1eaf3c9b-8dbb-4881-a431-53722be07492 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:51.486398 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-1eaf3c9b-8dbb-4881-a431-53722be07492 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] HTTP exception thrown: Instance b2d67eee-7c84-408a-8c4c-7b656de9128e could not be found. Oct 15 03:40:51.486974 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1eaf3c9b-8dbb-4881-a431-53722be07492 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Returning 404 to user: Instance b2d67eee-7c84-408a-8c4c-7b656de9128e could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:40:51.487839 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1eaf3c9b-8dbb-4881-a431-53722be07492 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e" status: 404 len: 111 microversion: 2.1 time: 0.028440 Oct 15 03:40:51.488354 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 185/354] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:51 2021] GET /compute/v2.1/servers/b2d67eee-7c84-408a-8c4c-7b656de9128e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 03:40:51.492111 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-48ffab8e-9075-4efc-87d7-5f388f54697f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:51.492715 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-48ffab8e-9075-4efc-87d7-5f388f54697f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:51.495864 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0100c633-ac71-4686-b92a-05c4aa949ef9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:51.496289 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0100c633-ac71-4686-b92a-05c4aa949ef9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:51.498560 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-48ffab8e-9075-4efc-87d7-5f388f54697f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:51.499004 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-48ffab8e-9075-4efc-87d7-5f388f54697f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:51.499786 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-48ffab8e-9075-4efc-87d7-5f388f54697f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:51.500224 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-48ffab8e-9075-4efc-87d7-5f388f54697f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:51.501797 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0100c633-ac71-4686-b92a-05c4aa949ef9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:51.502244 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0100c633-ac71-4686-b92a-05c4aa949ef9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:51.502990 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0100c633-ac71-4686-b92a-05c4aa949ef9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:51.503417 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0100c633-ac71-4686-b92a-05c4aa949ef9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:51.535459 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0100c633-ac71-4686-b92a-05c4aa949ef9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Going to try to terminate instance {{(pid=120899) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 15 03:40:51.631166 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0100c633-ac71-4686-b92a-05c4aa949ef9 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 204 len: 0 microversion: 2.1 time: 0.137828 Oct 15 03:40:51.632041 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 186/355] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 03:40:51 2021] DELETE /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 15 03:40:51.640029 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-765259d3-1d89-4ff7-82c6-51aff71f3abb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:51.640718 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-765259d3-1d89-4ff7-82c6-51aff71f3abb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:51.646315 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-765259d3-1d89-4ff7-82c6-51aff71f3abb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:51.647005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-765259d3-1d89-4ff7-82c6-51aff71f3abb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:51.647804 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-765259d3-1d89-4ff7-82c6-51aff71f3abb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:51.648784 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-765259d3-1d89-4ff7-82c6-51aff71f3abb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:51.654451 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-48ffab8e-9075-4efc-87d7-5f388f54697f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:51.663081 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-48ffab8e-9075-4efc-87d7-5f388f54697f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.173634 Oct 15 03:40:51.663081 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 170/356] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:51 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:40:51.698025 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a73603a4-d542-4855-b8cb-cb1461c73a9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:51.698623 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a73603a4-d542-4855-b8cb-cb1461c73a9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:51.704447 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a73603a4-d542-4855-b8cb-cb1461c73a9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:51.704889 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a73603a4-d542-4855-b8cb-cb1461c73a9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:51.705649 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a73603a4-d542-4855-b8cb-cb1461c73a9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:51.706246 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a73603a4-d542-4855-b8cb-cb1461c73a9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:51.810950 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-765259d3-1d89-4ff7-82c6-51aff71f3abb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:51.818226 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-765259d3-1d89-4ff7-82c6-51aff71f3abb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1514 microversion: 2.1 time: 0.182153 Oct 15 03:40:51.818794 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 187/357] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:51 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:40:51.859265 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a73603a4-d542-4855-b8cb-cb1461c73a9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:51.867652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a73603a4-d542-4855-b8cb-cb1461c73a9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:51.869168 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a73603a4-d542-4855-b8cb-cb1461c73a9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:51.870313 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a73603a4-d542-4855-b8cb-cb1461c73a9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.176325 Oct 15 03:40:51.870861 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 171/358] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:51 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:52.678011 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ce6ce682-073c-418d-9d8e-cc2df6ee2ffb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:52.678618 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ce6ce682-073c-418d-9d8e-cc2df6ee2ffb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:52.685133 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce6ce682-073c-418d-9d8e-cc2df6ee2ffb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:52.685582 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce6ce682-073c-418d-9d8e-cc2df6ee2ffb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:52.686339 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce6ce682-073c-418d-9d8e-cc2df6ee2ffb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:52.686771 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce6ce682-073c-418d-9d8e-cc2df6ee2ffb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:52.810103 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ce6ce682-073c-418d-9d8e-cc2df6ee2ffb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:52.817197 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ce6ce682-073c-418d-9d8e-cc2df6ee2ffb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.142843 Oct 15 03:40:52.817758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 188/359] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:52 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:52.835154 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-33c4ccf8-f438-4480-86b0-26142a012800 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:52.835827 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-33c4ccf8-f438-4480-86b0-26142a012800 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:52.841739 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-33c4ccf8-f438-4480-86b0-26142a012800 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:52.842191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-33c4ccf8-f438-4480-86b0-26142a012800 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:52.842957 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-33c4ccf8-f438-4480-86b0-26142a012800 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:52.843392 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-33c4ccf8-f438-4480-86b0-26142a012800 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:52.887922 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b1da5ef6-87e0-4057-9d07-46e44eea792b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:52.888444 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b1da5ef6-87e0-4057-9d07-46e44eea792b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:52.894965 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b1da5ef6-87e0-4057-9d07-46e44eea792b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:52.895419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b1da5ef6-87e0-4057-9d07-46e44eea792b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:52.896413 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b1da5ef6-87e0-4057-9d07-46e44eea792b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:52.896858 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b1da5ef6-87e0-4057-9d07-46e44eea792b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:52.997334 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-33c4ccf8-f438-4480-86b0-26142a012800 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:53.004644 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-33c4ccf8-f438-4480-86b0-26142a012800 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1514 microversion: 2.1 time: 0.173056 Oct 15 03:40:53.005205 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 172/360] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:52 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:53.048754 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b1da5ef6-87e0-4057-9d07-46e44eea792b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:53.056931 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b1da5ef6-87e0-4057-9d07-46e44eea792b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:53.058421 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b1da5ef6-87e0-4057-9d07-46e44eea792b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:53.059560 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b1da5ef6-87e0-4057-9d07-46e44eea792b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.175425 Oct 15 03:40:53.060180 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 189/361] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:52 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:40:53.837454 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5475e298-6568-4975-b8ab-eb897c678ea4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:53.838065 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5475e298-6568-4975-b8ab-eb897c678ea4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:53.844235 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5475e298-6568-4975-b8ab-eb897c678ea4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:53.844866 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5475e298-6568-4975-b8ab-eb897c678ea4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:53.845648 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5475e298-6568-4975-b8ab-eb897c678ea4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:53.846296 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5475e298-6568-4975-b8ab-eb897c678ea4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:53.873313 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-9e03b603-4449-4eba-999a-bc7ff8231de8 req-7026f99d-229e-4857-8b57-672c6675cfc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b4458c-7b40-46f8-9bc9-c3304b3f4687", "name": "network-vif-deleted", "tag": "191df8c4-0e08-4fa3-aaa6-fd952995c6e6"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:40:53.875196 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:40:53.875196 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 03:40:53.883489 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-9e03b603-4449-4eba-999a-bc7ff8231de8 req-7026f99d-229e-4857-8b57-672c6675cfc6 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:53.884092 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-9e03b603-4449-4eba-999a-bc7ff8231de8 req-7026f99d-229e-4857-8b57-672c6675cfc6 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:53.897544 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-9e03b603-4449-4eba-999a-bc7ff8231de8 req-7026f99d-229e-4857-8b57-672c6675cfc6 service nova] Creating event network-vif-deleted:191df8c4-0e08-4fa3-aaa6-fd952995c6e6 for instance d6b4458c-7b40-46f8-9bc9-c3304b3f4687 on hv-cinder-81410 Oct 15 03:40:53.903481 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-9e03b603-4449-4eba-999a-bc7ff8231de8 req-7026f99d-229e-4857-8b57-672c6675cfc6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035805 Oct 15 03:40:53.906986 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 190/362] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:40:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:40:54.000348 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5475e298-6568-4975-b8ab-eb897c678ea4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:54.009429 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5475e298-6568-4975-b8ab-eb897c678ea4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.175992 Oct 15 03:40:54.009993 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 173/363] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:53 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:54.021673 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9bed0406-d752-4690-901a-aff94eb0aa01 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:54.022366 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9bed0406-d752-4690-901a-aff94eb0aa01 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:54.028476 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bed0406-d752-4690-901a-aff94eb0aa01 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:54.028901 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bed0406-d752-4690-901a-aff94eb0aa01 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:54.029706 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bed0406-d752-4690-901a-aff94eb0aa01 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:54.030079 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bed0406-d752-4690-901a-aff94eb0aa01 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:54.059894 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bed0406-d752-4690-901a-aff94eb0aa01 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:54.060339 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bed0406-d752-4690-901a-aff94eb0aa01 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:54.060789 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.objects.instance [None req-9bed0406-d752-4690-901a-aff94eb0aa01 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lazy-loading 'fault' on Instance uuid d6b4458c-7b40-46f8-9bc9-c3304b3f4687 {{(pid=120899) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 03:40:54.077400 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-02193a54-f059-4013-9589-ab199705e03e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:54.078000 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-02193a54-f059-4013-9589-ab199705e03e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:54.083816 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-02193a54-f059-4013-9589-ab199705e03e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:54.084270 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-02193a54-f059-4013-9589-ab199705e03e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:54.085172 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-02193a54-f059-4013-9589-ab199705e03e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:54.085714 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-02193a54-f059-4013-9589-ab199705e03e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:54.101801 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-9bed0406-d752-4690-901a-aff94eb0aa01 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:54.109576 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9bed0406-d752-4690-901a-aff94eb0aa01 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 200 len: 1308 microversion: 2.1 time: 0.091675 Oct 15 03:40:54.110712 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 191/364] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:54 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:54.215900 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-02193a54-f059-4013-9589-ab199705e03e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:54.223498 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-02193a54-f059-4013-9589-ab199705e03e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:54.225036 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-02193a54-f059-4013-9589-ab199705e03e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:54.226166 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-02193a54-f059-4013-9589-ab199705e03e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.152483 Oct 15 03:40:54.227217 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 174/365] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:54 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:40:55.026835 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4d6071f1-5ff2-49a0-9296-8a414fc9e3ab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:55.027562 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4d6071f1-5ff2-49a0-9296-8a414fc9e3ab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:55.033360 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4d6071f1-5ff2-49a0-9296-8a414fc9e3ab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:55.033805 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4d6071f1-5ff2-49a0-9296-8a414fc9e3ab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:55.034563 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4d6071f1-5ff2-49a0-9296-8a414fc9e3ab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:55.034996 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4d6071f1-5ff2-49a0-9296-8a414fc9e3ab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:55.127040 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9ce56f19-ee37-4fba-ad83-ed58d123a317 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:55.127791 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9ce56f19-ee37-4fba-ad83-ed58d123a317 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: d6b4458c-7b40-46f8-9bc9-c3304b3f4687] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:55.133919 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9ce56f19-ee37-4fba-ad83-ed58d123a317 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:55.134358 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9ce56f19-ee37-4fba-ad83-ed58d123a317 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:55.135110 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9ce56f19-ee37-4fba-ad83-ed58d123a317 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:55.135539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9ce56f19-ee37-4fba-ad83-ed58d123a317 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:55.149449 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.wsgi [None req-9ce56f19-ee37-4fba-ad83-ed58d123a317 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] HTTP exception thrown: Instance d6b4458c-7b40-46f8-9bc9-c3304b3f4687 could not be found. Oct 15 03:40:55.150021 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9ce56f19-ee37-4fba-ad83-ed58d123a317 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Returning 404 to user: Instance d6b4458c-7b40-46f8-9bc9-c3304b3f4687 could not be found. {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:40:55.150821 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9ce56f19-ee37-4fba-ad83-ed58d123a317 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687" status: 404 len: 111 microversion: 2.1 time: 0.027458 Oct 15 03:40:55.151625 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 175/366] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:55 2021] GET /compute/v2.1/servers/d6b4458c-7b40-46f8-9bc9-c3304b3f4687 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 03:40:55.155389 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4d6071f1-5ff2-49a0-9296-8a414fc9e3ab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:55.163044 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4d6071f1-5ff2-49a0-9296-8a414fc9e3ab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.140331 Oct 15 03:40:55.163744 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 192/367] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:55 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:55.254549 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-414d092c-90bd-4842-ad3e-ebbd2cecfec3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:55.256127 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-414d092c-90bd-4842-ad3e-ebbd2cecfec3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:55.263404 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-414d092c-90bd-4842-ad3e-ebbd2cecfec3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:55.263890 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-414d092c-90bd-4842-ad3e-ebbd2cecfec3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:55.264659 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-414d092c-90bd-4842-ad3e-ebbd2cecfec3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:55.265087 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-414d092c-90bd-4842-ad3e-ebbd2cecfec3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:55.385504 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-414d092c-90bd-4842-ad3e-ebbd2cecfec3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:55.393055 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-414d092c-90bd-4842-ad3e-ebbd2cecfec3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:55.394530 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-414d092c-90bd-4842-ad3e-ebbd2cecfec3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:55.395667 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-414d092c-90bd-4842-ad3e-ebbd2cecfec3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.153344 Oct 15 03:40:55.396230 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 176/368] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:55 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:56.179715 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0464459c-4149-45ee-996e-06929327bc11 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:56.180271 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0464459c-4149-45ee-996e-06929327bc11 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:56.185977 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0464459c-4149-45ee-996e-06929327bc11 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:56.186424 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0464459c-4149-45ee-996e-06929327bc11 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:56.187180 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0464459c-4149-45ee-996e-06929327bc11 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:56.187614 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0464459c-4149-45ee-996e-06929327bc11 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:56.286804 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6d4e84db-45b3-4b48-acb9-a0fc1ad9a228 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:56.288199 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6d4e84db-45b3-4b48-acb9-a0fc1ad9a228 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:56.295661 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6d4e84db-45b3-4b48-acb9-a0fc1ad9a228 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:56.296260 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6d4e84db-45b3-4b48-acb9-a0fc1ad9a228 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:56.297109 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6d4e84db-45b3-4b48-acb9-a0fc1ad9a228 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:56.297806 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6d4e84db-45b3-4b48-acb9-a0fc1ad9a228 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:56.314870 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0464459c-4149-45ee-996e-06929327bc11 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:56.322625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0464459c-4149-45ee-996e-06929327bc11 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.146693 Oct 15 03:40:56.323192 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 193/369] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:56 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:56.325230 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6d4e84db-45b3-4b48-acb9-a0fc1ad9a228 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Going to try to terminate instance {{(pid=120897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 15 03:40:56.394832 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6d4e84db-45b3-4b48-acb9-a0fc1ad9a228 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "DELETE /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 204 len: 0 microversion: 2.1 time: 0.111556 Oct 15 03:40:56.395379 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 177/370] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 03:40:56 2021] DELETE /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 15 03:40:56.405581 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f7766949-4268-40a3-ad11-cc391bca5190 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:56.406203 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f7766949-4268-40a3-ad11-cc391bca5190 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:56.411976 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f7766949-4268-40a3-ad11-cc391bca5190 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:56.412429 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f7766949-4268-40a3-ad11-cc391bca5190 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:56.413198 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f7766949-4268-40a3-ad11-cc391bca5190 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:56.413296 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-18026d4a-2af1-49bb-930d-c90261a78498 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:56.413640 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f7766949-4268-40a3-ad11-cc391bca5190 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:56.414033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-18026d4a-2af1-49bb-930d-c90261a78498 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:56.419738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18026d4a-2af1-49bb-930d-c90261a78498 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:56.420189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18026d4a-2af1-49bb-930d-c90261a78498 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:56.420979 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18026d4a-2af1-49bb-930d-c90261a78498 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:56.421412 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18026d4a-2af1-49bb-930d-c90261a78498 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:56.597220 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f7766949-4268-40a3-ad11-cc391bca5190 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:56.599784 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-18026d4a-2af1-49bb-930d-c90261a78498 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:56.604818 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f7766949-4268-40a3-ad11-cc391bca5190 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1514 microversion: 2.1 time: 0.204563 Oct 15 03:40:56.605493 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 194/371] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:56 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:40:56.611604 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-18026d4a-2af1-49bb-930d-c90261a78498 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:56.613807 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-18026d4a-2af1-49bb-930d-c90261a78498 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:56.615396 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-18026d4a-2af1-49bb-930d-c90261a78498 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.206036 Oct 15 03:40:56.615970 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 178/372] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:56 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:40:57.343202 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-482e657a-bfe1-44f5-9b6d-0addeae14ee4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:57.343827 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-482e657a-bfe1-44f5-9b6d-0addeae14ee4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:57.349592 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-482e657a-bfe1-44f5-9b6d-0addeae14ee4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:57.350028 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-482e657a-bfe1-44f5-9b6d-0addeae14ee4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:57.350776 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-482e657a-bfe1-44f5-9b6d-0addeae14ee4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:57.351721 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-482e657a-bfe1-44f5-9b6d-0addeae14ee4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:57.472606 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-482e657a-bfe1-44f5-9b6d-0addeae14ee4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:57.480406 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-482e657a-bfe1-44f5-9b6d-0addeae14ee4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.140840 Oct 15 03:40:57.480977 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 195/373] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:57 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:57.623285 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3024720d-0e06-4474-989c-5ff4a4c03935 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:57.623849 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3024720d-0e06-4474-989c-5ff4a4c03935 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:57.629658 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3024720d-0e06-4474-989c-5ff4a4c03935 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:57.630104 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3024720d-0e06-4474-989c-5ff4a4c03935 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:57.630859 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3024720d-0e06-4474-989c-5ff4a4c03935 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:57.631290 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3024720d-0e06-4474-989c-5ff4a4c03935 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:57.632502 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-dbf01742-97f5-46fc-9751-8c35c5ca84cd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:57.633142 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-dbf01742-97f5-46fc-9751-8c35c5ca84cd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:57.638752 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dbf01742-97f5-46fc-9751-8c35c5ca84cd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:57.639204 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dbf01742-97f5-46fc-9751-8c35c5ca84cd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:57.639997 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dbf01742-97f5-46fc-9751-8c35c5ca84cd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:57.640437 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dbf01742-97f5-46fc-9751-8c35c5ca84cd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:57.801874 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-dbf01742-97f5-46fc-9751-8c35c5ca84cd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:57.806425 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3024720d-0e06-4474-989c-5ff4a4c03935 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:57.809921 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-dbf01742-97f5-46fc-9751-8c35c5ca84cd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:57.811558 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-dbf01742-97f5-46fc-9751-8c35c5ca84cd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:57.812847 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-dbf01742-97f5-46fc-9751-8c35c5ca84cd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.183962 Oct 15 03:40:57.817675 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 196/374] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:57 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:40:57.817862 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3024720d-0e06-4474-989c-5ff4a4c03935 tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1514 microversion: 2.1 time: 0.194582 Oct 15 03:40:57.817862 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 179/375] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:57 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:58.498112 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1edd83dc-e307-4626-b649-c6be38e62e93 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:58.498756 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1edd83dc-e307-4626-b649-c6be38e62e93 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:58.504952 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1edd83dc-e307-4626-b649-c6be38e62e93 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:58.505410 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1edd83dc-e307-4626-b649-c6be38e62e93 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:58.506184 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1edd83dc-e307-4626-b649-c6be38e62e93 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:58.506619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1edd83dc-e307-4626-b649-c6be38e62e93 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:58.635882 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-1edd83dc-e307-4626-b649-c6be38e62e93 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:58.643718 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1edd83dc-e307-4626-b649-c6be38e62e93 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.149768 Oct 15 03:40:58.644339 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 197/376] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:58 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:58.724103 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-03342884-d3e7-4cbd-a001-19ad348c7e6d req-2a89ec1b-54c6-40c4-a4e1-ef6254090ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "612f42d0-d719-4a5f-bcb9-029c18112f69", "name": "network-vif-deleted", "tag": "230afb5a-d538-4679-93eb-d7a4ac314ae4"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:40:58.725657 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:40:58.725657 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:40:58.732962 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-03342884-d3e7-4cbd-a001-19ad348c7e6d req-2a89ec1b-54c6-40c4-a4e1-ef6254090ea7 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:58.733403 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-03342884-d3e7-4cbd-a001-19ad348c7e6d req-2a89ec1b-54c6-40c4-a4e1-ef6254090ea7 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:58.744652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-03342884-d3e7-4cbd-a001-19ad348c7e6d req-2a89ec1b-54c6-40c4-a4e1-ef6254090ea7 service nova] Creating event network-vif-deleted:230afb5a-d538-4679-93eb-d7a4ac314ae4 for instance 612f42d0-d719-4a5f-bcb9-029c18112f69 on hv-cinder-81410 Oct 15 03:40:58.749588 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-03342884-d3e7-4cbd-a001-19ad348c7e6d req-2a89ec1b-54c6-40c4-a4e1-ef6254090ea7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028925 Oct 15 03:40:58.750406 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 180/377] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:40:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:40:58.831708 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3cb61229-081b-432f-a577-580dcfd56a0e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:58.832521 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3cb61229-081b-432f-a577-580dcfd56a0e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:58.837818 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-13afef5c-5293-4ead-b90b-39402b099ecb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:58.839279 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-13afef5c-5293-4ead-b90b-39402b099ecb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:58.839402 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3cb61229-081b-432f-a577-580dcfd56a0e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:58.839810 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3cb61229-081b-432f-a577-580dcfd56a0e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:58.840596 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3cb61229-081b-432f-a577-580dcfd56a0e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:58.841029 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3cb61229-081b-432f-a577-580dcfd56a0e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:58.849234 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13afef5c-5293-4ead-b90b-39402b099ecb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:58.849773 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13afef5c-5293-4ead-b90b-39402b099ecb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:58.850622 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13afef5c-5293-4ead-b90b-39402b099ecb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:58.851117 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13afef5c-5293-4ead-b90b-39402b099ecb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:58.883357 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13afef5c-5293-4ead-b90b-39402b099ecb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:58.884426 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13afef5c-5293-4ead-b90b-39402b099ecb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:58.885225 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.objects.instance [None req-13afef5c-5293-4ead-b90b-39402b099ecb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lazy-loading 'fault' on Instance uuid 612f42d0-d719-4a5f-bcb9-029c18112f69 {{(pid=120899) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 03:40:58.939411 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-13afef5c-5293-4ead-b90b-39402b099ecb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1f3db9250cc4edbacb392d5d0d18e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca42958bf634cd8be46887a2580f4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:58.950295 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-13afef5c-5293-4ead-b90b-39402b099ecb tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 200 len: 1307 microversion: 2.1 time: 0.122674 Oct 15 03:40:58.951270 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 198/378] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:58 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 1307 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:58.998848 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3cb61229-081b-432f-a577-580dcfd56a0e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:59.006479 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3cb61229-081b-432f-a577-580dcfd56a0e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:59.008033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3cb61229-081b-432f-a577-580dcfd56a0e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:59.009177 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3cb61229-081b-432f-a577-580dcfd56a0e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.181506 Oct 15 03:40:59.009729 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 181/379] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:40:58 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:40:59.660803 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6dd0cffe-01d9-4d9a-bfb2-35c2a73260a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:59.661344 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6dd0cffe-01d9-4d9a-bfb2-35c2a73260a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:59.667112 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6dd0cffe-01d9-4d9a-bfb2-35c2a73260a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:59.667553 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6dd0cffe-01d9-4d9a-bfb2-35c2a73260a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:59.668745 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6dd0cffe-01d9-4d9a-bfb2-35c2a73260a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:59.669182 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6dd0cffe-01d9-4d9a-bfb2-35c2a73260a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:59.794745 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6dd0cffe-01d9-4d9a-bfb2-35c2a73260a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:40:59.802514 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6dd0cffe-01d9-4d9a-bfb2-35c2a73260a3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.145723 Oct 15 03:40:59.803074 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 199/380] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:59 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:40:59.966156 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1c626fdb-3c74-4112-bd55-82ef308f7c7f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:40:59.966766 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1c626fdb-3c74-4112-bd55-82ef308f7c7f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] [instance: 612f42d0-d719-4a5f-bcb9-029c18112f69] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:40:59.973568 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1c626fdb-3c74-4112-bd55-82ef308f7c7f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:59.974089 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1c626fdb-3c74-4112-bd55-82ef308f7c7f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:59.974751 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1c626fdb-3c74-4112-bd55-82ef308f7c7f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:40:59.975182 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1c626fdb-3c74-4112-bd55-82ef308f7c7f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:40:59.988309 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.wsgi [None req-1c626fdb-3c74-4112-bd55-82ef308f7c7f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] HTTP exception thrown: Instance 612f42d0-d719-4a5f-bcb9-029c18112f69 could not be found. Oct 15 03:40:59.988904 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1c626fdb-3c74-4112-bd55-82ef308f7c7f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] Returning 404 to user: Instance 612f42d0-d719-4a5f-bcb9-029c18112f69 could not be found. {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:40:59.989891 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1c626fdb-3c74-4112-bd55-82ef308f7c7f tempest-AttachVolumeNegativeTest-2054439278 tempest-AttachVolumeNegativeTest-2054439278-project] 10.222.0.30 "GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69" status: 404 len: 111 microversion: 2.1 time: 0.027425 Oct 15 03:40:59.990280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 182/381] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:40:59 2021] GET /compute/v2.1/servers/612f42d0-d719-4a5f-bcb9-029c18112f69 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 03:41:00.026189 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3909aef7-d0fb-4071-adc3-3d3e083ce138 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:00.026819 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3909aef7-d0fb-4071-adc3-3d3e083ce138 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:00.032820 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3909aef7-d0fb-4071-adc3-3d3e083ce138 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:00.033555 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3909aef7-d0fb-4071-adc3-3d3e083ce138 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:00.034025 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3909aef7-d0fb-4071-adc3-3d3e083ce138 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:00.034453 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3909aef7-d0fb-4071-adc3-3d3e083ce138 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:00.175390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3909aef7-d0fb-4071-adc3-3d3e083ce138 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:00.184066 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3909aef7-d0fb-4071-adc3-3d3e083ce138 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:00.185713 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3909aef7-d0fb-4071-adc3-3d3e083ce138 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:00.186905 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3909aef7-d0fb-4071-adc3-3d3e083ce138 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.164514 Oct 15 03:41:00.187494 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 200/382] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:00 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:00.820747 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5af6b39d-cc63-470a-95c8-2922f9bea561 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:00.821467 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5af6b39d-cc63-470a-95c8-2922f9bea561 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:00.827880 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5af6b39d-cc63-470a-95c8-2922f9bea561 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:00.828362 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5af6b39d-cc63-470a-95c8-2922f9bea561 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:00.829276 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5af6b39d-cc63-470a-95c8-2922f9bea561 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:00.829790 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5af6b39d-cc63-470a-95c8-2922f9bea561 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:00.970043 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5af6b39d-cc63-470a-95c8-2922f9bea561 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:00.977117 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5af6b39d-cc63-470a-95c8-2922f9bea561 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.161108 Oct 15 03:41:00.977661 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 183/383] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:00 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:01.204677 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-953c6a0e-9c9c-48f7-af72-4077d257b6cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:01.205291 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-953c6a0e-9c9c-48f7-af72-4077d257b6cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:01.211009 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-953c6a0e-9c9c-48f7-af72-4077d257b6cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:01.211460 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-953c6a0e-9c9c-48f7-af72-4077d257b6cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:01.212286 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-953c6a0e-9c9c-48f7-af72-4077d257b6cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:01.212743 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-953c6a0e-9c9c-48f7-af72-4077d257b6cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:01.347391 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-953c6a0e-9c9c-48f7-af72-4077d257b6cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:01.355073 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-953c6a0e-9c9c-48f7-af72-4077d257b6cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:01.359486 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-953c6a0e-9c9c-48f7-af72-4077d257b6cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:01.360729 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-953c6a0e-9c9c-48f7-af72-4077d257b6cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.159784 Oct 15 03:41:01.361270 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 201/384] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:01 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:01.993105 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2cffb86b-3118-4c41-aa32-7f79eb1ed546 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:01.993738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2cffb86b-3118-4c41-aa32-7f79eb1ed546 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:01.999792 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2cffb86b-3118-4c41-aa32-7f79eb1ed546 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:02.000241 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2cffb86b-3118-4c41-aa32-7f79eb1ed546 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:02.000996 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2cffb86b-3118-4c41-aa32-7f79eb1ed546 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:02.001432 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2cffb86b-3118-4c41-aa32-7f79eb1ed546 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:02.140934 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2cffb86b-3118-4c41-aa32-7f79eb1ed546 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:02.149281 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2cffb86b-3118-4c41-aa32-7f79eb1ed546 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.159842 Oct 15 03:41:02.149897 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 184/385] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:01 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:02.378199 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-536d2d93-3a4e-42d3-8079-d4c9b2366f8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:02.378796 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-536d2d93-3a4e-42d3-8079-d4c9b2366f8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:02.385382 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-536d2d93-3a4e-42d3-8079-d4c9b2366f8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:02.385826 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-536d2d93-3a4e-42d3-8079-d4c9b2366f8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:02.386578 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-536d2d93-3a4e-42d3-8079-d4c9b2366f8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:02.387002 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-536d2d93-3a4e-42d3-8079-d4c9b2366f8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:02.507125 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-536d2d93-3a4e-42d3-8079-d4c9b2366f8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:02.523721 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-536d2d93-3a4e-42d3-8079-d4c9b2366f8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:02.525221 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-536d2d93-3a4e-42d3-8079-d4c9b2366f8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:02.526400 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-536d2d93-3a4e-42d3-8079-d4c9b2366f8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.152018 Oct 15 03:41:02.526981 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 202/386] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:02 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:03.166129 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f492b13d-9e33-4784-a7fc-aac54a93d952 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:03.167426 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f492b13d-9e33-4784-a7fc-aac54a93d952 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:03.173181 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f492b13d-9e33-4784-a7fc-aac54a93d952 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:03.173621 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f492b13d-9e33-4784-a7fc-aac54a93d952 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:03.174380 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f492b13d-9e33-4784-a7fc-aac54a93d952 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:03.176048 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f492b13d-9e33-4784-a7fc-aac54a93d952 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:03.312207 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f492b13d-9e33-4784-a7fc-aac54a93d952 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:03.320554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f492b13d-9e33-4784-a7fc-aac54a93d952 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.157626 Oct 15 03:41:03.321153 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 185/387] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:03 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:03.544375 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-cc32e123-95b8-40bb-80f2-11f9726204f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:03.544932 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-cc32e123-95b8-40bb-80f2-11f9726204f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:03.551484 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc32e123-95b8-40bb-80f2-11f9726204f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:03.552075 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc32e123-95b8-40bb-80f2-11f9726204f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:03.552922 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc32e123-95b8-40bb-80f2-11f9726204f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:03.553488 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc32e123-95b8-40bb-80f2-11f9726204f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:03.679231 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-cc32e123-95b8-40bb-80f2-11f9726204f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:03.687012 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-cc32e123-95b8-40bb-80f2-11f9726204f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:03.688681 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-cc32e123-95b8-40bb-80f2-11f9726204f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:03.689821 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-cc32e123-95b8-40bb-80f2-11f9726204f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1738 microversion: 2.20 time: 0.149358 Oct 15 03:41:03.690362 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 203/388] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:03 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:04.337480 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-03287880-0bb0-453a-93c4-5815923f35ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:04.338438 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-03287880-0bb0-453a-93c4-5815923f35ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:04.344782 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-03287880-0bb0-453a-93c4-5815923f35ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:04.345485 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-03287880-0bb0-453a-93c4-5815923f35ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:04.346580 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-03287880-0bb0-453a-93c4-5815923f35ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:04.347354 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-03287880-0bb0-453a-93c4-5815923f35ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:04.494054 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-03287880-0bb0-453a-93c4-5815923f35ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:04.502085 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-03287880-0bb0-453a-93c4-5815923f35ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.168502 Oct 15 03:41:04.502827 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 186/389] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:04 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:04.707426 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d9b0f906-d791-4941-97c1-9bc5f86dfb2f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:04.708945 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d9b0f906-d791-4941-97c1-9bc5f86dfb2f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:04.716889 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d9b0f906-d791-4941-97c1-9bc5f86dfb2f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:04.717336 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d9b0f906-d791-4941-97c1-9bc5f86dfb2f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:04.718168 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d9b0f906-d791-4941-97c1-9bc5f86dfb2f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:04.718618 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d9b0f906-d791-4941-97c1-9bc5f86dfb2f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:04.897404 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d9b0f906-d791-4941-97c1-9bc5f86dfb2f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:04.905864 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d9b0f906-d791-4941-97c1-9bc5f86dfb2f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:04.907445 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d9b0f906-d791-4941-97c1-9bc5f86dfb2f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:04.908710 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d9b0f906-d791-4941-97c1-9bc5f86dfb2f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1720 microversion: 2.20 time: 0.205420 Oct 15 03:41:04.909343 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 204/390] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:04 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1720 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:05.518281 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6b993584-388a-46d9-958e-b9477010fa79 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:05.518910 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6b993584-388a-46d9-958e-b9477010fa79 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:05.525462 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6b993584-388a-46d9-958e-b9477010fa79 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:05.526108 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6b993584-388a-46d9-958e-b9477010fa79 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:05.527033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6b993584-388a-46d9-958e-b9477010fa79 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:05.527625 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6b993584-388a-46d9-958e-b9477010fa79 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:05.654292 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6b993584-388a-46d9-958e-b9477010fa79 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:05.662140 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6b993584-388a-46d9-958e-b9477010fa79 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1522 microversion: 2.1 time: 0.148001 Oct 15 03:41:05.662698 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 187/391] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:05 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:05.927203 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1fbec1d3-30ce-4268-b02a-c797b429a690 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:05.927805 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1fbec1d3-30ce-4268-b02a-c797b429a690 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:05.933439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1fbec1d3-30ce-4268-b02a-c797b429a690 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:05.933891 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1fbec1d3-30ce-4268-b02a-c797b429a690 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:05.934659 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1fbec1d3-30ce-4268-b02a-c797b429a690 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:05.935096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1fbec1d3-30ce-4268-b02a-c797b429a690 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:06.073401 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-1fbec1d3-30ce-4268-b02a-c797b429a690 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:06.081420 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-1fbec1d3-30ce-4268-b02a-c797b429a690 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:06.082890 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-1fbec1d3-30ce-4268-b02a-c797b429a690 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:06.084170 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1fbec1d3-30ce-4268-b02a-c797b429a690 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1720 microversion: 2.20 time: 0.160832 Oct 15 03:41:06.084720 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 205/392] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:05 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:06.678460 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-aeb12226-c12c-4ebf-a90d-0e89e35e1a58 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:06.679070 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-aeb12226-c12c-4ebf-a90d-0e89e35e1a58 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:06.684954 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aeb12226-c12c-4ebf-a90d-0e89e35e1a58 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:06.685417 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aeb12226-c12c-4ebf-a90d-0e89e35e1a58 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:06.686194 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aeb12226-c12c-4ebf-a90d-0e89e35e1a58 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:06.686656 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aeb12226-c12c-4ebf-a90d-0e89e35e1a58 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:06.813222 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-aeb12226-c12c-4ebf-a90d-0e89e35e1a58 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:06.821659 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-aeb12226-c12c-4ebf-a90d-0e89e35e1a58 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1502 microversion: 2.1 time: 0.146823 Oct 15 03:41:06.822205 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 188/393] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:06 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:06.837423 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-24b769c1-dff5-41d4-8e00-c862a628fa68 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:06.838070 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-24b769c1-dff5-41d4-8e00-c862a628fa68 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:06.843970 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-24b769c1-dff5-41d4-8e00-c862a628fa68 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:06.844419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-24b769c1-dff5-41d4-8e00-c862a628fa68 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:06.845184 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-24b769c1-dff5-41d4-8e00-c862a628fa68 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:06.845613 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-24b769c1-dff5-41d4-8e00-c862a628fa68 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:06.967203 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-24b769c1-dff5-41d4-8e00-c862a628fa68 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:06.974433 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-24b769c1-dff5-41d4-8e00-c862a628fa68 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1516 microversion: 2.1 time: 0.140718 Oct 15 03:41:06.975007 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 206/394] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:06 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1516 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:07.102714 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b529242a-c873-4054-9d12-b2ee3973f874 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:07.103319 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b529242a-c873-4054-9d12-b2ee3973f874 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:07.109250 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b529242a-c873-4054-9d12-b2ee3973f874 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:07.109670 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b529242a-c873-4054-9d12-b2ee3973f874 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:07.110432 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b529242a-c873-4054-9d12-b2ee3973f874 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:07.110866 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b529242a-c873-4054-9d12-b2ee3973f874 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:07.251533 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b529242a-c873-4054-9d12-b2ee3973f874 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:07.260112 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b529242a-c873-4054-9d12-b2ee3973f874 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:07.261616 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b529242a-c873-4054-9d12-b2ee3973f874 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:07.262773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b529242a-c873-4054-9d12-b2ee3973f874 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1720 microversion: 2.20 time: 0.164287 Oct 15 03:41:07.263312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 189/395] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:07 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:07.300088 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-b4755738-9124-49ce-88a8-c90b668ce4e8 req-a4586464-cd12-406d-aadb-bf8948dbb274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3594fddd-dbb7-4731-8f30-b3512198e1a9", "name": "network-vif-unplugged", "status": "completed", "tag": "0ebbb249-fedc-46b3-94a7-8e70531c6d22"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:41:07.301727 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:41:07.301727 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 03:41:07.331589 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-b4755738-9124-49ce-88a8-c90b668ce4e8 req-a4586464-cd12-406d-aadb-bf8948dbb274 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:07.332117 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-b4755738-9124-49ce-88a8-c90b668ce4e8 req-a4586464-cd12-406d-aadb-bf8948dbb274 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:07.353672 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-b4755738-9124-49ce-88a8-c90b668ce4e8 req-a4586464-cd12-406d-aadb-bf8948dbb274 service nova] Creating event network-vif-unplugged:0ebbb249-fedc-46b3-94a7-8e70531c6d22 for instance 3594fddd-dbb7-4731-8f30-b3512198e1a9 on hv-cinder-81410 Oct 15 03:41:07.360213 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-b4755738-9124-49ce-88a8-c90b668ce4e8 req-a4586464-cd12-406d-aadb-bf8948dbb274 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063488 Oct 15 03:41:07.362263 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 207/396] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:41:07 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:41:08.280216 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0c638b06-2bd6-405d-9414-0d99999afda5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:08.280827 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0c638b06-2bd6-405d-9414-0d99999afda5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:08.286519 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0c638b06-2bd6-405d-9414-0d99999afda5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:08.286971 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0c638b06-2bd6-405d-9414-0d99999afda5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:08.287767 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0c638b06-2bd6-405d-9414-0d99999afda5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:08.288201 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0c638b06-2bd6-405d-9414-0d99999afda5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:08.389222 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fd1bdc2e-fff9-4042-9137-7da50abeed09 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:41:08.390448 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fd1bdc2e-fff9-4042-9137-7da50abeed09 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:08.396665 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd1bdc2e-fff9-4042-9137-7da50abeed09 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:08.397113 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd1bdc2e-fff9-4042-9137-7da50abeed09 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:08.398814 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd1bdc2e-fff9-4042-9137-7da50abeed09 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:08.399143 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd1bdc2e-fff9-4042-9137-7da50abeed09 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:08.419419 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0c638b06-2bd6-405d-9414-0d99999afda5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:08.428082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0c638b06-2bd6-405d-9414-0d99999afda5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:08.430331 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0c638b06-2bd6-405d-9414-0d99999afda5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:08.431715 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0c638b06-2bd6-405d-9414-0d99999afda5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1663 microversion: 2.20 time: 0.155227 Oct 15 03:41:08.432771 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 190/397] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:08 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:08.448132 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.objects.instance [None req-fd1bdc2e-fff9-4042-9137-7da50abeed09 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lazy-loading 'flavor' on Instance uuid c33f5b74-7b6d-44da-870a-cff6c079605d {{(pid=120899) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 03:41:08.449626 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c1de5222-f8d2-4ec4-b453-4cf72a592e86 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7676192-f05b-4d29-8bf5-ed60aecf22a3"}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:41:08.451842 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c1de5222-f8d2-4ec4-b453-4cf72a592e86 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:08.462433 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c1de5222-f8d2-4ec4-b453-4cf72a592e86 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:08.464592 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c1de5222-f8d2-4ec4-b453-4cf72a592e86 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:08.466543 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c1de5222-f8d2-4ec4-b453-4cf72a592e86 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:08.467165 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c1de5222-f8d2-4ec4-b453-4cf72a592e86 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:08.572224 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fd1bdc2e-fff9-4042-9137-7da50abeed09 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "POST /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/action" status: 200 len: 32 microversion: 2.1 time: 0.187434 Oct 15 03:41:08.573489 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 208/398] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 03:41:08 2021] POST /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 15 03:41:08.593471 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7d063a71-143f-4f23-ab14-58a4fd00fb49 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:08.594335 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7d063a71-143f-4f23-ab14-58a4fd00fb49 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:08.600981 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7d063a71-143f-4f23-ab14-58a4fd00fb49 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:08.602005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7d063a71-143f-4f23-ab14-58a4fd00fb49 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:08.602722 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7d063a71-143f-4f23-ab14-58a4fd00fb49 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:08.603157 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7d063a71-143f-4f23-ab14-58a4fd00fb49 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:08.802657 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c1de5222-f8d2-4ec4-b453-4cf72a592e86 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.356718 Oct 15 03:41:08.806628 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 191/399] 10.222.0.30 () {62 vars in 1363 bytes} [Fri Oct 15 03:41:08 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 188 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:41:08.874394 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7d063a71-143f-4f23-ab14-58a4fd00fb49 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:08.882826 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7d063a71-143f-4f23-ab14-58a4fd00fb49 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.293759 Oct 15 03:41:08.883594 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 209/400] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:08 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:08.913588 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-931a690d-309d-4019-88f4-f5a11b8a756a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:41:08.914252 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-931a690d-309d-4019-88f4-f5a11b8a756a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:08.919994 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-931a690d-309d-4019-88f4-f5a11b8a756a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:08.920435 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-931a690d-309d-4019-88f4-f5a11b8a756a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:08.921232 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-931a690d-309d-4019-88f4-f5a11b8a756a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:08.921665 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-931a690d-309d-4019-88f4-f5a11b8a756a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:09.027333 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-931a690d-309d-4019-88f4-f5a11b8a756a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 202 len: 0 microversion: 2.20 time: 0.117838 Oct 15 03:41:09.028636 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 192/401] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:41:08 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 15 03:41:09.037684 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-52c36048-13a6-4fc4-8481-18f5f87c7e77 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:09.038318 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-52c36048-13a6-4fc4-8481-18f5f87c7e77 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:09.045345 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-52c36048-13a6-4fc4-8481-18f5f87c7e77 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:09.045804 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-52c36048-13a6-4fc4-8481-18f5f87c7e77 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:09.046589 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-52c36048-13a6-4fc4-8481-18f5f87c7e77 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:09.047081 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-52c36048-13a6-4fc4-8481-18f5f87c7e77 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:09.300748 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-52c36048-13a6-4fc4-8481-18f5f87c7e77 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:09.312837 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-52c36048-13a6-4fc4-8481-18f5f87c7e77 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:09.314514 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-52c36048-13a6-4fc4-8481-18f5f87c7e77 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:09.315998 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-52c36048-13a6-4fc4-8481-18f5f87c7e77 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1749 microversion: 2.20 time: 0.283308 Oct 15 03:41:09.316636 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 210/402] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:09 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1749 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:09.900605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-75425fe1-4637-427d-9d21-79dfc912b3a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:09.901490 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-75425fe1-4637-427d-9d21-79dfc912b3a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:09.907739 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-75425fe1-4637-427d-9d21-79dfc912b3a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:09.908277 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-75425fe1-4637-427d-9d21-79dfc912b3a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:09.909144 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-75425fe1-4637-427d-9d21-79dfc912b3a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:09.909585 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-75425fe1-4637-427d-9d21-79dfc912b3a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:10.040936 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-75425fe1-4637-427d-9d21-79dfc912b3a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:10.048582 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-75425fe1-4637-427d-9d21-79dfc912b3a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.152472 Oct 15 03:41:10.049310 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 193/403] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:09 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:10.382740 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-332763e4-f2c8-44cb-81a4-68f2fffcaabd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:10.384146 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-332763e4-f2c8-44cb-81a4-68f2fffcaabd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:10.390807 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-332763e4-f2c8-44cb-81a4-68f2fffcaabd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:10.391425 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-332763e4-f2c8-44cb-81a4-68f2fffcaabd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:10.392500 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-332763e4-f2c8-44cb-81a4-68f2fffcaabd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:10.393002 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-332763e4-f2c8-44cb-81a4-68f2fffcaabd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:10.527615 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-332763e4-f2c8-44cb-81a4-68f2fffcaabd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:10.536364 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-332763e4-f2c8-44cb-81a4-68f2fffcaabd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:10.537840 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-332763e4-f2c8-44cb-81a4-68f2fffcaabd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:10.539660 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-332763e4-f2c8-44cb-81a4-68f2fffcaabd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1751 microversion: 2.20 time: 0.162680 Oct 15 03:41:10.540402 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 211/404] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:10 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:10.848084 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-81e8c6aa-f63a-434d-82ef-c0f4887095f8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-921762796", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-878614080", "security_groups": [{"name": "tempest-secgroup-smoke-749950884"}], "block_device_mapping_v2": [{"uuid": "59826191-e1c1-44b2-93af-a4c16173150d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0006c2d5-d608-4255-8781-4a519d11899d"}]}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:41:10.955491 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.network.neutron [None req-81e8c6aa-f63a-434d-82ef-c0f4887095f8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] validate_networks() for [('0006c2d5-d608-4255-8781-4a519d11899d', None, None, None, None, None)] {{(pid=120897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 15 03:41:11.065627 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9bc4390d-82fc-4e2a-8ea5-7826c8e7e634 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:11.066610 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9bc4390d-82fc-4e2a-8ea5-7826c8e7e634 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:11.072362 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bc4390d-82fc-4e2a-8ea5-7826c8e7e634 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:11.072818 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bc4390d-82fc-4e2a-8ea5-7826c8e7e634 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:11.073598 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bc4390d-82fc-4e2a-8ea5-7826c8e7e634 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:11.074243 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bc4390d-82fc-4e2a-8ea5-7826c8e7e634 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:11.322599 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-9bc4390d-82fc-4e2a-8ea5-7826c8e7e634 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:11.334509 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9bc4390d-82fc-4e2a-8ea5-7826c8e7e634 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.272565 Oct 15 03:41:11.335085 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 212/405] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:11 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:11.435650 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-81e8c6aa-f63a-434d-82ef-c0f4887095f8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Flavor limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 03:41:11.436107 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-81e8c6aa-f63a-434d-82ef-c0f4887095f8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Image limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 03:41:11.436590 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-81e8c6aa-f63a-434d-82ef-c0f4887095f8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Flavor pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 03:41:11.437029 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-81e8c6aa-f63a-434d-82ef-c0f4887095f8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Image pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 03:41:11.437440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-81e8c6aa-f63a-434d-82ef-c0f4887095f8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 03:41:11.446698 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81e8c6aa-f63a-434d-82ef-c0f4887095f8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:11.447146 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81e8c6aa-f63a-434d-82ef-c0f4887095f8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:11.447981 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81e8c6aa-f63a-434d-82ef-c0f4887095f8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:11.448416 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81e8c6aa-f63a-434d-82ef-c0f4887095f8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:11.465109 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-81e8c6aa-f63a-434d-82ef-c0f4887095f8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Getting quotas for project de088af04e804d909ae6daa141302d4c. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:41:11.469003 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-81e8c6aa-f63a-434d-82ef-c0f4887095f8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Getting quotas for user d1bb22a3461a47e5afeb229038cb4a8d and project de088af04e804d909ae6daa141302d4c. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:41:11.527140 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-81e8c6aa-f63a-434d-82ef-c0f4887095f8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Going to run 1 instances... {{(pid=120897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 15 03:41:11.529457 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-81e8c6aa-f63a-434d-82ef-c0f4887095f8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='59826191-e1c1-44b2-93af-a4c16173150d',volume_size=None,volume_type=None)] {{(pid=120897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 15 03:41:11.560138 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-42eb45db-687e-4cf8-a870-b4daf5c06a92 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:11.560138 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-42eb45db-687e-4cf8-a870-b4daf5c06a92 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:11.566843 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-42eb45db-687e-4cf8-a870-b4daf5c06a92 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:11.567296 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-42eb45db-687e-4cf8-a870-b4daf5c06a92 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:11.568235 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-42eb45db-687e-4cf8-a870-b4daf5c06a92 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:11.568873 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-42eb45db-687e-4cf8-a870-b4daf5c06a92 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:11.688741 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-81e8c6aa-f63a-434d-82ef-c0f4887095f8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.845815 Oct 15 03:41:11.695380 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 194/406] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Oct 15 03:41:10 2021] POST /compute/v2.1/servers => generated 405 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 03:41:11.701338 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3b92bcab-088b-46af-9b03-e1710e39c2a9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:11.702151 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3b92bcab-088b-46af-9b03-e1710e39c2a9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:11.849287 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3b92bcab-088b-46af-9b03-e1710e39c2a9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:11.857087 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3b92bcab-088b-46af-9b03-e1710e39c2a9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1093 microversion: 2.1 time: 0.160420 Oct 15 03:41:11.857861 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 195/407] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:11 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1093 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:11.913607 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-42eb45db-687e-4cf8-a870-b4daf5c06a92 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:11.922879 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-42eb45db-687e-4cf8-a870-b4daf5c06a92 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:11.924779 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-42eb45db-687e-4cf8-a870-b4daf5c06a92 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:11.926431 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-42eb45db-687e-4cf8-a870-b4daf5c06a92 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.371716 Oct 15 03:41:11.927060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 213/408] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:11 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:41:12.351925 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cd8bc73f-4b4c-4177-86c0-6e123824908a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:12.352540 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cd8bc73f-4b4c-4177-86c0-6e123824908a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:12.358485 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd8bc73f-4b4c-4177-86c0-6e123824908a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:12.359023 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd8bc73f-4b4c-4177-86c0-6e123824908a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:12.359837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd8bc73f-4b4c-4177-86c0-6e123824908a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:12.360276 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd8bc73f-4b4c-4177-86c0-6e123824908a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:12.480811 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-cd8bc73f-4b4c-4177-86c0-6e123824908a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:12.487893 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cd8bc73f-4b4c-4177-86c0-6e123824908a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.139636 Oct 15 03:41:12.488654 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 196/409] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:12 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:12.874871 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-12f5e85f-d3af-4784-8f9b-0219435f67d5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:12.878360 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-12f5e85f-d3af-4784-8f9b-0219435f67d5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:12.899336 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-12f5e85f-d3af-4784-8f9b-0219435f67d5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:12.901141 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-12f5e85f-d3af-4784-8f9b-0219435f67d5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:12.904811 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-12f5e85f-d3af-4784-8f9b-0219435f67d5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:12.906770 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-12f5e85f-d3af-4784-8f9b-0219435f67d5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:12.944543 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8199ec79-68bd-416d-a985-7a2d9a82ca6a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:12.945392 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8199ec79-68bd-416d-a985-7a2d9a82ca6a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:12.954914 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8199ec79-68bd-416d-a985-7a2d9a82ca6a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:12.958377 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8199ec79-68bd-416d-a985-7a2d9a82ca6a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:12.966847 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8199ec79-68bd-416d-a985-7a2d9a82ca6a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:12.967557 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8199ec79-68bd-416d-a985-7a2d9a82ca6a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:13.001883 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-12f5e85f-d3af-4784-8f9b-0219435f67d5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:13.012664 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-12f5e85f-d3af-4784-8f9b-0219435f67d5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1209 microversion: 2.1 time: 0.142196 Oct 15 03:41:13.015545 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 214/410] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:12 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1209 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:13.219396 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8199ec79-68bd-416d-a985-7a2d9a82ca6a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:13.230998 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8199ec79-68bd-416d-a985-7a2d9a82ca6a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:13.232543 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8199ec79-68bd-416d-a985-7a2d9a82ca6a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:13.233705 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8199ec79-68bd-416d-a985-7a2d9a82ca6a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.293800 Oct 15 03:41:13.235731 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 197/411] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:12 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:13.506177 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9ac6fea1-5cea-4c40-b8b9-e9a765a95fcc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:13.506783 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9ac6fea1-5cea-4c40-b8b9-e9a765a95fcc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:13.513643 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ac6fea1-5cea-4c40-b8b9-e9a765a95fcc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:13.514094 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ac6fea1-5cea-4c40-b8b9-e9a765a95fcc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:13.514898 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ac6fea1-5cea-4c40-b8b9-e9a765a95fcc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:13.515333 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ac6fea1-5cea-4c40-b8b9-e9a765a95fcc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:13.644641 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-9ac6fea1-5cea-4c40-b8b9-e9a765a95fcc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:13.652682 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9ac6fea1-5cea-4c40-b8b9-e9a765a95fcc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.150149 Oct 15 03:41:13.653254 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 215/412] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:13 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:13.790754 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0846b50b-69b1-4188-aec1-3e7ae3944b4f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-920029089", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1243066600", "security_groups": [{"name": "tempest-secgroup-smoke-1277826771"}], "networks": [{"uuid": "58018b8c-68c0-42dc-aafb-1fd477a37a25"}], "block_device_mapping_v2": [{"uuid": "3f612c19-2690-4fa8-af0e-a0c406dadc8c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:41:13.896452 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.network.neutron [None req-0846b50b-69b1-4188-aec1-3e7ae3944b4f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] validate_networks() for [('58018b8c-68c0-42dc-aafb-1fd477a37a25', None, None, None, None, None)] {{(pid=120897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 15 03:41:13.914794 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8854e76d-258e-4164-870a-2bf2fa00ad59 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b19e4dd-22f3-4c5c-b826-a4abba8952e1", "device": "/dev/sdb"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:41:13.916450 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8854e76d-258e-4164-870a-2bf2fa00ad59 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:13.922508 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8854e76d-258e-4164-870a-2bf2fa00ad59 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:13.923155 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8854e76d-258e-4164-870a-2bf2fa00ad59 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:13.924434 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8854e76d-258e-4164-870a-2bf2fa00ad59 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:13.925165 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8854e76d-258e-4164-870a-2bf2fa00ad59 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:14.291349 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-0846b50b-69b1-4188-aec1-3e7ae3944b4f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Flavor limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 03:41:14.291794 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-0846b50b-69b1-4188-aec1-3e7ae3944b4f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Image limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 03:41:14.292321 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-0846b50b-69b1-4188-aec1-3e7ae3944b4f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Flavor pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 03:41:14.292727 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-0846b50b-69b1-4188-aec1-3e7ae3944b4f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Image pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 03:41:14.293134 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-0846b50b-69b1-4188-aec1-3e7ae3944b4f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 03:41:14.301533 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0846b50b-69b1-4188-aec1-3e7ae3944b4f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:14.301967 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0846b50b-69b1-4188-aec1-3e7ae3944b4f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:14.302754 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0846b50b-69b1-4188-aec1-3e7ae3944b4f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:14.303182 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0846b50b-69b1-4188-aec1-3e7ae3944b4f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:14.321497 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-0846b50b-69b1-4188-aec1-3e7ae3944b4f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Getting quotas for project 2e70b7afa65b45d19294e3a06917a51d. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:41:14.325149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-0846b50b-69b1-4188-aec1-3e7ae3944b4f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Getting quotas for user 8eb29072473e4c198148b0059eb1bc3e and project 2e70b7afa65b45d19294e3a06917a51d. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:41:14.380365 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0846b50b-69b1-4188-aec1-3e7ae3944b4f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Going to run 1 instances... {{(pid=120897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 15 03:41:14.383004 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0846b50b-69b1-4188-aec1-3e7ae3944b4f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f612c19-2690-4fa8-af0e-a0c406dadc8c',volume_size=None,volume_type=None)] {{(pid=120897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 15 03:41:14.510025 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0846b50b-69b1-4188-aec1-3e7ae3944b4f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.723352 Oct 15 03:41:14.510663 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 198/413] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Oct 15 03:41:13 2021] POST /compute/v2.1/servers => generated 406 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 03:41:14.517438 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9d8517b5-e1ac-46cd-9536-1d5c469ec8b9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:14.518321 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9d8517b5-e1ac-46cd-9536-1d5c469ec8b9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:14.525407 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d8517b5-e1ac-46cd-9536-1d5c469ec8b9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:14.525921 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d8517b5-e1ac-46cd-9536-1d5c469ec8b9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:14.526699 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d8517b5-e1ac-46cd-9536-1d5c469ec8b9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:14.527136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d8517b5-e1ac-46cd-9536-1d5c469ec8b9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:14.594848 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9d8517b5-e1ac-46cd-9536-1d5c469ec8b9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:14.604027 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9d8517b5-e1ac-46cd-9536-1d5c469ec8b9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1209 microversion: 2.1 time: 0.092259 Oct 15 03:41:14.604731 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 199/414] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:14 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:14.622057 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9b0ef769-ab86-4e60-a329-8e8e107e820b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:14.622669 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9b0ef769-ab86-4e60-a329-8e8e107e820b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:14.628920 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9b0ef769-ab86-4e60-a329-8e8e107e820b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:14.629543 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9b0ef769-ab86-4e60-a329-8e8e107e820b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:14.630239 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9b0ef769-ab86-4e60-a329-8e8e107e820b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:14.630789 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9b0ef769-ab86-4e60-a329-8e8e107e820b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:14.780574 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9b0ef769-ab86-4e60-a329-8e8e107e820b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:14.789233 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9b0ef769-ab86-4e60-a329-8e8e107e820b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:14.790949 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9b0ef769-ab86-4e60-a329-8e8e107e820b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:14.792973 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9b0ef769-ab86-4e60-a329-8e8e107e820b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.174571 Oct 15 03:41:14.793464 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 200/415] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:14 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:14.798615 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-af5d944f-52cd-4d7e-b0c4-72d00142c6c8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:14.799579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-af5d944f-52cd-4d7e-b0c4-72d00142c6c8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:14.858855 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-af5d944f-52cd-4d7e-b0c4-72d00142c6c8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:14.866917 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-af5d944f-52cd-4d7e-b0c4-72d00142c6c8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1088 microversion: 2.1 time: 0.072027 Oct 15 03:41:14.867475 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 201/416] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:14 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:14.877603 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cfff40ea-dd8f-4fd0-9cd5-6eaa8173e752 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:14.878307 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cfff40ea-dd8f-4fd0-9cd5-6eaa8173e752 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:14.886060 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cfff40ea-dd8f-4fd0-9cd5-6eaa8173e752 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:14.887061 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cfff40ea-dd8f-4fd0-9cd5-6eaa8173e752 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:14.888272 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cfff40ea-dd8f-4fd0-9cd5-6eaa8173e752 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:14.888778 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cfff40ea-dd8f-4fd0-9cd5-6eaa8173e752 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:15.041488 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-cfff40ea-dd8f-4fd0-9cd5-6eaa8173e752 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:15.068835 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cfff40ea-dd8f-4fd0-9cd5-6eaa8173e752 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.199996 Oct 15 03:41:15.070314 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 202/417] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:14 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:15.623669 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-31c492aa-7ec6-4783-b1cd-8e375501b4d8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:15.624344 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-31c492aa-7ec6-4783-b1cd-8e375501b4d8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:15.630413 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-31c492aa-7ec6-4783-b1cd-8e375501b4d8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:15.630860 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-31c492aa-7ec6-4783-b1cd-8e375501b4d8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:15.631629 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-31c492aa-7ec6-4783-b1cd-8e375501b4d8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:15.632083 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-31c492aa-7ec6-4783-b1cd-8e375501b4d8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:15.693481 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-31c492aa-7ec6-4783-b1cd-8e375501b4d8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:15.700815 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-31c492aa-7ec6-4783-b1cd-8e375501b4d8 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1209 microversion: 2.1 time: 0.080880 Oct 15 03:41:15.703670 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 203/418] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:15 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:15.812782 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3fb1febc-0923-490b-bfcc-79bf0b96222f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:15.813529 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3fb1febc-0923-490b-bfcc-79bf0b96222f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:15.819574 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3fb1febc-0923-490b-bfcc-79bf0b96222f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:15.820056 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3fb1febc-0923-490b-bfcc-79bf0b96222f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:15.820872 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3fb1febc-0923-490b-bfcc-79bf0b96222f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:15.821318 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3fb1febc-0923-490b-bfcc-79bf0b96222f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:15.952694 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3fb1febc-0923-490b-bfcc-79bf0b96222f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:15.963379 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3fb1febc-0923-490b-bfcc-79bf0b96222f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:15.965342 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3fb1febc-0923-490b-bfcc-79bf0b96222f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:15.966692 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3fb1febc-0923-490b-bfcc-79bf0b96222f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.158008 Oct 15 03:41:15.977760 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 204/419] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:15 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:41:15.982247 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4cc915a6-ecc9-4440-a823-b2dacd02feb3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:15.982859 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4cc915a6-ecc9-4440-a823-b2dacd02feb3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:15.988751 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4cc915a6-ecc9-4440-a823-b2dacd02feb3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:15.989198 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4cc915a6-ecc9-4440-a823-b2dacd02feb3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:15.989959 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4cc915a6-ecc9-4440-a823-b2dacd02feb3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:15.990393 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4cc915a6-ecc9-4440-a823-b2dacd02feb3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:16.056604 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4cc915a6-ecc9-4440-a823-b2dacd02feb3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:16.063935 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4cc915a6-ecc9-4440-a823-b2dacd02feb3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1138 microversion: 2.1 time: 0.085120 Oct 15 03:41:16.064505 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 205/420] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:15 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:16.086440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9f23c8f6-1977-4290-afff-a643de5dc61b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:16.087179 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9f23c8f6-1977-4290-afff-a643de5dc61b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:16.093265 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9f23c8f6-1977-4290-afff-a643de5dc61b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:16.093719 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9f23c8f6-1977-4290-afff-a643de5dc61b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:16.094509 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9f23c8f6-1977-4290-afff-a643de5dc61b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:16.094946 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9f23c8f6-1977-4290-afff-a643de5dc61b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:16.223057 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9f23c8f6-1977-4290-afff-a643de5dc61b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:16.230465 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9f23c8f6-1977-4290-afff-a643de5dc61b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.148105 Oct 15 03:41:16.231029 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 206/421] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:16 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:16.717719 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0afc273a-1a5b-4b33-afe1-b8beed5080c4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:16.718329 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0afc273a-1a5b-4b33-afe1-b8beed5080c4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:16.724517 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0afc273a-1a5b-4b33-afe1-b8beed5080c4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:16.724969 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0afc273a-1a5b-4b33-afe1-b8beed5080c4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:16.725773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0afc273a-1a5b-4b33-afe1-b8beed5080c4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:16.726729 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0afc273a-1a5b-4b33-afe1-b8beed5080c4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:16.788330 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0afc273a-1a5b-4b33-afe1-b8beed5080c4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:16.802732 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0afc273a-1a5b-4b33-afe1-b8beed5080c4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1209 microversion: 2.1 time: 0.088603 Oct 15 03:41:16.803309 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 207/422] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:16 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:16.985403 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e3f39813-7239-4d07-9b42-ed006a5b5e98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:16.986064 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e3f39813-7239-4d07-9b42-ed006a5b5e98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:16.991855 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3f39813-7239-4d07-9b42-ed006a5b5e98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:16.992320 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3f39813-7239-4d07-9b42-ed006a5b5e98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:16.993121 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3f39813-7239-4d07-9b42-ed006a5b5e98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:16.993553 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3f39813-7239-4d07-9b42-ed006a5b5e98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:17.123937 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e3f39813-7239-4d07-9b42-ed006a5b5e98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:17.133297 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e3f39813-7239-4d07-9b42-ed006a5b5e98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:17.134835 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e3f39813-7239-4d07-9b42-ed006a5b5e98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:17.136049 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e3f39813-7239-4d07-9b42-ed006a5b5e98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.154483 Oct 15 03:41:17.136794 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 208/423] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:16 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:41:17.141031 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4ec12e04-22b2-4323-a41e-94690f010401 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:17.141665 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4ec12e04-22b2-4323-a41e-94690f010401 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:17.147577 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4ec12e04-22b2-4323-a41e-94690f010401 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:17.148094 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4ec12e04-22b2-4323-a41e-94690f010401 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:17.149471 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4ec12e04-22b2-4323-a41e-94690f010401 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:17.149906 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4ec12e04-22b2-4323-a41e-94690f010401 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:17.209264 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4ec12e04-22b2-4323-a41e-94690f010401 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:17.217603 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4ec12e04-22b2-4323-a41e-94690f010401 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1138 microversion: 2.1 time: 0.079898 Oct 15 03:41:17.218371 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 209/424] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:17 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1138 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:17.247334 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-23fd20ac-82ee-4303-802a-7b0a54475149 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:17.247975 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-23fd20ac-82ee-4303-802a-7b0a54475149 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:17.254189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-23fd20ac-82ee-4303-802a-7b0a54475149 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:17.254640 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-23fd20ac-82ee-4303-802a-7b0a54475149 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:17.255758 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-23fd20ac-82ee-4303-802a-7b0a54475149 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:17.255931 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-23fd20ac-82ee-4303-802a-7b0a54475149 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:17.391914 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-23fd20ac-82ee-4303-802a-7b0a54475149 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:17.401929 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-23fd20ac-82ee-4303-802a-7b0a54475149 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.158149 Oct 15 03:41:17.408928 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 210/425] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:17 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:17.820942 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-59e28591-18de-4e3e-b8b7-ddddd2846e52 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:17.821476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-59e28591-18de-4e3e-b8b7-ddddd2846e52 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:17.827542 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-59e28591-18de-4e3e-b8b7-ddddd2846e52 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:17.828027 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-59e28591-18de-4e3e-b8b7-ddddd2846e52 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:17.828801 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-59e28591-18de-4e3e-b8b7-ddddd2846e52 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:17.829239 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-59e28591-18de-4e3e-b8b7-ddddd2846e52 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:17.891477 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-59e28591-18de-4e3e-b8b7-ddddd2846e52 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:17.899345 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-59e28591-18de-4e3e-b8b7-ddddd2846e52 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1209 microversion: 2.1 time: 0.082208 Oct 15 03:41:17.899946 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 211/426] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:17 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:18.154079 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-83cce912-3619-4aef-92d5-dca89bcf6648 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:18.154813 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-83cce912-3619-4aef-92d5-dca89bcf6648 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:18.161052 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-83cce912-3619-4aef-92d5-dca89bcf6648 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:18.161616 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-83cce912-3619-4aef-92d5-dca89bcf6648 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:18.162468 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-83cce912-3619-4aef-92d5-dca89bcf6648 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:18.162900 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-83cce912-3619-4aef-92d5-dca89bcf6648 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:18.295066 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-83cce912-3619-4aef-92d5-dca89bcf6648 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:18.304801 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-83cce912-3619-4aef-92d5-dca89bcf6648 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:18.306304 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-83cce912-3619-4aef-92d5-dca89bcf6648 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:18.307457 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-83cce912-3619-4aef-92d5-dca89bcf6648 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.157338 Oct 15 03:41:18.309977 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 212/427] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:18 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:18.312295 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bbcc556c-1b23-4788-87fc-957922c95a09 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:18.312908 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bbcc556c-1b23-4788-87fc-957922c95a09 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:18.318961 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bbcc556c-1b23-4788-87fc-957922c95a09 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:18.319511 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bbcc556c-1b23-4788-87fc-957922c95a09 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:18.320804 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bbcc556c-1b23-4788-87fc-957922c95a09 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:18.321249 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bbcc556c-1b23-4788-87fc-957922c95a09 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:18.382897 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bbcc556c-1b23-4788-87fc-957922c95a09 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:18.390520 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bbcc556c-1b23-4788-87fc-957922c95a09 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1138 microversion: 2.1 time: 0.081494 Oct 15 03:41:18.391098 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 213/428] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:18 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1138 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:18.418148 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-45b14e04-0c10-4e2b-b05c-b3d68b2e9935 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:18.418643 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-45b14e04-0c10-4e2b-b05c-b3d68b2e9935 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:18.424523 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45b14e04-0c10-4e2b-b05c-b3d68b2e9935 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:18.425058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45b14e04-0c10-4e2b-b05c-b3d68b2e9935 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:18.425819 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45b14e04-0c10-4e2b-b05c-b3d68b2e9935 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:18.426245 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45b14e04-0c10-4e2b-b05c-b3d68b2e9935 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:18.549724 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-45b14e04-0c10-4e2b-b05c-b3d68b2e9935 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:18.557553 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-45b14e04-0c10-4e2b-b05c-b3d68b2e9935 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.143135 Oct 15 03:41:18.558113 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 214/429] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:18 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:18.916589 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4dde2350-a0c5-491f-ab1a-c4f9b151d0b0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:18.917197 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4dde2350-a0c5-491f-ab1a-c4f9b151d0b0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:18.923068 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4dde2350-a0c5-491f-ab1a-c4f9b151d0b0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:18.923521 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4dde2350-a0c5-491f-ab1a-c4f9b151d0b0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:18.924309 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4dde2350-a0c5-491f-ab1a-c4f9b151d0b0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:18.924739 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4dde2350-a0c5-491f-ab1a-c4f9b151d0b0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:18.987704 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4dde2350-a0c5-491f-ab1a-c4f9b151d0b0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:18.995332 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4dde2350-a0c5-491f-ab1a-c4f9b151d0b0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1209 microversion: 2.1 time: 0.083125 Oct 15 03:41:18.995932 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 215/430] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:18 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:19.325740 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-22fc3271-0107-40ae-b7f0-d9b663fffe1c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:19.326485 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-22fc3271-0107-40ae-b7f0-d9b663fffe1c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:19.332258 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-22fc3271-0107-40ae-b7f0-d9b663fffe1c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:19.332703 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-22fc3271-0107-40ae-b7f0-d9b663fffe1c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:19.333476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-22fc3271-0107-40ae-b7f0-d9b663fffe1c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:19.333912 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-22fc3271-0107-40ae-b7f0-d9b663fffe1c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:19.467237 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-22fc3271-0107-40ae-b7f0-d9b663fffe1c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:19.475602 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-22fc3271-0107-40ae-b7f0-d9b663fffe1c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:19.477164 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-22fc3271-0107-40ae-b7f0-d9b663fffe1c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:19.478342 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-22fc3271-0107-40ae-b7f0-d9b663fffe1c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.156493 Oct 15 03:41:19.480819 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 216/431] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:19 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:19.483103 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-758aa2d2-cd18-468f-86aa-d386fac32fcf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:19.483707 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-758aa2d2-cd18-468f-86aa-d386fac32fcf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:19.489584 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-758aa2d2-cd18-468f-86aa-d386fac32fcf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:19.490022 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-758aa2d2-cd18-468f-86aa-d386fac32fcf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:19.490786 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-758aa2d2-cd18-468f-86aa-d386fac32fcf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:19.491236 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-758aa2d2-cd18-468f-86aa-d386fac32fcf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:19.551376 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-758aa2d2-cd18-468f-86aa-d386fac32fcf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:19.558717 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-758aa2d2-cd18-468f-86aa-d386fac32fcf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1138 microversion: 2.1 time: 0.078903 Oct 15 03:41:19.559276 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 217/432] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:19 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1138 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:19.574328 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-589fff89-e507-4640-8500-90c232cf7308 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:19.574933 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-589fff89-e507-4640-8500-90c232cf7308 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:19.581151 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-589fff89-e507-4640-8500-90c232cf7308 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:19.581594 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-589fff89-e507-4640-8500-90c232cf7308 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:19.582347 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-589fff89-e507-4640-8500-90c232cf7308 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:19.582776 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-589fff89-e507-4640-8500-90c232cf7308 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:19.708116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-589fff89-e507-4640-8500-90c232cf7308 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:19.722315 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-589fff89-e507-4640-8500-90c232cf7308 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.143677 Oct 15 03:41:19.724184 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 218/433] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:19 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:20.012350 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5534a9e5-881e-409f-8351-5c5fcfaee1ce tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:20.012980 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5534a9e5-881e-409f-8351-5c5fcfaee1ce tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:20.019130 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5534a9e5-881e-409f-8351-5c5fcfaee1ce tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:20.019627 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5534a9e5-881e-409f-8351-5c5fcfaee1ce tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:20.020461 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5534a9e5-881e-409f-8351-5c5fcfaee1ce tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:20.020802 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5534a9e5-881e-409f-8351-5c5fcfaee1ce tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:20.087586 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5534a9e5-881e-409f-8351-5c5fcfaee1ce tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:20.095536 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5534a9e5-881e-409f-8351-5c5fcfaee1ce tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1209 microversion: 2.1 time: 0.086753 Oct 15 03:41:20.096136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 219/434] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:20 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1209 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:20.497030 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fde018fa-2296-40e7-af4d-fa01a82c166b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:20.497735 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fde018fa-2296-40e7-af4d-fa01a82c166b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:20.503672 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fde018fa-2296-40e7-af4d-fa01a82c166b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:20.504139 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fde018fa-2296-40e7-af4d-fa01a82c166b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:20.504908 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fde018fa-2296-40e7-af4d-fa01a82c166b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:20.505340 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fde018fa-2296-40e7-af4d-fa01a82c166b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:20.628820 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fde018fa-2296-40e7-af4d-fa01a82c166b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:20.637526 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fde018fa-2296-40e7-af4d-fa01a82c166b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:20.639037 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fde018fa-2296-40e7-af4d-fa01a82c166b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:20.640232 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fde018fa-2296-40e7-af4d-fa01a82c166b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.146920 Oct 15 03:41:20.640787 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 220/435] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:20 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:20.645068 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-51fac8e6-e8ac-4778-a473-4dd768e791b5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:20.645676 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-51fac8e6-e8ac-4778-a473-4dd768e791b5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:20.652190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-51fac8e6-e8ac-4778-a473-4dd768e791b5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:20.652644 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-51fac8e6-e8ac-4778-a473-4dd768e791b5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:20.653410 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-51fac8e6-e8ac-4778-a473-4dd768e791b5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:20.653841 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-51fac8e6-e8ac-4778-a473-4dd768e791b5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:20.714449 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-51fac8e6-e8ac-4778-a473-4dd768e791b5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:20.722175 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-51fac8e6-e8ac-4778-a473-4dd768e791b5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1138 microversion: 2.1 time: 0.080097 Oct 15 03:41:20.722883 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 221/436] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:20 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1138 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:20.730041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-621ae674-c537-42ab-b975-7f126cb1b75b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:20.730653 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-621ae674-c537-42ab-b975-7f126cb1b75b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:20.736698 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-621ae674-c537-42ab-b975-7f126cb1b75b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:20.737150 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-621ae674-c537-42ab-b975-7f126cb1b75b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:20.737929 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-621ae674-c537-42ab-b975-7f126cb1b75b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:20.738368 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-621ae674-c537-42ab-b975-7f126cb1b75b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:20.861344 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-621ae674-c537-42ab-b975-7f126cb1b75b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:20.868496 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-621ae674-c537-42ab-b975-7f126cb1b75b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.141987 Oct 15 03:41:20.869059 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 222/437] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:20 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:21.112908 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-03e9b7a1-cee3-422e-83dc-b8c931ea6983 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:21.113550 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-03e9b7a1-cee3-422e-83dc-b8c931ea6983 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:21.121512 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-03e9b7a1-cee3-422e-83dc-b8c931ea6983 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:21.121966 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-03e9b7a1-cee3-422e-83dc-b8c931ea6983 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:21.122743 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-03e9b7a1-cee3-422e-83dc-b8c931ea6983 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:21.123168 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-03e9b7a1-cee3-422e-83dc-b8c931ea6983 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:21.182803 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-03e9b7a1-cee3-422e-83dc-b8c931ea6983 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:21.191024 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-03e9b7a1-cee3-422e-83dc-b8c931ea6983 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1209 microversion: 2.1 time: 0.081825 Oct 15 03:41:21.191604 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 223/438] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:21 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:21.658799 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d2ef15d1-dc88-4f25-8e3a-f0575cede725 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:21.659515 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d2ef15d1-dc88-4f25-8e3a-f0575cede725 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:21.665798 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2ef15d1-dc88-4f25-8e3a-f0575cede725 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:21.666238 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2ef15d1-dc88-4f25-8e3a-f0575cede725 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:21.666995 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2ef15d1-dc88-4f25-8e3a-f0575cede725 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:21.667422 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2ef15d1-dc88-4f25-8e3a-f0575cede725 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:21.803054 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d2ef15d1-dc88-4f25-8e3a-f0575cede725 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:21.812636 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d2ef15d1-dc88-4f25-8e3a-f0575cede725 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:21.814179 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d2ef15d1-dc88-4f25-8e3a-f0575cede725 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:21.815343 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d2ef15d1-dc88-4f25-8e3a-f0575cede725 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.160338 Oct 15 03:41:21.816108 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 224/439] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:21 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:21.823757 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-98b0eb68-38f0-490a-8c84-f6e2bab755c8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:21.824434 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-98b0eb68-38f0-490a-8c84-f6e2bab755c8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:21.830364 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-98b0eb68-38f0-490a-8c84-f6e2bab755c8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:21.830751 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-98b0eb68-38f0-490a-8c84-f6e2bab755c8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:21.831551 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-98b0eb68-38f0-490a-8c84-f6e2bab755c8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:21.831984 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-98b0eb68-38f0-490a-8c84-f6e2bab755c8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:21.900052 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-98b0eb68-38f0-490a-8c84-f6e2bab755c8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:21.907983 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-98b0eb68-38f0-490a-8c84-f6e2bab755c8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1138 microversion: 2.1 time: 0.087538 Oct 15 03:41:21.908837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 225/440] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:21 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1138 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:21.915619 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-09892779-1660-4e5d-b21d-6a9f88fe5d41 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:21.916312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-09892779-1660-4e5d-b21d-6a9f88fe5d41 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:21.923244 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-09892779-1660-4e5d-b21d-6a9f88fe5d41 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:21.923748 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-09892779-1660-4e5d-b21d-6a9f88fe5d41 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:21.925118 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-09892779-1660-4e5d-b21d-6a9f88fe5d41 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:21.925580 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-09892779-1660-4e5d-b21d-6a9f88fe5d41 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:22.053165 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-09892779-1660-4e5d-b21d-6a9f88fe5d41 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:22.060663 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-09892779-1660-4e5d-b21d-6a9f88fe5d41 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.150748 Oct 15 03:41:22.061283 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 226/441] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:21 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:22.209317 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c86c545d-b924-466c-b594-d7ae2fda75be tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:22.210643 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c86c545d-b924-466c-b594-d7ae2fda75be tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:22.217002 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c86c545d-b924-466c-b594-d7ae2fda75be tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:22.217574 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c86c545d-b924-466c-b594-d7ae2fda75be tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:22.218471 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c86c545d-b924-466c-b594-d7ae2fda75be tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:22.218975 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c86c545d-b924-466c-b594-d7ae2fda75be tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:22.292803 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c86c545d-b924-466c-b594-d7ae2fda75be tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:22.316306 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c86c545d-b924-466c-b594-d7ae2fda75be tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1209 microversion: 2.1 time: 0.110674 Oct 15 03:41:22.316886 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 227/442] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:22 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1209 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:22.833697 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-802e8b11-71e7-4121-9a5c-6e9dbc0c4827 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:22.835185 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-802e8b11-71e7-4121-9a5c-6e9dbc0c4827 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:22.842373 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-802e8b11-71e7-4121-9a5c-6e9dbc0c4827 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:22.842905 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-802e8b11-71e7-4121-9a5c-6e9dbc0c4827 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:22.849027 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-802e8b11-71e7-4121-9a5c-6e9dbc0c4827 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:22.849552 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-802e8b11-71e7-4121-9a5c-6e9dbc0c4827 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:22.986286 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-802e8b11-71e7-4121-9a5c-6e9dbc0c4827 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:22.996220 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-802e8b11-71e7-4121-9a5c-6e9dbc0c4827 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:22.997642 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-802e8b11-71e7-4121-9a5c-6e9dbc0c4827 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:22.998959 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-802e8b11-71e7-4121-9a5c-6e9dbc0c4827 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.169244 Oct 15 03:41:22.999509 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 228/443] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:22 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:41:23.004071 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9b12b46a-77fb-47d0-aaf2-3068c1e21f1a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:23.004748 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9b12b46a-77fb-47d0-aaf2-3068c1e21f1a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:23.011290 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9b12b46a-77fb-47d0-aaf2-3068c1e21f1a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:23.011935 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9b12b46a-77fb-47d0-aaf2-3068c1e21f1a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:23.012719 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9b12b46a-77fb-47d0-aaf2-3068c1e21f1a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:23.013178 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9b12b46a-77fb-47d0-aaf2-3068c1e21f1a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:23.088139 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9b12b46a-77fb-47d0-aaf2-3068c1e21f1a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:23.096812 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9b12b46a-77fb-47d0-aaf2-3068c1e21f1a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1138 microversion: 2.1 time: 0.096207 Oct 15 03:41:23.107125 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 229/444] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:22 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1138 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:23.113975 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0100c462-95d0-43c3-b55c-11331c52591e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:23.114784 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0100c462-95d0-43c3-b55c-11331c52591e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:23.127545 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0100c462-95d0-43c3-b55c-11331c52591e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:23.128057 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0100c462-95d0-43c3-b55c-11331c52591e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:23.128978 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0100c462-95d0-43c3-b55c-11331c52591e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:23.129418 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0100c462-95d0-43c3-b55c-11331c52591e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:23.268319 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0100c462-95d0-43c3-b55c-11331c52591e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:23.275607 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0100c462-95d0-43c3-b55c-11331c52591e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.166259 Oct 15 03:41:23.276218 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 230/445] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:23 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:23.333475 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2cfc0232-cd3d-4782-a694-1664c11142d0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:23.334076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2cfc0232-cd3d-4782-a694-1664c11142d0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:23.341029 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2cfc0232-cd3d-4782-a694-1664c11142d0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:23.341474 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2cfc0232-cd3d-4782-a694-1664c11142d0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:23.342223 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2cfc0232-cd3d-4782-a694-1664c11142d0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:23.342651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2cfc0232-cd3d-4782-a694-1664c11142d0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:23.404183 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2cfc0232-cd3d-4782-a694-1664c11142d0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:23.412917 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2cfc0232-cd3d-4782-a694-1664c11142d0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1209 microversion: 2.1 time: 0.083145 Oct 15 03:41:23.414102 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 231/446] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:23 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:24.017756 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1a840b99-e177-4a83-836d-a4bf1ee30fc9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:24.018995 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1a840b99-e177-4a83-836d-a4bf1ee30fc9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:24.025527 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1a840b99-e177-4a83-836d-a4bf1ee30fc9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:24.025982 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1a840b99-e177-4a83-836d-a4bf1ee30fc9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:24.026829 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1a840b99-e177-4a83-836d-a4bf1ee30fc9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:24.027243 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1a840b99-e177-4a83-836d-a4bf1ee30fc9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:24.157774 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1a840b99-e177-4a83-836d-a4bf1ee30fc9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:24.167408 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1a840b99-e177-4a83-836d-a4bf1ee30fc9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:24.169037 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1a840b99-e177-4a83-836d-a4bf1ee30fc9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:24.170317 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1a840b99-e177-4a83-836d-a4bf1ee30fc9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.156445 Oct 15 03:41:24.171258 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 232/447] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:24 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:41:24.175750 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-53d01bd1-db0a-4d79-94f3-5dd25f53f8eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:24.176452 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-53d01bd1-db0a-4d79-94f3-5dd25f53f8eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:24.183277 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53d01bd1-db0a-4d79-94f3-5dd25f53f8eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:24.183736 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53d01bd1-db0a-4d79-94f3-5dd25f53f8eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:24.184512 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53d01bd1-db0a-4d79-94f3-5dd25f53f8eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:24.184981 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53d01bd1-db0a-4d79-94f3-5dd25f53f8eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:24.260711 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-53d01bd1-db0a-4d79-94f3-5dd25f53f8eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:24.276835 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-53d01bd1-db0a-4d79-94f3-5dd25f53f8eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1138 microversion: 2.1 time: 0.104094 Oct 15 03:41:24.277482 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 233/448] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:24 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1138 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:24.292881 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-785cb219-b260-4992-a03f-b2b7bcf258c4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:24.293657 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-785cb219-b260-4992-a03f-b2b7bcf258c4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:24.303163 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-785cb219-b260-4992-a03f-b2b7bcf258c4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:24.304297 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-785cb219-b260-4992-a03f-b2b7bcf258c4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:24.305301 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-785cb219-b260-4992-a03f-b2b7bcf258c4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:24.305837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-785cb219-b260-4992-a03f-b2b7bcf258c4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:24.446095 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-785cb219-b260-4992-a03f-b2b7bcf258c4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:24.453568 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-785cb219-b260-4992-a03f-b2b7bcf258c4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.164407 Oct 15 03:41:24.454218 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 234/449] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:24 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:24.458608 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e0d4c18e-2ed4-4b2e-a43d-e3def60af1fd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:24.459285 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e0d4c18e-2ed4-4b2e-a43d-e3def60af1fd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:24.465612 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0d4c18e-2ed4-4b2e-a43d-e3def60af1fd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:24.466058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0d4c18e-2ed4-4b2e-a43d-e3def60af1fd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:24.466823 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0d4c18e-2ed4-4b2e-a43d-e3def60af1fd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:24.467253 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0d4c18e-2ed4-4b2e-a43d-e3def60af1fd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:24.527515 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e0d4c18e-2ed4-4b2e-a43d-e3def60af1fd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:24.534757 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e0d4c18e-2ed4-4b2e-a43d-e3def60af1fd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1209 microversion: 2.1 time: 0.079532 Oct 15 03:41:24.535309 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 235/450] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:24 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1209 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:25.189583 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6789c9e9-4d24-4378-8f46-306db70e9ddc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:25.190207 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6789c9e9-4d24-4378-8f46-306db70e9ddc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:25.196227 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6789c9e9-4d24-4378-8f46-306db70e9ddc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:25.196676 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6789c9e9-4d24-4378-8f46-306db70e9ddc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:25.197427 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6789c9e9-4d24-4378-8f46-306db70e9ddc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:25.197858 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6789c9e9-4d24-4378-8f46-306db70e9ddc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:25.316932 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6789c9e9-4d24-4378-8f46-306db70e9ddc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:25.325468 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6789c9e9-4d24-4378-8f46-306db70e9ddc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:25.326959 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6789c9e9-4d24-4378-8f46-306db70e9ddc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:25.328148 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6789c9e9-4d24-4378-8f46-306db70e9ddc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.142386 Oct 15 03:41:25.328699 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 236/451] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:25 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:41:25.332947 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9a376857-126e-4edb-9fa8-a4e58a0ca8ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:25.333548 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9a376857-126e-4edb-9fa8-a4e58a0ca8ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:25.339574 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9a376857-126e-4edb-9fa8-a4e58a0ca8ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:25.340080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9a376857-126e-4edb-9fa8-a4e58a0ca8ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:25.340841 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9a376857-126e-4edb-9fa8-a4e58a0ca8ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:25.341278 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9a376857-126e-4edb-9fa8-a4e58a0ca8ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:25.398403 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9a376857-126e-4edb-9fa8-a4e58a0ca8ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:25.405766 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9a376857-126e-4edb-9fa8-a4e58a0ca8ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1138 microversion: 2.1 time: 0.076056 Oct 15 03:41:25.406333 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 237/452] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:25 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1138 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:25.470167 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2f9c9e09-b9b3-4b17-a867-9f71a3ba2d29 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:25.470703 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2f9c9e09-b9b3-4b17-a867-9f71a3ba2d29 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:25.476242 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2f9c9e09-b9b3-4b17-a867-9f71a3ba2d29 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:25.476688 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2f9c9e09-b9b3-4b17-a867-9f71a3ba2d29 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:25.477449 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2f9c9e09-b9b3-4b17-a867-9f71a3ba2d29 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:25.477881 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2f9c9e09-b9b3-4b17-a867-9f71a3ba2d29 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:25.592610 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2f9c9e09-b9b3-4b17-a867-9f71a3ba2d29 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:25.599691 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2f9c9e09-b9b3-4b17-a867-9f71a3ba2d29 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.132899 Oct 15 03:41:25.600267 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 238/453] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:25 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:25.604696 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-62bd2a4b-58fa-4e78-94f4-6a367896e7f3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:25.605298 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-62bd2a4b-58fa-4e78-94f4-6a367896e7f3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:25.610507 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-62bd2a4b-58fa-4e78-94f4-6a367896e7f3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:25.610954 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-62bd2a4b-58fa-4e78-94f4-6a367896e7f3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:25.611732 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-62bd2a4b-58fa-4e78-94f4-6a367896e7f3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:25.612170 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-62bd2a4b-58fa-4e78-94f4-6a367896e7f3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:25.668867 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-62bd2a4b-58fa-4e78-94f4-6a367896e7f3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:25.675978 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-62bd2a4b-58fa-4e78-94f4-6a367896e7f3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1209 microversion: 2.1 time: 0.074451 Oct 15 03:41:25.676539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 239/454] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:25 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1209 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:26.346701 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4edc3663-3ad4-4986-b0f3-d3680dbd08b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:26.347278 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4edc3663-3ad4-4986-b0f3-d3680dbd08b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:26.353433 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4edc3663-3ad4-4986-b0f3-d3680dbd08b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:26.353878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4edc3663-3ad4-4986-b0f3-d3680dbd08b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:26.354640 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4edc3663-3ad4-4986-b0f3-d3680dbd08b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:26.355068 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4edc3663-3ad4-4986-b0f3-d3680dbd08b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:26.472716 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4edc3663-3ad4-4986-b0f3-d3680dbd08b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:26.481297 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4edc3663-3ad4-4986-b0f3-d3680dbd08b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:26.482785 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4edc3663-3ad4-4986-b0f3-d3680dbd08b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:26.483966 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4edc3663-3ad4-4986-b0f3-d3680dbd08b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.141079 Oct 15 03:41:26.484569 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 240/455] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:26 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:41:26.488933 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-427abcc2-5a0f-44ae-9374-1e9b994a1288 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:26.489530 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-427abcc2-5a0f-44ae-9374-1e9b994a1288 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:26.494741 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-427abcc2-5a0f-44ae-9374-1e9b994a1288 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:26.495183 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-427abcc2-5a0f-44ae-9374-1e9b994a1288 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:26.495968 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-427abcc2-5a0f-44ae-9374-1e9b994a1288 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:26.496403 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-427abcc2-5a0f-44ae-9374-1e9b994a1288 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:26.554664 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-427abcc2-5a0f-44ae-9374-1e9b994a1288 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:26.561706 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-427abcc2-5a0f-44ae-9374-1e9b994a1288 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1138 microversion: 2.1 time: 0.076220 Oct 15 03:41:26.562249 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 241/456] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:26 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1138 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:26.615085 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f9b019d9-7ab3-401b-8133-66eca93550ff tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:26.615611 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f9b019d9-7ab3-401b-8133-66eca93550ff tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:26.620936 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f9b019d9-7ab3-401b-8133-66eca93550ff tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:26.621375 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f9b019d9-7ab3-401b-8133-66eca93550ff tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:26.622117 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f9b019d9-7ab3-401b-8133-66eca93550ff tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:26.622540 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f9b019d9-7ab3-401b-8133-66eca93550ff tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:26.738235 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f9b019d9-7ab3-401b-8133-66eca93550ff tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:26.745387 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f9b019d9-7ab3-401b-8133-66eca93550ff tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.133602 Oct 15 03:41:26.745935 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 242/457] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:26 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:26.750013 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2acc33f2-6cdd-4c9e-a69f-648d02e7bf28 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:26.750605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2acc33f2-6cdd-4c9e-a69f-648d02e7bf28 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:26.755808 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2acc33f2-6cdd-4c9e-a69f-648d02e7bf28 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:26.756259 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2acc33f2-6cdd-4c9e-a69f-648d02e7bf28 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:26.757504 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2acc33f2-6cdd-4c9e-a69f-648d02e7bf28 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:26.757935 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2acc33f2-6cdd-4c9e-a69f-648d02e7bf28 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:26.820749 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2acc33f2-6cdd-4c9e-a69f-648d02e7bf28 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:26.827858 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2acc33f2-6cdd-4c9e-a69f-648d02e7bf28 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1209 microversion: 2.1 time: 0.080964 Oct 15 03:41:26.828417 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 243/458] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:26 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:27.504163 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-43db29a4-8f9c-4315-8dac-3b213316801e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:27.505559 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-43db29a4-8f9c-4315-8dac-3b213316801e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:27.513912 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-43db29a4-8f9c-4315-8dac-3b213316801e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:27.515793 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-43db29a4-8f9c-4315-8dac-3b213316801e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:27.517073 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-43db29a4-8f9c-4315-8dac-3b213316801e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:27.518400 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-43db29a4-8f9c-4315-8dac-3b213316801e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:27.674984 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8854e76d-258e-4164-870a-2bf2fa00ad59 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "POST /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 13.764757 Oct 15 03:41:27.677023 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 216/459] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Oct 15 03:41:13 2021] POST /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73/os-volume_attachments => generated 194 bytes in 13767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:41:27.684090 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-90571180-81a7-4a40-8976-8e1fe3423d36 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:27.685189 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-90571180-81a7-4a40-8976-8e1fe3423d36 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:27.696240 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-90571180-81a7-4a40-8976-8e1fe3423d36 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:27.696982 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-90571180-81a7-4a40-8976-8e1fe3423d36 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:27.699611 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-90571180-81a7-4a40-8976-8e1fe3423d36 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:27.700391 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-90571180-81a7-4a40-8976-8e1fe3423d36 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:27.780914 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-90571180-81a7-4a40-8976-8e1fe3423d36 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:27.795214 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-90571180-81a7-4a40-8976-8e1fe3423d36 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1130 microversion: 2.1 time: 0.116740 Oct 15 03:41:27.799031 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 217/460] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:27 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1130 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:27.800265 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-43db29a4-8f9c-4315-8dac-3b213316801e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:27.808875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-53886ff9-b51f-4a75-981d-48d1c88dbf61 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:27.810816 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-53886ff9-b51f-4a75-981d-48d1c88dbf61 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:27.811393 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-43db29a4-8f9c-4315-8dac-3b213316801e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:27.816770 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-43db29a4-8f9c-4315-8dac-3b213316801e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:27.819609 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-53886ff9-b51f-4a75-981d-48d1c88dbf61 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:27.820871 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-43db29a4-8f9c-4315-8dac-3b213316801e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.321502 Oct 15 03:41:27.823717 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 244/461] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:27 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:41:27.824466 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-53886ff9-b51f-4a75-981d-48d1c88dbf61 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:27.825670 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-53886ff9-b51f-4a75-981d-48d1c88dbf61 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:27.826253 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-53886ff9-b51f-4a75-981d-48d1c88dbf61 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:27.850148 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-551c6a7c-5579-4bc0-b881-64b33c8b1c2f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:27.851080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-551c6a7c-5579-4bc0-b881-64b33c8b1c2f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:27.862597 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-551c6a7c-5579-4bc0-b881-64b33c8b1c2f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:27.863065 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-551c6a7c-5579-4bc0-b881-64b33c8b1c2f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:27.864681 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-551c6a7c-5579-4bc0-b881-64b33c8b1c2f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:27.870008 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-551c6a7c-5579-4bc0-b881-64b33c8b1c2f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:27.965234 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-551c6a7c-5579-4bc0-b881-64b33c8b1c2f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:27.975253 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-551c6a7c-5579-4bc0-b881-64b33c8b1c2f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1209 microversion: 2.1 time: 0.132700 Oct 15 03:41:27.976014 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 245/462] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:27 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1209 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:28.061307 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-53886ff9-b51f-4a75-981d-48d1c88dbf61 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:28.068646 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-53886ff9-b51f-4a75-981d-48d1c88dbf61 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.268110 Oct 15 03:41:28.069778 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 218/463] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:27 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:28.814154 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e1058023-ccdf-43a0-937b-6ed7fbfe1631 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:28.814884 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e1058023-ccdf-43a0-937b-6ed7fbfe1631 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:28.820772 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1058023-ccdf-43a0-937b-6ed7fbfe1631 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:28.821249 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1058023-ccdf-43a0-937b-6ed7fbfe1631 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:28.822432 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1058023-ccdf-43a0-937b-6ed7fbfe1631 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:28.823004 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1058023-ccdf-43a0-937b-6ed7fbfe1631 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:28.841169 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b5ccd7f2-40c8-4408-a736-b198eb4471c9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:28.841768 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b5ccd7f2-40c8-4408-a736-b198eb4471c9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:28.849163 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b5ccd7f2-40c8-4408-a736-b198eb4471c9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:28.850018 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b5ccd7f2-40c8-4408-a736-b198eb4471c9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:28.851715 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b5ccd7f2-40c8-4408-a736-b198eb4471c9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:28.852278 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b5ccd7f2-40c8-4408-a736-b198eb4471c9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:28.884349 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e1058023-ccdf-43a0-937b-6ed7fbfe1631 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:28.891488 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e1058023-ccdf-43a0-937b-6ed7fbfe1631 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1130 microversion: 2.1 time: 0.081168 Oct 15 03:41:28.892257 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 246/464] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:28 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1130 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:28.975954 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b5ccd7f2-40c8-4408-a736-b198eb4471c9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:28.984023 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b5ccd7f2-40c8-4408-a736-b198eb4471c9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:28.985668 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b5ccd7f2-40c8-4408-a736-b198eb4471c9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:28.986849 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b5ccd7f2-40c8-4408-a736-b198eb4471c9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.150341 Oct 15 03:41:28.987697 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 219/465] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:28 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:41:28.991993 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fd9a26f9-3870-4c06-83d8-bf260bc07572 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:28.992590 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fd9a26f9-3870-4c06-83d8-bf260bc07572 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:28.998322 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fd9a26f9-3870-4c06-83d8-bf260bc07572 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:28.998771 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fd9a26f9-3870-4c06-83d8-bf260bc07572 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:28.999524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fd9a26f9-3870-4c06-83d8-bf260bc07572 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:29.000053 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fd9a26f9-3870-4c06-83d8-bf260bc07572 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:29.086202 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-656fd8af-0f21-44f8-9253-83d94e0b84a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:29.086938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-656fd8af-0f21-44f8-9253-83d94e0b84a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:29.093030 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-656fd8af-0f21-44f8-9253-83d94e0b84a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:29.093548 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-656fd8af-0f21-44f8-9253-83d94e0b84a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:29.094374 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-656fd8af-0f21-44f8-9253-83d94e0b84a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:29.094878 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-656fd8af-0f21-44f8-9253-83d94e0b84a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:29.117106 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fd9a26f9-3870-4c06-83d8-bf260bc07572 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:29.124631 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fd9a26f9-3870-4c06-83d8-bf260bc07572 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1276 microversion: 2.1 time: 0.136436 Oct 15 03:41:29.125191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 247/466] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:28 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:29.213074 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-656fd8af-0f21-44f8-9253-83d94e0b84a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:29.220267 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-656fd8af-0f21-44f8-9253-83d94e0b84a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.138268 Oct 15 03:41:29.220865 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 220/467] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:29 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:29.908705 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e0a9cb81-6a31-4812-84cd-2e96fb722c17 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:29.909304 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e0a9cb81-6a31-4812-84cd-2e96fb722c17 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:29.915431 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0a9cb81-6a31-4812-84cd-2e96fb722c17 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:29.915920 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0a9cb81-6a31-4812-84cd-2e96fb722c17 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:29.916665 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0a9cb81-6a31-4812-84cd-2e96fb722c17 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:29.917095 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0a9cb81-6a31-4812-84cd-2e96fb722c17 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:29.976530 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e0a9cb81-6a31-4812-84cd-2e96fb722c17 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:29.984130 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e0a9cb81-6a31-4812-84cd-2e96fb722c17 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1130 microversion: 2.1 time: 0.078930 Oct 15 03:41:29.984680 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 248/468] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:29 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1130 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:30.004623 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e7938581-a9a6-4a86-b299-ad5f61842dab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:30.005234 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e7938581-a9a6-4a86-b299-ad5f61842dab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:30.010859 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7938581-a9a6-4a86-b299-ad5f61842dab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:30.011311 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7938581-a9a6-4a86-b299-ad5f61842dab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:30.012101 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7938581-a9a6-4a86-b299-ad5f61842dab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:30.012534 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7938581-a9a6-4a86-b299-ad5f61842dab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:30.128597 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e7938581-a9a6-4a86-b299-ad5f61842dab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:30.136501 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e7938581-a9a6-4a86-b299-ad5f61842dab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:30.137992 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e7938581-a9a6-4a86-b299-ad5f61842dab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:30.139143 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e7938581-a9a6-4a86-b299-ad5f61842dab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.138152 Oct 15 03:41:30.139701 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 221/469] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:29 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:30.141292 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-76dca192-ba41-43ac-b40c-ded4727b2be3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:30.141894 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-76dca192-ba41-43ac-b40c-ded4727b2be3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:30.147989 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-76dca192-ba41-43ac-b40c-ded4727b2be3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:30.148430 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-76dca192-ba41-43ac-b40c-ded4727b2be3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:30.149173 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-76dca192-ba41-43ac-b40c-ded4727b2be3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:30.149599 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-76dca192-ba41-43ac-b40c-ded4727b2be3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:30.238007 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-15826a4c-5c3d-41bd-acf4-68d58576cd4e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:30.238609 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-15826a4c-5c3d-41bd-acf4-68d58576cd4e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:30.245212 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-15826a4c-5c3d-41bd-acf4-68d58576cd4e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:30.245212 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-15826a4c-5c3d-41bd-acf4-68d58576cd4e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:30.245872 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-15826a4c-5c3d-41bd-acf4-68d58576cd4e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:30.246298 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-15826a4c-5c3d-41bd-acf4-68d58576cd4e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:30.271017 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-76dca192-ba41-43ac-b40c-ded4727b2be3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:30.278839 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-76dca192-ba41-43ac-b40c-ded4727b2be3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1276 microversion: 2.1 time: 0.141148 Oct 15 03:41:30.279340 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 249/470] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:30 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:30.366163 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-15826a4c-5c3d-41bd-acf4-68d58576cd4e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:30.373345 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-15826a4c-5c3d-41bd-acf4-68d58576cd4e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.139002 Oct 15 03:41:30.373909 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 222/471] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:30 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:31.001131 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-28e79fb0-12f0-4001-bd65-2c4fb72d427b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:31.001751 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-28e79fb0-12f0-4001-bd65-2c4fb72d427b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:31.008516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28e79fb0-12f0-4001-bd65-2c4fb72d427b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:31.008943 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28e79fb0-12f0-4001-bd65-2c4fb72d427b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:31.009725 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28e79fb0-12f0-4001-bd65-2c4fb72d427b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:31.010156 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28e79fb0-12f0-4001-bd65-2c4fb72d427b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:31.158229 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0aa15e0b-8fc7-4f60-a8d9-7b2f0145e7a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:31.158846 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0aa15e0b-8fc7-4f60-a8d9-7b2f0145e7a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:31.165507 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0aa15e0b-8fc7-4f60-a8d9-7b2f0145e7a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:31.165967 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0aa15e0b-8fc7-4f60-a8d9-7b2f0145e7a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:31.166744 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0aa15e0b-8fc7-4f60-a8d9-7b2f0145e7a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:31.167186 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0aa15e0b-8fc7-4f60-a8d9-7b2f0145e7a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:31.176587 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-28e79fb0-12f0-4001-bd65-2c4fb72d427b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:31.186026 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-28e79fb0-12f0-4001-bd65-2c4fb72d427b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1186 microversion: 2.1 time: 0.188556 Oct 15 03:41:31.186897 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 250/472] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:30 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1186 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:31.298554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d69d32f0-bc14-4cb4-9d3c-4587c573edce tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:31.299836 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d69d32f0-bc14-4cb4-9d3c-4587c573edce tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:31.310601 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d69d32f0-bc14-4cb4-9d3c-4587c573edce tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:31.311955 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d69d32f0-bc14-4cb4-9d3c-4587c573edce tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:31.313873 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d69d32f0-bc14-4cb4-9d3c-4587c573edce tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:31.314767 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d69d32f0-bc14-4cb4-9d3c-4587c573edce tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:31.457671 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0aa15e0b-8fc7-4f60-a8d9-7b2f0145e7a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:31.468995 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0aa15e0b-8fc7-4f60-a8d9-7b2f0145e7a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:31.471241 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0aa15e0b-8fc7-4f60-a8d9-7b2f0145e7a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:31.472695 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0aa15e0b-8fc7-4f60-a8d9-7b2f0145e7a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.318981 Oct 15 03:41:31.483724 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 223/473] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:31 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:41:31.500910 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6f2a4247-3e2b-4150-803a-e54caffa9b2b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:31.501545 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6f2a4247-3e2b-4150-803a-e54caffa9b2b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:31.511234 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f2a4247-3e2b-4150-803a-e54caffa9b2b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:31.512779 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f2a4247-3e2b-4150-803a-e54caffa9b2b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:31.523172 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f2a4247-3e2b-4150-803a-e54caffa9b2b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:31.523869 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f2a4247-3e2b-4150-803a-e54caffa9b2b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:31.729591 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d69d32f0-bc14-4cb4-9d3c-4587c573edce tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:31.741140 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d69d32f0-bc14-4cb4-9d3c-4587c573edce tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1276 microversion: 2.1 time: 0.448245 Oct 15 03:41:31.741728 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 251/474] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:31 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1276 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:31.929011 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6f2a4247-3e2b-4150-803a-e54caffa9b2b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:31.937746 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6f2a4247-3e2b-4150-803a-e54caffa9b2b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.456157 Oct 15 03:41:31.940490 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 224/475] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:31 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:32.193520 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-75a5927f-a478-48e1-8334-886cdc2e62a0 req-4cd327b6-05ed-4b64-8a00-f863798fb6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e429526-26c8-4d98-8691-73770db59513", "tag": "b203b749-dead-423e-8bfb-4c494e6c63ab"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:41:32.197217 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:41:32.197217 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:41:32.206634 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-75a5927f-a478-48e1-8334-886cdc2e62a0 req-4cd327b6-05ed-4b64-8a00-f863798fb6c2 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:32.207431 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-75a5927f-a478-48e1-8334-886cdc2e62a0 req-4cd327b6-05ed-4b64-8a00-f863798fb6c2 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:32.213097 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-86bda451-3546-48a4-86a7-7cb040c35e47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:32.216848 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-86bda451-3546-48a4-86a7-7cb040c35e47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:32.225294 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-75a5927f-a478-48e1-8334-886cdc2e62a0 req-4cd327b6-05ed-4b64-8a00-f863798fb6c2 service nova] Creating event network-changed:b203b749-dead-423e-8bfb-4c494e6c63ab for instance 6e429526-26c8-4d98-8691-73770db59513 on hv-cinder-81410 Oct 15 03:41:32.229565 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-86bda451-3546-48a4-86a7-7cb040c35e47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:32.230156 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-86bda451-3546-48a4-86a7-7cb040c35e47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:32.231329 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-86bda451-3546-48a4-86a7-7cb040c35e47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:32.232908 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-86bda451-3546-48a4-86a7-7cb040c35e47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:32.250390 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-75a5927f-a478-48e1-8334-886cdc2e62a0 req-4cd327b6-05ed-4b64-8a00-f863798fb6c2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048753 Oct 15 03:41:32.252990 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 252/476] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:41:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:41:32.341338 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-86bda451-3546-48a4-86a7-7cb040c35e47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:32.349317 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-86bda451-3546-48a4-86a7-7cb040c35e47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1204 microversion: 2.1 time: 0.148452 Oct 15 03:41:32.350268 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 225/477] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:32 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1204 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:32.495796 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e3f3e7d5-722d-425d-bc7a-87b9feb05a64 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:32.496673 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e3f3e7d5-722d-425d-bc7a-87b9feb05a64 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:32.503538 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3f3e7d5-722d-425d-bc7a-87b9feb05a64 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:32.504040 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3f3e7d5-722d-425d-bc7a-87b9feb05a64 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:32.504816 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3f3e7d5-722d-425d-bc7a-87b9feb05a64 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:32.505249 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3f3e7d5-722d-425d-bc7a-87b9feb05a64 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:32.757449 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4c93884d-9019-4b23-9484-d9243480f4e5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:32.758059 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4c93884d-9019-4b23-9484-d9243480f4e5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:32.764230 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4c93884d-9019-4b23-9484-d9243480f4e5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:32.764874 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4c93884d-9019-4b23-9484-d9243480f4e5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:32.765696 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4c93884d-9019-4b23-9484-d9243480f4e5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:32.766133 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4c93884d-9019-4b23-9484-d9243480f4e5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:32.776378 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e3f3e7d5-722d-425d-bc7a-87b9feb05a64 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:32.785077 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e3f3e7d5-722d-425d-bc7a-87b9feb05a64 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:32.786727 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e3f3e7d5-722d-425d-bc7a-87b9feb05a64 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:32.788521 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e3f3e7d5-722d-425d-bc7a-87b9feb05a64 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.300577 Oct 15 03:41:32.789270 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 253/478] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:32 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:32.956647 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-504ebe79-b100-473e-ba01-a6360f106fdb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:32.957354 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-504ebe79-b100-473e-ba01-a6360f106fdb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:32.963618 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-504ebe79-b100-473e-ba01-a6360f106fdb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:32.964233 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-504ebe79-b100-473e-ba01-a6360f106fdb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:32.965152 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-504ebe79-b100-473e-ba01-a6360f106fdb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:32.965688 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-504ebe79-b100-473e-ba01-a6360f106fdb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:33.111574 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4c93884d-9019-4b23-9484-d9243480f4e5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:33.122708 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4c93884d-9019-4b23-9484-d9243480f4e5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1264 microversion: 2.1 time: 0.368584 Oct 15 03:41:33.132356 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 226/479] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:32 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1264 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:33.240251 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-504ebe79-b100-473e-ba01-a6360f106fdb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:33.249334 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-504ebe79-b100-473e-ba01-a6360f106fdb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.296293 Oct 15 03:41:33.249892 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 254/480] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:32 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:33.375316 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b5172d5e-bdef-4ee7-850c-60b01f36a07d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:33.375905 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b5172d5e-bdef-4ee7-850c-60b01f36a07d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:33.382229 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b5172d5e-bdef-4ee7-850c-60b01f36a07d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:33.382701 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b5172d5e-bdef-4ee7-850c-60b01f36a07d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:33.383442 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b5172d5e-bdef-4ee7-850c-60b01f36a07d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:33.383909 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b5172d5e-bdef-4ee7-850c-60b01f36a07d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:33.664907 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b5172d5e-bdef-4ee7-850c-60b01f36a07d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:33.674642 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b5172d5e-bdef-4ee7-850c-60b01f36a07d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1272 microversion: 2.1 time: 0.303018 Oct 15 03:41:33.675239 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 227/481] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:33 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1272 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:33.807801 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-620eaab2-a0b2-4e1a-bca9-a8cb0c38c038 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:33.808693 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-620eaab2-a0b2-4e1a-bca9-a8cb0c38c038 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:33.815149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-620eaab2-a0b2-4e1a-bca9-a8cb0c38c038 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:33.815592 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-620eaab2-a0b2-4e1a-bca9-a8cb0c38c038 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:33.816427 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-620eaab2-a0b2-4e1a-bca9-a8cb0c38c038 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:33.817198 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-620eaab2-a0b2-4e1a-bca9-a8cb0c38c038 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:34.142227 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c1a05c68-6722-4444-8c27-2897edafe4cc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:34.142782 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c1a05c68-6722-4444-8c27-2897edafe4cc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:34.149058 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c1a05c68-6722-4444-8c27-2897edafe4cc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:34.149514 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c1a05c68-6722-4444-8c27-2897edafe4cc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:34.150290 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c1a05c68-6722-4444-8c27-2897edafe4cc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:34.150730 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c1a05c68-6722-4444-8c27-2897edafe4cc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:34.310109 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-620eaab2-a0b2-4e1a-bca9-a8cb0c38c038 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:34.318444 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-620eaab2-a0b2-4e1a-bca9-a8cb0c38c038 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:34.320704 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-620eaab2-a0b2-4e1a-bca9-a8cb0c38c038 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:34.321903 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-620eaab2-a0b2-4e1a-bca9-a8cb0c38c038 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.519310 Oct 15 03:41:34.322465 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 255/482] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:33 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:34.327007 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0ad2740a-1c4f-4c3d-b849-54a6b7a298a9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:34.327805 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0ad2740a-1c4f-4c3d-b849-54a6b7a298a9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:34.333385 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0ad2740a-1c4f-4c3d-b849-54a6b7a298a9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:34.333970 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0ad2740a-1c4f-4c3d-b849-54a6b7a298a9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:34.335338 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0ad2740a-1c4f-4c3d-b849-54a6b7a298a9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:34.335772 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0ad2740a-1c4f-4c3d-b849-54a6b7a298a9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:34.517385 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c1a05c68-6722-4444-8c27-2897edafe4cc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:34.525559 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c1a05c68-6722-4444-8c27-2897edafe4cc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1264 microversion: 2.1 time: 0.386941 Oct 15 03:41:34.526397 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 228/483] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:34 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1264 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:34.538822 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-1b4f6de8-a4b8-4309-a608-ea8c64a87e76 req-76582b91-ca19-4af6-b3a6-5b7143380d9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37285523-63b9-4079-939b-b156366439e6", "tag": "6991361a-3fd3-4d0d-8d4b-edd950821f5d"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:41:34.540416 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:41:34.540416 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 03:41:34.550894 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-1b4f6de8-a4b8-4309-a608-ea8c64a87e76 req-76582b91-ca19-4af6-b3a6-5b7143380d9c service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:34.551335 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-1b4f6de8-a4b8-4309-a608-ea8c64a87e76 req-76582b91-ca19-4af6-b3a6-5b7143380d9c service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:34.562670 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-1b4f6de8-a4b8-4309-a608-ea8c64a87e76 req-76582b91-ca19-4af6-b3a6-5b7143380d9c service nova] Creating event network-changed:6991361a-3fd3-4d0d-8d4b-edd950821f5d for instance 37285523-63b9-4079-939b-b156366439e6 on hv-cinder-81410 Oct 15 03:41:34.572934 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-1b4f6de8-a4b8-4309-a608-ea8c64a87e76 req-76582b91-ca19-4af6-b3a6-5b7143380d9c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045164 Oct 15 03:41:34.573534 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 229/484] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:41:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:41:34.639787 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0ad2740a-1c4f-4c3d-b849-54a6b7a298a9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:34.647814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0ad2740a-1c4f-4c3d-b849-54a6b7a298a9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1522 microversion: 2.1 time: 0.324040 Oct 15 03:41:34.657366 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 256/485] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:34 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:34.691600 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-dece3639-ebc2-489d-8376-3edd50e0efe2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:34.692426 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-dece3639-ebc2-489d-8376-3edd50e0efe2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:34.702288 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dece3639-ebc2-489d-8376-3edd50e0efe2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:34.702803 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dece3639-ebc2-489d-8376-3edd50e0efe2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:34.704005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dece3639-ebc2-489d-8376-3edd50e0efe2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:34.705842 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dece3639-ebc2-489d-8376-3edd50e0efe2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:34.898334 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-dece3639-ebc2-489d-8376-3edd50e0efe2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:34.905616 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-dece3639-ebc2-489d-8376-3edd50e0efe2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1272 microversion: 2.1 time: 0.218044 Oct 15 03:41:34.915336 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 230/486] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:34 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:35.342196 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e66cc1b9-ccbf-49fc-9594-088c212f524e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:35.343012 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e66cc1b9-ccbf-49fc-9594-088c212f524e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:35.365854 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e66cc1b9-ccbf-49fc-9594-088c212f524e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:35.366308 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e66cc1b9-ccbf-49fc-9594-088c212f524e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:35.367088 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e66cc1b9-ccbf-49fc-9594-088c212f524e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:35.368142 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e66cc1b9-ccbf-49fc-9594-088c212f524e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:35.543017 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4b1873c8-030c-4ad3-800c-e6cc71f68c0d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:35.544615 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4b1873c8-030c-4ad3-800c-e6cc71f68c0d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:35.551474 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4b1873c8-030c-4ad3-800c-e6cc71f68c0d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:35.551972 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4b1873c8-030c-4ad3-800c-e6cc71f68c0d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:35.552766 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4b1873c8-030c-4ad3-800c-e6cc71f68c0d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:35.553208 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4b1873c8-030c-4ad3-800c-e6cc71f68c0d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:35.562981 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e66cc1b9-ccbf-49fc-9594-088c212f524e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:35.572064 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e66cc1b9-ccbf-49fc-9594-088c212f524e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:35.573933 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e66cc1b9-ccbf-49fc-9594-088c212f524e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:35.575369 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e66cc1b9-ccbf-49fc-9594-088c212f524e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.238760 Oct 15 03:41:35.586937 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 257/487] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:35 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:35.664122 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-16ede869-3baa-40df-95ba-bfa0e1be00f1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:35.664742 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-16ede869-3baa-40df-95ba-bfa0e1be00f1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:35.670584 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16ede869-3baa-40df-95ba-bfa0e1be00f1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:35.670965 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16ede869-3baa-40df-95ba-bfa0e1be00f1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:35.671775 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16ede869-3baa-40df-95ba-bfa0e1be00f1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:35.672216 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16ede869-3baa-40df-95ba-bfa0e1be00f1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:35.818465 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4b1873c8-030c-4ad3-800c-e6cc71f68c0d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:35.826791 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4b1873c8-030c-4ad3-800c-e6cc71f68c0d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1264 microversion: 2.1 time: 0.287519 Oct 15 03:41:35.827534 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 231/488] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:35 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1264 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:35.888666 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-16ede869-3baa-40df-95ba-bfa0e1be00f1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:35.895783 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-16ede869-3baa-40df-95ba-bfa0e1be00f1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1502 microversion: 2.1 time: 0.235990 Oct 15 03:41:35.906574 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 258/489] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:35 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1502 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:35.913724 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-67521322-80d8-4f21-bea8-9d3db2321386 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13508d53-2fa1-4e66-a409-2d9a75429fcd"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:41:35.916628 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-67521322-80d8-4f21-bea8-9d3db2321386 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:35.922946 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-67521322-80d8-4f21-bea8-9d3db2321386 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:35.923628 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-67521322-80d8-4f21-bea8-9d3db2321386 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:35.923869 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f78c6a49-cd8c-4ee0-9dfa-eee89b2aedf1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:35.924666 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f78c6a49-cd8c-4ee0-9dfa-eee89b2aedf1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:35.924884 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-67521322-80d8-4f21-bea8-9d3db2321386 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:35.925293 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-67521322-80d8-4f21-bea8-9d3db2321386 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:35.931096 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f78c6a49-cd8c-4ee0-9dfa-eee89b2aedf1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:35.931618 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f78c6a49-cd8c-4ee0-9dfa-eee89b2aedf1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:35.932437 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f78c6a49-cd8c-4ee0-9dfa-eee89b2aedf1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:35.932876 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f78c6a49-cd8c-4ee0-9dfa-eee89b2aedf1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:35.949801 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-67521322-80d8-4f21-bea8-9d3db2321386 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] HTTP exception thrown: Cannot 'attach_volume' instance c33f5b74-7b6d-44da-870a-cff6c079605d while it is in vm_state rescued Oct 15 03:41:35.950841 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-67521322-80d8-4f21-bea8-9d3db2321386 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Returning 409 to user: Cannot 'attach_volume' instance c33f5b74-7b6d-44da-870a-cff6c079605d while it is in vm_state rescued {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:41:35.951831 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-67521322-80d8-4f21-bea8-9d3db2321386 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "POST /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042394 Oct 15 03:41:35.952401 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 232/490] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Oct 15 03:41:35 2021] POST /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 15 03:41:35.961070 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-13ab72c6-05b7-476f-bfb3-9514cac18b47 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:41:35.961604 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-13ab72c6-05b7-476f-bfb3-9514cac18b47 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:35.969942 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13ab72c6-05b7-476f-bfb3-9514cac18b47 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:35.970628 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13ab72c6-05b7-476f-bfb3-9514cac18b47 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:35.971773 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13ab72c6-05b7-476f-bfb3-9514cac18b47 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:35.972377 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13ab72c6-05b7-476f-bfb3-9514cac18b47 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:36.054568 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-13ab72c6-05b7-476f-bfb3-9514cac18b47 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "POST /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/action" status: 202 len: 0 microversion: 2.1 time: 0.097138 Oct 15 03:41:36.055265 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 233/491] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 03:41:35 2021] POST /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 15 03:41:36.065012 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b15d9ae8-565c-4a3b-94c6-d77222cd768f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:36.065720 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b15d9ae8-565c-4a3b-94c6-d77222cd768f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:36.072537 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b15d9ae8-565c-4a3b-94c6-d77222cd768f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:36.073341 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b15d9ae8-565c-4a3b-94c6-d77222cd768f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:36.074285 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b15d9ae8-565c-4a3b-94c6-d77222cd768f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:36.074868 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b15d9ae8-565c-4a3b-94c6-d77222cd768f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:36.084042 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f78c6a49-cd8c-4ee0-9dfa-eee89b2aedf1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:36.093100 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f78c6a49-cd8c-4ee0-9dfa-eee89b2aedf1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1272 microversion: 2.1 time: 0.174208 Oct 15 03:41:36.103408 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 259/492] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:35 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1272 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:36.292544 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b15d9ae8-565c-4a3b-94c6-d77222cd768f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:36.300669 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b15d9ae8-565c-4a3b-94c6-d77222cd768f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1510 microversion: 2.1 time: 0.239519 Oct 15 03:41:36.301425 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 234/493] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:36 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1510 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:36.594108 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-18787795-1001-4e03-aaf6-16c3d83e3bff tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:36.594716 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-18787795-1001-4e03-aaf6-16c3d83e3bff tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:36.601132 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18787795-1001-4e03-aaf6-16c3d83e3bff tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:36.601581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18787795-1001-4e03-aaf6-16c3d83e3bff tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:36.602352 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18787795-1001-4e03-aaf6-16c3d83e3bff tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:36.602783 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18787795-1001-4e03-aaf6-16c3d83e3bff tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:36.727455 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-18787795-1001-4e03-aaf6-16c3d83e3bff tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:36.735643 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-18787795-1001-4e03-aaf6-16c3d83e3bff tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:36.737165 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-18787795-1001-4e03-aaf6-16c3d83e3bff tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:36.738310 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-18787795-1001-4e03-aaf6-16c3d83e3bff tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.147882 Oct 15 03:41:36.738923 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 260/494] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:36 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:36.846347 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fd4c83cd-883b-4dcd-a471-436d6194701f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:36.846963 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fd4c83cd-883b-4dcd-a471-436d6194701f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:36.853495 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd4c83cd-883b-4dcd-a471-436d6194701f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:36.854031 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd4c83cd-883b-4dcd-a471-436d6194701f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:36.854881 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd4c83cd-883b-4dcd-a471-436d6194701f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:36.855324 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd4c83cd-883b-4dcd-a471-436d6194701f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:36.984388 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fd4c83cd-883b-4dcd-a471-436d6194701f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:36.991784 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fd4c83cd-883b-4dcd-a471-436d6194701f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1264 microversion: 2.1 time: 0.150326 Oct 15 03:41:36.992353 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 235/495] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:36 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:37.111382 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-147a5b3b-0ec8-4597-af40-6afd17cfa7ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:37.112028 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-147a5b3b-0ec8-4597-af40-6afd17cfa7ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:37.117661 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-147a5b3b-0ec8-4597-af40-6afd17cfa7ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:37.118110 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-147a5b3b-0ec8-4597-af40-6afd17cfa7ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:37.118875 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-147a5b3b-0ec8-4597-af40-6afd17cfa7ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:37.119312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-147a5b3b-0ec8-4597-af40-6afd17cfa7ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:37.242974 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-147a5b3b-0ec8-4597-af40-6afd17cfa7ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:37.250227 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-147a5b3b-0ec8-4597-af40-6afd17cfa7ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1272 microversion: 2.1 time: 0.142430 Oct 15 03:41:37.260462 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 261/496] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:37 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1272 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:37.317918 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e5a90c44-6ab5-48c5-a653-815354e2244e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:37.318600 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e5a90c44-6ab5-48c5-a653-815354e2244e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:37.324766 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e5a90c44-6ab5-48c5-a653-815354e2244e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:37.325282 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e5a90c44-6ab5-48c5-a653-815354e2244e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:37.326105 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e5a90c44-6ab5-48c5-a653-815354e2244e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:37.326607 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e5a90c44-6ab5-48c5-a653-815354e2244e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:37.446157 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e5a90c44-6ab5-48c5-a653-815354e2244e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:37.453610 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e5a90c44-6ab5-48c5-a653-815354e2244e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1510 microversion: 2.1 time: 0.139169 Oct 15 03:41:37.454075 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 236/497] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:37 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1510 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:37.756591 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-50e4540c-d07a-4a09-ab03-6052b11ab243 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:37.757193 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-50e4540c-d07a-4a09-ab03-6052b11ab243 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:37.763552 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50e4540c-d07a-4a09-ab03-6052b11ab243 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:37.764030 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50e4540c-d07a-4a09-ab03-6052b11ab243 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:37.764782 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50e4540c-d07a-4a09-ab03-6052b11ab243 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:37.765213 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50e4540c-d07a-4a09-ab03-6052b11ab243 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:37.884911 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-50e4540c-d07a-4a09-ab03-6052b11ab243 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:37.892841 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-50e4540c-d07a-4a09-ab03-6052b11ab243 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:37.894327 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-50e4540c-d07a-4a09-ab03-6052b11ab243 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:37.895462 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-50e4540c-d07a-4a09-ab03-6052b11ab243 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.142590 Oct 15 03:41:37.896044 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 262/498] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:37 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:38.008218 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-11e04c95-e84d-4e28-b64f-89de567d99a0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:38.008753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-11e04c95-e84d-4e28-b64f-89de567d99a0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:38.014472 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-11e04c95-e84d-4e28-b64f-89de567d99a0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:38.014922 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-11e04c95-e84d-4e28-b64f-89de567d99a0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:38.015699 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-11e04c95-e84d-4e28-b64f-89de567d99a0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:38.016130 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-11e04c95-e84d-4e28-b64f-89de567d99a0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:38.134737 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-11e04c95-e84d-4e28-b64f-89de567d99a0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:38.141899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-11e04c95-e84d-4e28-b64f-89de567d99a0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1264 microversion: 2.1 time: 0.137325 Oct 15 03:41:38.142468 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 237/499] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:38 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:38.267339 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b60111c4-bed5-4bc5-bad8-0f369f49e5b6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:38.267909 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b60111c4-bed5-4bc5-bad8-0f369f49e5b6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:38.273808 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b60111c4-bed5-4bc5-bad8-0f369f49e5b6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:38.274248 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b60111c4-bed5-4bc5-bad8-0f369f49e5b6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:38.275411 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b60111c4-bed5-4bc5-bad8-0f369f49e5b6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:38.275872 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b60111c4-bed5-4bc5-bad8-0f369f49e5b6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:38.395397 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b60111c4-bed5-4bc5-bad8-0f369f49e5b6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:38.403502 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b60111c4-bed5-4bc5-bad8-0f369f49e5b6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1272 microversion: 2.1 time: 0.139808 Oct 15 03:41:38.404426 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 263/500] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:38 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1272 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:38.471588 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2dfe1742-fcc8-484d-b4c2-9bc5beed8294 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:38.472232 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2dfe1742-fcc8-484d-b4c2-9bc5beed8294 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:38.478474 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2dfe1742-fcc8-484d-b4c2-9bc5beed8294 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:38.478920 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2dfe1742-fcc8-484d-b4c2-9bc5beed8294 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:38.479670 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2dfe1742-fcc8-484d-b4c2-9bc5beed8294 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:38.480123 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2dfe1742-fcc8-484d-b4c2-9bc5beed8294 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:38.597274 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2dfe1742-fcc8-484d-b4c2-9bc5beed8294 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:38.605079 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2dfe1742-fcc8-484d-b4c2-9bc5beed8294 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1516 microversion: 2.1 time: 0.137073 Oct 15 03:41:38.605647 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 238/501] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:38 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1516 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:38.913142 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3bc0db5d-18d3-4266-b1be-3a2db3d3962e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:38.913780 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3bc0db5d-18d3-4266-b1be-3a2db3d3962e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:38.919762 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3bc0db5d-18d3-4266-b1be-3a2db3d3962e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:38.920216 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3bc0db5d-18d3-4266-b1be-3a2db3d3962e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:38.920976 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3bc0db5d-18d3-4266-b1be-3a2db3d3962e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:38.921408 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3bc0db5d-18d3-4266-b1be-3a2db3d3962e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:39.054565 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3bc0db5d-18d3-4266-b1be-3a2db3d3962e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:39.062710 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3bc0db5d-18d3-4266-b1be-3a2db3d3962e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:39.064163 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3bc0db5d-18d3-4266-b1be-3a2db3d3962e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:39.065318 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3bc0db5d-18d3-4266-b1be-3a2db3d3962e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.155877 Oct 15 03:41:39.065871 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 264/502] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:38 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:39.158258 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d2a2ac34-2efa-4ee1-a45e-f59bc94f0184 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:39.159295 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d2a2ac34-2efa-4ee1-a45e-f59bc94f0184 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:39.164988 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d2a2ac34-2efa-4ee1-a45e-f59bc94f0184 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:39.165435 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d2a2ac34-2efa-4ee1-a45e-f59bc94f0184 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:39.166196 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d2a2ac34-2efa-4ee1-a45e-f59bc94f0184 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:39.166631 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d2a2ac34-2efa-4ee1-a45e-f59bc94f0184 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:39.284213 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d2a2ac34-2efa-4ee1-a45e-f59bc94f0184 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:39.291945 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d2a2ac34-2efa-4ee1-a45e-f59bc94f0184 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1264 microversion: 2.1 time: 0.137363 Oct 15 03:41:39.292507 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 239/503] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:39 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:39.420426 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9ed16858-aa71-468e-a04b-f27e1d2cc6fd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:39.421038 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9ed16858-aa71-468e-a04b-f27e1d2cc6fd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:39.426679 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9ed16858-aa71-468e-a04b-f27e1d2cc6fd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:39.427126 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9ed16858-aa71-468e-a04b-f27e1d2cc6fd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:39.427912 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9ed16858-aa71-468e-a04b-f27e1d2cc6fd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:39.428889 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9ed16858-aa71-468e-a04b-f27e1d2cc6fd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:39.542824 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9ed16858-aa71-468e-a04b-f27e1d2cc6fd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:39.549893 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9ed16858-aa71-468e-a04b-f27e1d2cc6fd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1272 microversion: 2.1 time: 0.133056 Oct 15 03:41:39.550445 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 265/504] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:39 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:39.908875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d7856d91-1d84-49f2-87ea-4f7ff42ba724 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:39.909485 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d7856d91-1d84-49f2-87ea-4f7ff42ba724 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:39.915762 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d7856d91-1d84-49f2-87ea-4f7ff42ba724 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:39.916210 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d7856d91-1d84-49f2-87ea-4f7ff42ba724 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:39.916967 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d7856d91-1d84-49f2-87ea-4f7ff42ba724 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:39.917397 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d7856d91-1d84-49f2-87ea-4f7ff42ba724 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:40.035764 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d7856d91-1d84-49f2-87ea-4f7ff42ba724 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:40.044014 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d7856d91-1d84-49f2-87ea-4f7ff42ba724 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1516 microversion: 2.1 time: 0.138658 Oct 15 03:41:40.044577 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 240/505] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:39 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1516 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:40.061879 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-81a711e1-5789-4676-9a40-09019a33eef0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06d79cd1-1f75-4ca9-9595-602627841dff"}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:41:40.063160 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-81a711e1-5789-4676-9a40-09019a33eef0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:40.068980 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81a711e1-5789-4676-9a40-09019a33eef0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:40.069503 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81a711e1-5789-4676-9a40-09019a33eef0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:40.070346 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81a711e1-5789-4676-9a40-09019a33eef0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:40.070849 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81a711e1-5789-4676-9a40-09019a33eef0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:40.085287 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-51a01d84-b74d-4316-9b53-39f768f4dc80 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:40.086230 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-51a01d84-b74d-4316-9b53-39f768f4dc80 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:40.092431 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51a01d84-b74d-4316-9b53-39f768f4dc80 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:40.092887 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51a01d84-b74d-4316-9b53-39f768f4dc80 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:40.093658 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51a01d84-b74d-4316-9b53-39f768f4dc80 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:40.094090 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51a01d84-b74d-4316-9b53-39f768f4dc80 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:40.231350 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-51a01d84-b74d-4316-9b53-39f768f4dc80 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:40.245013 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-51a01d84-b74d-4316-9b53-39f768f4dc80 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:40.246643 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-51a01d84-b74d-4316-9b53-39f768f4dc80 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:40.247694 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-51a01d84-b74d-4316-9b53-39f768f4dc80 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.167268 Oct 15 03:41:40.251791 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 241/506] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:40 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:41:40.308463 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-202b59e7-ab5a-4afa-9651-d7855c516b74 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:40.309077 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-202b59e7-ab5a-4afa-9651-d7855c516b74 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:40.315247 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-202b59e7-ab5a-4afa-9651-d7855c516b74 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:40.315720 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-202b59e7-ab5a-4afa-9651-d7855c516b74 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:40.316487 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-202b59e7-ab5a-4afa-9651-d7855c516b74 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:40.316925 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-202b59e7-ab5a-4afa-9651-d7855c516b74 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:40.332415 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-81a711e1-5789-4676-9a40-09019a33eef0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "POST /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276274 Oct 15 03:41:40.333054 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 266/507] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Oct 15 03:41:40 2021] POST /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:41:40.449590 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-202b59e7-ab5a-4afa-9651-d7855c516b74 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:40.456872 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-202b59e7-ab5a-4afa-9651-d7855c516b74 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1264 microversion: 2.1 time: 0.152033 Oct 15 03:41:40.457413 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 242/508] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:40 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:40.567274 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c9b6458e-6409-4285-8654-4a971b44c1e8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:40.568018 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c9b6458e-6409-4285-8654-4a971b44c1e8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:40.574407 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c9b6458e-6409-4285-8654-4a971b44c1e8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:40.574855 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c9b6458e-6409-4285-8654-4a971b44c1e8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:40.575615 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c9b6458e-6409-4285-8654-4a971b44c1e8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:40.576077 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c9b6458e-6409-4285-8654-4a971b44c1e8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:40.698679 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c9b6458e-6409-4285-8654-4a971b44c1e8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:40.705937 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c9b6458e-6409-4285-8654-4a971b44c1e8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1272 microversion: 2.1 time: 0.142622 Oct 15 03:41:40.706490 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 267/509] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:40 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1272 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:41.265927 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-840f704e-df98-4258-a446-d4425b0d1ea1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:41.266526 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-840f704e-df98-4258-a446-d4425b0d1ea1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:41.272140 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-840f704e-df98-4258-a446-d4425b0d1ea1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:41.272584 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-840f704e-df98-4258-a446-d4425b0d1ea1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:41.273333 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-840f704e-df98-4258-a446-d4425b0d1ea1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:41.273763 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-840f704e-df98-4258-a446-d4425b0d1ea1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:41.398385 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-840f704e-df98-4258-a446-d4425b0d1ea1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:41.406885 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-840f704e-df98-4258-a446-d4425b0d1ea1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:41.408405 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-840f704e-df98-4258-a446-d4425b0d1ea1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:41.409549 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-840f704e-df98-4258-a446-d4425b0d1ea1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.147277 Oct 15 03:41:41.410098 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 243/510] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:41 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:41.475457 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4761dfcc-eba3-4af6-9b56-2a33e8b5117b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:41.476441 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4761dfcc-eba3-4af6-9b56-2a33e8b5117b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:41.483947 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4761dfcc-eba3-4af6-9b56-2a33e8b5117b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:41.484578 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4761dfcc-eba3-4af6-9b56-2a33e8b5117b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:41.485440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4761dfcc-eba3-4af6-9b56-2a33e8b5117b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:41.486048 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4761dfcc-eba3-4af6-9b56-2a33e8b5117b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:41.609761 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4761dfcc-eba3-4af6-9b56-2a33e8b5117b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:41.617546 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4761dfcc-eba3-4af6-9b56-2a33e8b5117b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1264 microversion: 2.1 time: 0.146804 Oct 15 03:41:41.618486 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 268/511] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:41 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:41.722118 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c6410fb6-eb30-453b-9c83-4d3e817ad875 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:41.722726 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c6410fb6-eb30-453b-9c83-4d3e817ad875 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:41.728670 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6410fb6-eb30-453b-9c83-4d3e817ad875 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:41.729136 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6410fb6-eb30-453b-9c83-4d3e817ad875 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:41.729885 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6410fb6-eb30-453b-9c83-4d3e817ad875 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:41.730319 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6410fb6-eb30-453b-9c83-4d3e817ad875 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:41.850521 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c6410fb6-eb30-453b-9c83-4d3e817ad875 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:41.857734 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c6410fb6-eb30-453b-9c83-4d3e817ad875 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1272 microversion: 2.1 time: 0.139320 Oct 15 03:41:41.858301 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 244/512] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:41 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1272 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:42.428025 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-851fdca3-e498-4c9d-b396-dcf7c8a29cca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:42.429256 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-851fdca3-e498-4c9d-b396-dcf7c8a29cca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:42.435170 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-851fdca3-e498-4c9d-b396-dcf7c8a29cca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:42.435633 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-851fdca3-e498-4c9d-b396-dcf7c8a29cca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:42.436712 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-851fdca3-e498-4c9d-b396-dcf7c8a29cca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:42.437230 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-851fdca3-e498-4c9d-b396-dcf7c8a29cca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:42.565874 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-851fdca3-e498-4c9d-b396-dcf7c8a29cca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:42.576867 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-851fdca3-e498-4c9d-b396-dcf7c8a29cca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:42.578807 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-851fdca3-e498-4c9d-b396-dcf7c8a29cca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:42.580098 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-851fdca3-e498-4c9d-b396-dcf7c8a29cca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.155798 Oct 15 03:41:42.580860 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 269/513] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:42 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:42.634294 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c2ead02c-14ef-411b-8b7d-d1f3261b0dfc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:42.635160 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c2ead02c-14ef-411b-8b7d-d1f3261b0dfc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:42.641235 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c2ead02c-14ef-411b-8b7d-d1f3261b0dfc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:42.641879 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c2ead02c-14ef-411b-8b7d-d1f3261b0dfc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:42.642934 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c2ead02c-14ef-411b-8b7d-d1f3261b0dfc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:42.643781 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c2ead02c-14ef-411b-8b7d-d1f3261b0dfc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:42.809903 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c2ead02c-14ef-411b-8b7d-d1f3261b0dfc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:42.818213 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c2ead02c-14ef-411b-8b7d-d1f3261b0dfc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1264 microversion: 2.1 time: 0.187800 Oct 15 03:41:42.818822 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 245/514] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:42 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:42.874675 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ff6eb1fb-fb9c-4657-9451-6a6af654dca1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:42.875433 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ff6eb1fb-fb9c-4657-9451-6a6af654dca1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:42.882985 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff6eb1fb-fb9c-4657-9451-6a6af654dca1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:42.883481 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff6eb1fb-fb9c-4657-9451-6a6af654dca1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:42.884606 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff6eb1fb-fb9c-4657-9451-6a6af654dca1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:42.885400 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff6eb1fb-fb9c-4657-9451-6a6af654dca1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:43.027002 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ff6eb1fb-fb9c-4657-9451-6a6af654dca1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:43.034256 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ff6eb1fb-fb9c-4657-9451-6a6af654dca1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1260 microversion: 2.1 time: 0.163768 Oct 15 03:41:43.034918 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 270/515] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:42 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:43.598527 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-596f4c95-2a88-4018-a981-628cf7474059 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:43.599160 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-596f4c95-2a88-4018-a981-628cf7474059 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:43.605842 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-596f4c95-2a88-4018-a981-628cf7474059 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:43.606285 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-596f4c95-2a88-4018-a981-628cf7474059 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:43.607043 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-596f4c95-2a88-4018-a981-628cf7474059 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:43.607470 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-596f4c95-2a88-4018-a981-628cf7474059 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:43.728944 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-596f4c95-2a88-4018-a981-628cf7474059 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:43.737072 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-596f4c95-2a88-4018-a981-628cf7474059 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:43.738570 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-596f4c95-2a88-4018-a981-628cf7474059 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:43.739733 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-596f4c95-2a88-4018-a981-628cf7474059 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.144905 Oct 15 03:41:43.740322 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 246/516] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:43 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:43.835753 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9c5cb2b6-582b-491b-83be-6507a76c47cf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:43.836361 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9c5cb2b6-582b-491b-83be-6507a76c47cf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:43.842785 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9c5cb2b6-582b-491b-83be-6507a76c47cf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:43.843253 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9c5cb2b6-582b-491b-83be-6507a76c47cf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:43.844106 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9c5cb2b6-582b-491b-83be-6507a76c47cf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:43.844542 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9c5cb2b6-582b-491b-83be-6507a76c47cf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:43.965048 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9c5cb2b6-582b-491b-83be-6507a76c47cf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:43.972639 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9c5cb2b6-582b-491b-83be-6507a76c47cf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1264 microversion: 2.1 time: 0.141101 Oct 15 03:41:43.973196 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 271/517] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:43 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1264 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:44.049985 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d7034d9d-40e2-4624-b3cd-c22753ee73b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:44.050581 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d7034d9d-40e2-4624-b3cd-c22753ee73b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:44.057032 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d7034d9d-40e2-4624-b3cd-c22753ee73b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:44.057485 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d7034d9d-40e2-4624-b3cd-c22753ee73b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:44.058262 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d7034d9d-40e2-4624-b3cd-c22753ee73b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:44.058699 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d7034d9d-40e2-4624-b3cd-c22753ee73b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:44.179435 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d7034d9d-40e2-4624-b3cd-c22753ee73b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:44.186578 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d7034d9d-40e2-4624-b3cd-c22753ee73b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1260 microversion: 2.1 time: 0.140162 Oct 15 03:41:44.187149 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 247/518] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:44 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1260 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:44.758006 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0a0a7dc5-3624-4eeb-8d29-367d636f4b38 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:44.758601 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0a0a7dc5-3624-4eeb-8d29-367d636f4b38 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:44.764592 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0a0a7dc5-3624-4eeb-8d29-367d636f4b38 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:44.765103 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0a0a7dc5-3624-4eeb-8d29-367d636f4b38 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:44.766031 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0a0a7dc5-3624-4eeb-8d29-367d636f4b38 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:44.766503 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0a0a7dc5-3624-4eeb-8d29-367d636f4b38 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:44.887037 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0a0a7dc5-3624-4eeb-8d29-367d636f4b38 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:44.895103 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0a0a7dc5-3624-4eeb-8d29-367d636f4b38 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:44.896549 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0a0a7dc5-3624-4eeb-8d29-367d636f4b38 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:44.897689 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0a0a7dc5-3624-4eeb-8d29-367d636f4b38 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.143986 Oct 15 03:41:44.898236 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 272/519] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:44 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:44.988859 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-dfb4bc47-82d4-4026-ad6f-695f2e114531 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:44.989467 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-dfb4bc47-82d4-4026-ad6f-695f2e114531 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:44.995713 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dfb4bc47-82d4-4026-ad6f-695f2e114531 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:44.996162 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dfb4bc47-82d4-4026-ad6f-695f2e114531 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:44.996920 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dfb4bc47-82d4-4026-ad6f-695f2e114531 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:44.997352 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dfb4bc47-82d4-4026-ad6f-695f2e114531 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:45.114599 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-dfb4bc47-82d4-4026-ad6f-695f2e114531 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:45.122438 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-dfb4bc47-82d4-4026-ad6f-695f2e114531 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1264 microversion: 2.1 time: 0.137156 Oct 15 03:41:45.123003 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 248/520] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:44 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:45.203720 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-571633a5-0832-47c8-8ace-471f4990a476 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:45.204294 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-571633a5-0832-47c8-8ace-471f4990a476 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:45.210198 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-571633a5-0832-47c8-8ace-471f4990a476 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:45.210645 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-571633a5-0832-47c8-8ace-471f4990a476 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:45.211405 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-571633a5-0832-47c8-8ace-471f4990a476 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:45.211870 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-571633a5-0832-47c8-8ace-471f4990a476 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:45.332477 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-571633a5-0832-47c8-8ace-471f4990a476 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:45.339802 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-571633a5-0832-47c8-8ace-471f4990a476 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1260 microversion: 2.1 time: 0.139771 Oct 15 03:41:45.340361 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 273/521] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:45 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1260 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:45.914577 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-49530a31-2b44-4409-a5cf-817148f411fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:45.915178 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-49530a31-2b44-4409-a5cf-817148f411fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:45.920905 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-49530a31-2b44-4409-a5cf-817148f411fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:45.921353 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-49530a31-2b44-4409-a5cf-817148f411fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:45.922109 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-49530a31-2b44-4409-a5cf-817148f411fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:45.922539 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-49530a31-2b44-4409-a5cf-817148f411fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:46.043636 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-49530a31-2b44-4409-a5cf-817148f411fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:46.051850 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-49530a31-2b44-4409-a5cf-817148f411fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:46.053339 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-49530a31-2b44-4409-a5cf-817148f411fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:46.054488 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-49530a31-2b44-4409-a5cf-817148f411fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.143578 Oct 15 03:41:46.055033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 249/522] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:45 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:46.139136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-89ab81ea-4890-4651-b83f-0cce17bccfb6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:46.139857 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-89ab81ea-4890-4651-b83f-0cce17bccfb6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:46.145652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-89ab81ea-4890-4651-b83f-0cce17bccfb6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:46.146104 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-89ab81ea-4890-4651-b83f-0cce17bccfb6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:46.147583 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-89ab81ea-4890-4651-b83f-0cce17bccfb6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:46.147889 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-89ab81ea-4890-4651-b83f-0cce17bccfb6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:46.270116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-89ab81ea-4890-4651-b83f-0cce17bccfb6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:46.277605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-89ab81ea-4890-4651-b83f-0cce17bccfb6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1264 microversion: 2.1 time: 0.142147 Oct 15 03:41:46.278167 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 274/523] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:46 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1264 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:46.356352 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2ff4bf0c-4d9d-4b94-95c3-eba6ef680cb5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:46.357209 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2ff4bf0c-4d9d-4b94-95c3-eba6ef680cb5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:46.363072 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2ff4bf0c-4d9d-4b94-95c3-eba6ef680cb5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:46.363517 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2ff4bf0c-4d9d-4b94-95c3-eba6ef680cb5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:46.364316 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2ff4bf0c-4d9d-4b94-95c3-eba6ef680cb5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:46.364748 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2ff4bf0c-4d9d-4b94-95c3-eba6ef680cb5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:46.686408 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2ff4bf0c-4d9d-4b94-95c3-eba6ef680cb5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:46.693463 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2ff4bf0c-4d9d-4b94-95c3-eba6ef680cb5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1260 microversion: 2.1 time: 0.340852 Oct 15 03:41:46.694105 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 250/524] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:46 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1260 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:47.072396 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e0cdeff5-b97b-4456-9514-03890b22d266 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:47.073000 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e0cdeff5-b97b-4456-9514-03890b22d266 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:47.078796 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0cdeff5-b97b-4456-9514-03890b22d266 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:47.079242 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0cdeff5-b97b-4456-9514-03890b22d266 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:47.080021 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0cdeff5-b97b-4456-9514-03890b22d266 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:47.080447 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0cdeff5-b97b-4456-9514-03890b22d266 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:47.200307 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e0cdeff5-b97b-4456-9514-03890b22d266 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:47.208698 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e0cdeff5-b97b-4456-9514-03890b22d266 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:47.210684 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e0cdeff5-b97b-4456-9514-03890b22d266 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:47.211868 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e0cdeff5-b97b-4456-9514-03890b22d266 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.143367 Oct 15 03:41:47.212427 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 275/525] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:47 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:47.294105 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c3cd0425-0ff8-4f38-a7dc-d51c73b8474e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:47.294713 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c3cd0425-0ff8-4f38-a7dc-d51c73b8474e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:47.300419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c3cd0425-0ff8-4f38-a7dc-d51c73b8474e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:47.300866 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c3cd0425-0ff8-4f38-a7dc-d51c73b8474e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:47.301625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c3cd0425-0ff8-4f38-a7dc-d51c73b8474e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:47.302058 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c3cd0425-0ff8-4f38-a7dc-d51c73b8474e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:47.419827 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c3cd0425-0ff8-4f38-a7dc-d51c73b8474e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:47.426936 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c3cd0425-0ff8-4f38-a7dc-d51c73b8474e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1264 microversion: 2.1 time: 0.136466 Oct 15 03:41:47.427488 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 251/526] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:47 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:47.710350 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-324f6ce7-c9bc-4d0e-afce-82afdf40aa4d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:47.710884 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-324f6ce7-c9bc-4d0e-afce-82afdf40aa4d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:47.716865 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-324f6ce7-c9bc-4d0e-afce-82afdf40aa4d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:47.717312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-324f6ce7-c9bc-4d0e-afce-82afdf40aa4d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:47.718072 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-324f6ce7-c9bc-4d0e-afce-82afdf40aa4d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:47.718504 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-324f6ce7-c9bc-4d0e-afce-82afdf40aa4d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:47.838920 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-324f6ce7-c9bc-4d0e-afce-82afdf40aa4d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:47.846495 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-324f6ce7-c9bc-4d0e-afce-82afdf40aa4d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1260 microversion: 2.1 time: 0.140503 Oct 15 03:41:47.847076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 276/527] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:47 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1260 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:48.230566 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4610abef-7226-4a1f-98f3-bc5fc2798721 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:48.231186 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4610abef-7226-4a1f-98f3-bc5fc2798721 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:48.236992 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4610abef-7226-4a1f-98f3-bc5fc2798721 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:48.237434 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4610abef-7226-4a1f-98f3-bc5fc2798721 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:48.238193 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4610abef-7226-4a1f-98f3-bc5fc2798721 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:48.238623 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4610abef-7226-4a1f-98f3-bc5fc2798721 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:48.356704 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4610abef-7226-4a1f-98f3-bc5fc2798721 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:48.364673 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4610abef-7226-4a1f-98f3-bc5fc2798721 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:48.366755 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4610abef-7226-4a1f-98f3-bc5fc2798721 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:48.367927 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4610abef-7226-4a1f-98f3-bc5fc2798721 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.141049 Oct 15 03:41:48.368474 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 252/528] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:48 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:48.443101 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cc7566af-f82b-433b-af63-e0fcd05f0b1f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:48.443815 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cc7566af-f82b-433b-af63-e0fcd05f0b1f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:48.449574 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cc7566af-f82b-433b-af63-e0fcd05f0b1f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:48.450018 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cc7566af-f82b-433b-af63-e0fcd05f0b1f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:48.450774 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cc7566af-f82b-433b-af63-e0fcd05f0b1f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:48.451205 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cc7566af-f82b-433b-af63-e0fcd05f0b1f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:48.565966 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-cc7566af-f82b-433b-af63-e0fcd05f0b1f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:48.573207 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cc7566af-f82b-433b-af63-e0fcd05f0b1f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1264 microversion: 2.1 time: 0.133692 Oct 15 03:41:48.573762 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 277/529] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:48 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1264 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:48.862004 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3d982e49-6f25-4caa-8df3-38606957f460 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:48.862642 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3d982e49-6f25-4caa-8df3-38606957f460 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:48.868855 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3d982e49-6f25-4caa-8df3-38606957f460 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:48.869300 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3d982e49-6f25-4caa-8df3-38606957f460 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:48.870060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3d982e49-6f25-4caa-8df3-38606957f460 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:48.870489 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3d982e49-6f25-4caa-8df3-38606957f460 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:48.988402 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3d982e49-6f25-4caa-8df3-38606957f460 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:48.996276 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3d982e49-6f25-4caa-8df3-38606957f460 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1260 microversion: 2.1 time: 0.137907 Oct 15 03:41:48.996836 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 253/530] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:48 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1260 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:49.386404 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4ecc9f3a-be21-4043-8ec2-50aaaf9894b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:49.387009 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4ecc9f3a-be21-4043-8ec2-50aaaf9894b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:49.392738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4ecc9f3a-be21-4043-8ec2-50aaaf9894b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:49.393187 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4ecc9f3a-be21-4043-8ec2-50aaaf9894b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:49.393942 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4ecc9f3a-be21-4043-8ec2-50aaaf9894b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:49.394374 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4ecc9f3a-be21-4043-8ec2-50aaaf9894b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:49.509312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4ecc9f3a-be21-4043-8ec2-50aaaf9894b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:49.517400 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4ecc9f3a-be21-4043-8ec2-50aaaf9894b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:49.518870 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4ecc9f3a-be21-4043-8ec2-50aaaf9894b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:49.520015 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4ecc9f3a-be21-4043-8ec2-50aaaf9894b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.137266 Oct 15 03:41:49.520564 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 278/531] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:49 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:49.589645 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-dc5de581-c68f-49ff-8cb8-ae0045ecb49d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:49.590245 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-dc5de581-c68f-49ff-8cb8-ae0045ecb49d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:49.595975 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dc5de581-c68f-49ff-8cb8-ae0045ecb49d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:49.596420 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dc5de581-c68f-49ff-8cb8-ae0045ecb49d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:49.597166 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dc5de581-c68f-49ff-8cb8-ae0045ecb49d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:49.597594 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dc5de581-c68f-49ff-8cb8-ae0045ecb49d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:49.716667 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-dc5de581-c68f-49ff-8cb8-ae0045ecb49d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:49.725929 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-dc5de581-c68f-49ff-8cb8-ae0045ecb49d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1264 microversion: 2.1 time: 0.140067 Oct 15 03:41:49.726491 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 254/532] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:49 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:50.012891 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-880b0448-5a6b-4f36-ad49-759c1537dc5d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:50.013503 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-880b0448-5a6b-4f36-ad49-759c1537dc5d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:50.019255 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-880b0448-5a6b-4f36-ad49-759c1537dc5d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:50.019727 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-880b0448-5a6b-4f36-ad49-759c1537dc5d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:50.020487 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-880b0448-5a6b-4f36-ad49-759c1537dc5d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:50.020944 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-880b0448-5a6b-4f36-ad49-759c1537dc5d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:50.144241 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-880b0448-5a6b-4f36-ad49-759c1537dc5d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:50.152655 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-880b0448-5a6b-4f36-ad49-759c1537dc5d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1260 microversion: 2.1 time: 0.143186 Oct 15 03:41:50.153229 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 279/533] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:50 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1260 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:50.537752 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6763eae7-c591-4225-8701-3d23afc07048 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:50.538355 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6763eae7-c591-4225-8701-3d23afc07048 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:50.544405 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6763eae7-c591-4225-8701-3d23afc07048 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:50.544847 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6763eae7-c591-4225-8701-3d23afc07048 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:50.545594 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6763eae7-c591-4225-8701-3d23afc07048 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:50.546021 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6763eae7-c591-4225-8701-3d23afc07048 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:50.663036 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6763eae7-c591-4225-8701-3d23afc07048 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:50.671036 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6763eae7-c591-4225-8701-3d23afc07048 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:50.672545 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6763eae7-c591-4225-8701-3d23afc07048 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:50.673689 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6763eae7-c591-4225-8701-3d23afc07048 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.140187 Oct 15 03:41:50.674235 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 255/534] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:50 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:50.741746 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2ca32bef-5cb4-4ba2-adc0-f35cd1134053 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:50.742354 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2ca32bef-5cb4-4ba2-adc0-f35cd1134053 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:50.748108 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2ca32bef-5cb4-4ba2-adc0-f35cd1134053 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:50.748557 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2ca32bef-5cb4-4ba2-adc0-f35cd1134053 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:50.749321 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2ca32bef-5cb4-4ba2-adc0-f35cd1134053 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:50.749755 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2ca32bef-5cb4-4ba2-adc0-f35cd1134053 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:50.866069 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2ca32bef-5cb4-4ba2-adc0-f35cd1134053 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:50.873214 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2ca32bef-5cb4-4ba2-adc0-f35cd1134053 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1264 microversion: 2.1 time: 0.135137 Oct 15 03:41:50.873771 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 280/535] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:50 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1264 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:51.169001 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ddbc58c9-e349-4b35-ba7b-3d3cd477e99b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:51.169520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ddbc58c9-e349-4b35-ba7b-3d3cd477e99b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:51.175320 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ddbc58c9-e349-4b35-ba7b-3d3cd477e99b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:51.175795 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ddbc58c9-e349-4b35-ba7b-3d3cd477e99b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:51.176544 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ddbc58c9-e349-4b35-ba7b-3d3cd477e99b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:51.177170 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ddbc58c9-e349-4b35-ba7b-3d3cd477e99b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:51.296373 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ddbc58c9-e349-4b35-ba7b-3d3cd477e99b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:51.303843 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ddbc58c9-e349-4b35-ba7b-3d3cd477e99b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1260 microversion: 2.1 time: 0.138194 Oct 15 03:41:51.304695 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 256/536] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:51 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1260 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:51.613897 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-f4cdebec-97d2-4052-8740-30edff251986 req-48cc748b-fe6d-4880-958b-81400b2859e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e429526-26c8-4d98-8691-73770db59513", "name": "network-vif-plugged", "status": "completed", "tag": "b203b749-dead-423e-8bfb-4c494e6c63ab"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:41:51.616023 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:41:51.616023 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:41:51.622769 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-f4cdebec-97d2-4052-8740-30edff251986 req-48cc748b-fe6d-4880-958b-81400b2859e7 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:51.623228 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-f4cdebec-97d2-4052-8740-30edff251986 req-48cc748b-fe6d-4880-958b-81400b2859e7 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:51.636002 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-f4cdebec-97d2-4052-8740-30edff251986 req-48cc748b-fe6d-4880-958b-81400b2859e7 service nova] Creating event network-vif-plugged:b203b749-dead-423e-8bfb-4c494e6c63ab for instance 6e429526-26c8-4d98-8691-73770db59513 on hv-cinder-81410 Oct 15 03:41:51.641389 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-f4cdebec-97d2-4052-8740-30edff251986 req-48cc748b-fe6d-4880-958b-81400b2859e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031120 Oct 15 03:41:51.641971 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 281/537] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:41:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:41:51.692068 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-76ae0cb7-6fa2-45f7-b54a-3f4ef00182fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:51.692607 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-76ae0cb7-6fa2-45f7-b54a-3f4ef00182fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:51.698855 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-76ae0cb7-6fa2-45f7-b54a-3f4ef00182fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:51.699286 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-76ae0cb7-6fa2-45f7-b54a-3f4ef00182fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:51.700099 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-76ae0cb7-6fa2-45f7-b54a-3f4ef00182fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:51.700520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-76ae0cb7-6fa2-45f7-b54a-3f4ef00182fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:51.826758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-76ae0cb7-6fa2-45f7-b54a-3f4ef00182fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:51.836176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-76ae0cb7-6fa2-45f7-b54a-3f4ef00182fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:51.837940 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-76ae0cb7-6fa2-45f7-b54a-3f4ef00182fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:51.839447 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-76ae0cb7-6fa2-45f7-b54a-3f4ef00182fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.151154 Oct 15 03:41:51.840072 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 257/538] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:51 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:51.890480 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a9324371-697b-4326-87b1-3dc05409f7c1 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:51.891510 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a9324371-697b-4326-87b1-3dc05409f7c1 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:51.898609 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a9324371-697b-4326-87b1-3dc05409f7c1 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:51.899066 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a9324371-697b-4326-87b1-3dc05409f7c1 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:51.899873 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a9324371-697b-4326-87b1-3dc05409f7c1 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:51.900321 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a9324371-697b-4326-87b1-3dc05409f7c1 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:52.036489 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a9324371-697b-4326-87b1-3dc05409f7c1 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:52.045496 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a9324371-697b-4326-87b1-3dc05409f7c1 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1264 microversion: 2.1 time: 0.159132 Oct 15 03:41:52.046384 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 282/539] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:51 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:52.321311 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ee548378-113a-4303-a80b-6a3464e925f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:52.321930 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ee548378-113a-4303-a80b-6a3464e925f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:52.327699 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee548378-113a-4303-a80b-6a3464e925f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:52.328144 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee548378-113a-4303-a80b-6a3464e925f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:52.328893 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee548378-113a-4303-a80b-6a3464e925f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:52.329316 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee548378-113a-4303-a80b-6a3464e925f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:52.445647 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ee548378-113a-4303-a80b-6a3464e925f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:52.452916 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ee548378-113a-4303-a80b-6a3464e925f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1260 microversion: 2.1 time: 0.135724 Oct 15 03:41:52.453475 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 258/540] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:52 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1260 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:52.857768 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cefb9265-f74c-49e9-bfd8-0a70bc77fc02 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:52.858404 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cefb9265-f74c-49e9-bfd8-0a70bc77fc02 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:52.864220 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cefb9265-f74c-49e9-bfd8-0a70bc77fc02 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:52.864668 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cefb9265-f74c-49e9-bfd8-0a70bc77fc02 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:52.865452 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cefb9265-f74c-49e9-bfd8-0a70bc77fc02 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:52.865900 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cefb9265-f74c-49e9-bfd8-0a70bc77fc02 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:52.981666 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-cefb9265-f74c-49e9-bfd8-0a70bc77fc02 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:52.989977 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-cefb9265-f74c-49e9-bfd8-0a70bc77fc02 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:52.992024 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-cefb9265-f74c-49e9-bfd8-0a70bc77fc02 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:52.993284 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cefb9265-f74c-49e9-bfd8-0a70bc77fc02 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.139166 Oct 15 03:41:52.994240 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 283/541] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:52 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:53.062441 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f770b28e-7d3e-40be-80c8-403b2f3f89b3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:53.063049 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f770b28e-7d3e-40be-80c8-403b2f3f89b3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:53.069345 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f770b28e-7d3e-40be-80c8-403b2f3f89b3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:53.069802 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f770b28e-7d3e-40be-80c8-403b2f3f89b3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:53.070569 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f770b28e-7d3e-40be-80c8-403b2f3f89b3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:53.071009 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f770b28e-7d3e-40be-80c8-403b2f3f89b3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:53.191362 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f770b28e-7d3e-40be-80c8-403b2f3f89b3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:53.199025 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f770b28e-7d3e-40be-80c8-403b2f3f89b3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1264 microversion: 2.1 time: 0.140276 Oct 15 03:41:53.199596 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 259/542] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:53 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:53.469993 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5b4a1013-9c05-43e8-ae7d-473a558403ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:53.471781 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5b4a1013-9c05-43e8-ae7d-473a558403ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:53.478615 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5b4a1013-9c05-43e8-ae7d-473a558403ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:53.479341 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5b4a1013-9c05-43e8-ae7d-473a558403ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:53.480366 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5b4a1013-9c05-43e8-ae7d-473a558403ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:53.480873 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5b4a1013-9c05-43e8-ae7d-473a558403ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:53.603453 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5b4a1013-9c05-43e8-ae7d-473a558403ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:53.610793 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5b4a1013-9c05-43e8-ae7d-473a558403ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1260 microversion: 2.1 time: 0.144938 Oct 15 03:41:53.611357 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 284/543] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:53 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1260 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:53.656669 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-0d5c29e6-87a0-4d6b-9880-4b73c91bae5a req-5c289145-518d-46f8-a475-540e3e81cd93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3594fddd-dbb7-4731-8f30-b3512198e1a9", "name": "network-vif-plugged", "status": "completed", "tag": "0ebbb249-fedc-46b3-94a7-8e70531c6d22"}, {"server_uuid": "37285523-63b9-4079-939b-b156366439e6", "name": "network-vif-plugged", "status": "completed", "tag": "6991361a-3fd3-4d0d-8d4b-edd950821f5d"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:41:53.658486 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:41:53.658486 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 03:41:53.666489 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-0d5c29e6-87a0-4d6b-9880-4b73c91bae5a req-5c289145-518d-46f8-a475-540e3e81cd93 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:53.667060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-0d5c29e6-87a0-4d6b-9880-4b73c91bae5a req-5c289145-518d-46f8-a475-540e3e81cd93 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:53.679800 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-0d5c29e6-87a0-4d6b-9880-4b73c91bae5a req-5c289145-518d-46f8-a475-540e3e81cd93 service nova] Creating event network-vif-plugged:0ebbb249-fedc-46b3-94a7-8e70531c6d22 for instance 3594fddd-dbb7-4731-8f30-b3512198e1a9 on hv-cinder-81410 Oct 15 03:41:53.680325 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-0d5c29e6-87a0-4d6b-9880-4b73c91bae5a req-5c289145-518d-46f8-a475-540e3e81cd93 service nova] Creating event network-vif-plugged:6991361a-3fd3-4d0d-8d4b-edd950821f5d for instance 37285523-63b9-4079-939b-b156366439e6 on hv-cinder-81410 Oct 15 03:41:53.686666 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-0d5c29e6-87a0-4d6b-9880-4b73c91bae5a req-5c289145-518d-46f8-a475-540e3e81cd93 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033684 Oct 15 03:41:53.687405 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 260/544] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:41:53 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:41:54.012534 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bc3cd7f5-75b9-422a-9c91-5433329f2e61 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:54.013136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bc3cd7f5-75b9-422a-9c91-5433329f2e61 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:54.018852 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bc3cd7f5-75b9-422a-9c91-5433329f2e61 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:54.019301 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bc3cd7f5-75b9-422a-9c91-5433329f2e61 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:54.020239 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bc3cd7f5-75b9-422a-9c91-5433329f2e61 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:54.020784 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bc3cd7f5-75b9-422a-9c91-5433329f2e61 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:54.143135 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bc3cd7f5-75b9-422a-9c91-5433329f2e61 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:54.151206 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bc3cd7f5-75b9-422a-9c91-5433329f2e61 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:54.152799 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bc3cd7f5-75b9-422a-9c91-5433329f2e61 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:54.154000 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bc3cd7f5-75b9-422a-9c91-5433329f2e61 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.145135 Oct 15 03:41:54.154597 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 285/545] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:54 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:54.215763 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a875fc04-bce2-4672-9148-57722163b864 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:54.216381 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a875fc04-bce2-4672-9148-57722163b864 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:54.222280 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a875fc04-bce2-4672-9148-57722163b864 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:54.222724 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a875fc04-bce2-4672-9148-57722163b864 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:54.223472 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a875fc04-bce2-4672-9148-57722163b864 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:54.223933 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a875fc04-bce2-4672-9148-57722163b864 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:54.346566 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-a875fc04-bce2-4672-9148-57722163b864 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:54.354584 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a875fc04-bce2-4672-9148-57722163b864 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1452 microversion: 2.1 time: 0.143064 Oct 15 03:41:54.355158 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 261/546] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:54 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1452 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:54.371640 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-edb89282-0345-46d2-a5e8-76e9e62eaa2f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:54.372486 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-edb89282-0345-46d2-a5e8-76e9e62eaa2f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:54.378277 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edb89282-0345-46d2-a5e8-76e9e62eaa2f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:54.378735 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edb89282-0345-46d2-a5e8-76e9e62eaa2f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:54.379544 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edb89282-0345-46d2-a5e8-76e9e62eaa2f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:54.379988 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edb89282-0345-46d2-a5e8-76e9e62eaa2f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:54.524587 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-edb89282-0345-46d2-a5e8-76e9e62eaa2f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:54.531834 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-edb89282-0345-46d2-a5e8-76e9e62eaa2f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1452 microversion: 2.1 time: 0.163833 Oct 15 03:41:54.532400 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 286/547] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:54 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:54.626967 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6b7c621b-44ba-479f-89e0-92d104c79ad6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:54.627668 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6b7c621b-44ba-479f-89e0-92d104c79ad6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:54.633946 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b7c621b-44ba-479f-89e0-92d104c79ad6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:54.634393 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b7c621b-44ba-479f-89e0-92d104c79ad6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:54.635151 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b7c621b-44ba-479f-89e0-92d104c79ad6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:54.635581 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b7c621b-44ba-479f-89e0-92d104c79ad6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:54.754340 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6b7c621b-44ba-479f-89e0-92d104c79ad6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:54.761720 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6b7c621b-44ba-479f-89e0-92d104c79ad6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1260 microversion: 2.1 time: 0.138331 Oct 15 03:41:54.762281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 262/548] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:54 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1260 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:41:55.172623 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5a11506f-6bb5-4d99-8458-9566f4c0bc33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:55.173241 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5a11506f-6bb5-4d99-8458-9566f4c0bc33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:55.178993 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a11506f-6bb5-4d99-8458-9566f4c0bc33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:55.179431 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a11506f-6bb5-4d99-8458-9566f4c0bc33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:55.180431 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a11506f-6bb5-4d99-8458-9566f4c0bc33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:55.180870 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a11506f-6bb5-4d99-8458-9566f4c0bc33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:55.298908 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5a11506f-6bb5-4d99-8458-9566f4c0bc33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:55.308005 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5a11506f-6bb5-4d99-8458-9566f4c0bc33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:55.309417 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5a11506f-6bb5-4d99-8458-9566f4c0bc33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:55.310624 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5a11506f-6bb5-4d99-8458-9566f4c0bc33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.141717 Oct 15 03:41:55.311191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 287/549] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:55 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:55.778711 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-aa7aaf68-c311-463b-b3e3-2fa412f7a9ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:55.779496 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-aa7aaf68-c311-463b-b3e3-2fa412f7a9ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:55.785415 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aa7aaf68-c311-463b-b3e3-2fa412f7a9ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:55.785953 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aa7aaf68-c311-463b-b3e3-2fa412f7a9ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:55.786791 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aa7aaf68-c311-463b-b3e3-2fa412f7a9ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:55.787300 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aa7aaf68-c311-463b-b3e3-2fa412f7a9ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:55.913805 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-aa7aaf68-c311-463b-b3e3-2fa412f7a9ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:55.921028 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-aa7aaf68-c311-463b-b3e3-2fa412f7a9ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1444 microversion: 2.1 time: 0.145994 Oct 15 03:41:55.921598 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 263/550] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:55 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1444 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:55.937929 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c33d02f3-2326-4c03-84c9-08eddf1b2029 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:55.938539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c33d02f3-2326-4c03-84c9-08eddf1b2029 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:55.944880 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c33d02f3-2326-4c03-84c9-08eddf1b2029 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:55.945355 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c33d02f3-2326-4c03-84c9-08eddf1b2029 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:55.946098 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c33d02f3-2326-4c03-84c9-08eddf1b2029 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:55.946532 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c33d02f3-2326-4c03-84c9-08eddf1b2029 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:56.082856 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c33d02f3-2326-4c03-84c9-08eddf1b2029 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:56.091718 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c33d02f3-2326-4c03-84c9-08eddf1b2029 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1444 microversion: 2.1 time: 0.157395 Oct 15 03:41:56.092460 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 288/551] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:41:55 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:41:56.329443 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-967cf685-b8be-4f64-b90f-2390608309b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:56.330437 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-967cf685-b8be-4f64-b90f-2390608309b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:56.338526 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-967cf685-b8be-4f64-b90f-2390608309b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:56.339097 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-967cf685-b8be-4f64-b90f-2390608309b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:56.340082 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-967cf685-b8be-4f64-b90f-2390608309b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:56.340692 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-967cf685-b8be-4f64-b90f-2390608309b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:56.538091 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-967cf685-b8be-4f64-b90f-2390608309b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:56.551504 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-967cf685-b8be-4f64-b90f-2390608309b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:56.553152 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-967cf685-b8be-4f64-b90f-2390608309b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:56.554542 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-967cf685-b8be-4f64-b90f-2390608309b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1807 microversion: 2.20 time: 0.229445 Oct 15 03:41:56.565716 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 264/552] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:56 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:56.672973 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-59251697-4d6b-47f1-a648-88bcd1083939 req-189b8f7d-7d91-4279-95d9-98ea947bad59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e429526-26c8-4d98-8691-73770db59513", "tag": "b203b749-dead-423e-8bfb-4c494e6c63ab"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:41:56.675377 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:41:56.675377 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:41:56.689836 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-59251697-4d6b-47f1-a648-88bcd1083939 req-189b8f7d-7d91-4279-95d9-98ea947bad59 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:56.690523 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-59251697-4d6b-47f1-a648-88bcd1083939 req-189b8f7d-7d91-4279-95d9-98ea947bad59 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:56.710095 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-59251697-4d6b-47f1-a648-88bcd1083939 req-189b8f7d-7d91-4279-95d9-98ea947bad59 service nova] Creating event network-changed:b203b749-dead-423e-8bfb-4c494e6c63ab for instance 6e429526-26c8-4d98-8691-73770db59513 on hv-cinder-81410 Oct 15 03:41:56.720750 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-59251697-4d6b-47f1-a648-88bcd1083939 req-189b8f7d-7d91-4279-95d9-98ea947bad59 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053053 Oct 15 03:41:56.721562 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 289/553] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:41:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:41:57.573563 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0baf97fc-b08b-4e2f-a291-e8538c88a996 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:41:57.574856 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0baf97fc-b08b-4e2f-a291-e8538c88a996 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:41:57.584658 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0baf97fc-b08b-4e2f-a291-e8538c88a996 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:57.586952 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0baf97fc-b08b-4e2f-a291-e8538c88a996 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:57.588268 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0baf97fc-b08b-4e2f-a291-e8538c88a996 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:57.591302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0baf97fc-b08b-4e2f-a291-e8538c88a996 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:58.024414 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0baf97fc-b08b-4e2f-a291-e8538c88a996 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:58.032488 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0baf97fc-b08b-4e2f-a291-e8538c88a996 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:58.034341 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0baf97fc-b08b-4e2f-a291-e8538c88a996 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:41:58.035094 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0baf97fc-b08b-4e2f-a291-e8538c88a996 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1794 microversion: 2.20 time: 0.466346 Oct 15 03:41:58.035636 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 265/554] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:41:57 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1794 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:41:58.623406 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-bfbb1a06-08d0-4566-8bcb-17ef63b0eac7 req-2f535729-5a1e-465a-b87b-938c60e17b7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37285523-63b9-4079-939b-b156366439e6", "tag": "6991361a-3fd3-4d0d-8d4b-edd950821f5d"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:41:58.625002 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:41:58.625002 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:41:58.632060 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-bfbb1a06-08d0-4566-8bcb-17ef63b0eac7 req-2f535729-5a1e-465a-b87b-938c60e17b7c service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:41:58.632511 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-bfbb1a06-08d0-4566-8bcb-17ef63b0eac7 req-2f535729-5a1e-465a-b87b-938c60e17b7c service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:41:58.648198 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-bfbb1a06-08d0-4566-8bcb-17ef63b0eac7 req-2f535729-5a1e-465a-b87b-938c60e17b7c service nova] Creating event network-changed:6991361a-3fd3-4d0d-8d4b-edd950821f5d for instance 37285523-63b9-4079-939b-b156366439e6 on hv-cinder-81410 Oct 15 03:41:58.653033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-bfbb1a06-08d0-4566-8bcb-17ef63b0eac7 req-2f535729-5a1e-465a-b87b-938c60e17b7c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040922 Oct 15 03:41:58.653766 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 290/555] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:41:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:42:37.392224 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0279f551-d8d8-4fbd-b949-5159e0076cd3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:42:37.393266 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0279f551-d8d8-4fbd-b949-5159e0076cd3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:37.399087 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0279f551-d8d8-4fbd-b949-5159e0076cd3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:37.399532 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0279f551-d8d8-4fbd-b949-5159e0076cd3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:37.400343 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0279f551-d8d8-4fbd-b949-5159e0076cd3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:37.400782 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0279f551-d8d8-4fbd-b949-5159e0076cd3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:37.424176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.objects.instance [None req-0279f551-d8d8-4fbd-b949-5159e0076cd3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lazy-loading 'flavor' on Instance uuid c33f5b74-7b6d-44da-870a-cff6c079605d {{(pid=120899) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 03:42:37.540155 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0279f551-d8d8-4fbd-b949-5159e0076cd3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "POST /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/action" status: 200 len: 32 microversion: 2.1 time: 0.151464 Oct 15 03:42:37.540876 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 266/556] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 03:42:37 2021] POST /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 03:42:37.551025 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8c27a980-74de-475b-bd39-15a46ec9771b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:37.552339 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8c27a980-74de-475b-bd39-15a46ec9771b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:37.560807 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8c27a980-74de-475b-bd39-15a46ec9771b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:37.562059 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8c27a980-74de-475b-bd39-15a46ec9771b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:37.562870 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8c27a980-74de-475b-bd39-15a46ec9771b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:37.563312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8c27a980-74de-475b-bd39-15a46ec9771b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:37.763480 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8c27a980-74de-475b-bd39-15a46ec9771b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:42:37.771156 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8c27a980-74de-475b-bd39-15a46ec9771b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1568 microversion: 2.1 time: 0.225150 Oct 15 03:42:37.771739 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 291/557] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:42:37 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:42:38.788293 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-18ae59f7-1cb6-4550-975b-8f16f24d6381 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:38.788982 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-18ae59f7-1cb6-4550-975b-8f16f24d6381 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:38.794926 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18ae59f7-1cb6-4550-975b-8f16f24d6381 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:38.795365 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18ae59f7-1cb6-4550-975b-8f16f24d6381 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:38.796147 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18ae59f7-1cb6-4550-975b-8f16f24d6381 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:38.796573 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18ae59f7-1cb6-4550-975b-8f16f24d6381 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:38.918440 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-18ae59f7-1cb6-4550-975b-8f16f24d6381 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:42:38.925980 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-18ae59f7-1cb6-4550-975b-8f16f24d6381 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1568 microversion: 2.1 time: 0.141666 Oct 15 03:42:38.926547 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 267/558] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:42:38 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:42:39.942738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bf5cb1d3-8463-4e8f-8d77-a8ebbd36b0d1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:39.943254 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bf5cb1d3-8463-4e8f-8d77-a8ebbd36b0d1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:39.948970 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf5cb1d3-8463-4e8f-8d77-a8ebbd36b0d1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:39.949411 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf5cb1d3-8463-4e8f-8d77-a8ebbd36b0d1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:39.950158 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf5cb1d3-8463-4e8f-8d77-a8ebbd36b0d1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:39.950584 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf5cb1d3-8463-4e8f-8d77-a8ebbd36b0d1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:40.066926 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bf5cb1d3-8463-4e8f-8d77-a8ebbd36b0d1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:42:40.074522 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bf5cb1d3-8463-4e8f-8d77-a8ebbd36b0d1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1568 microversion: 2.1 time: 0.135494 Oct 15 03:42:40.075071 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 292/559] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:42:39 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:42:40.964406 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8906f964-560c-4be3-b7e3-a1ba616f7123 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:40.964932 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8906f964-560c-4be3-b7e3-a1ba616f7123 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:40.970518 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8906f964-560c-4be3-b7e3-a1ba616f7123 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:40.970960 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8906f964-560c-4be3-b7e3-a1ba616f7123 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:40.971766 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8906f964-560c-4be3-b7e3-a1ba616f7123 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:40.972197 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8906f964-560c-4be3-b7e3-a1ba616f7123 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:40.999841 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8906f964-560c-4be3-b7e3-a1ba616f7123 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments/c7676192-f05b-4d29-8bf5-ed60aecf22a3" status: 200 len: 194 microversion: 2.20 time: 0.039600 Oct 15 03:42:41.000390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 268/560] 10.222.0.30 () {60 vars in 1453 bytes} [Fri Oct 15 03:42:40 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments/c7676192-f05b-4d29-8bf5-ed60aecf22a3 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:42:41.058154 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-71c629b5-bd0b-4976-99ba-14db84acb6fc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:41.058660 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-71c629b5-bd0b-4976-99ba-14db84acb6fc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:41.064481 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-71c629b5-bd0b-4976-99ba-14db84acb6fc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:41.064925 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-71c629b5-bd0b-4976-99ba-14db84acb6fc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:41.065671 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-71c629b5-bd0b-4976-99ba-14db84acb6fc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:41.066101 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-71c629b5-bd0b-4976-99ba-14db84acb6fc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:41.091822 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7fc53886-1e59-4727-abd5-0336d80f17ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:41.092439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7fc53886-1e59-4727-abd5-0336d80f17ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:41.098142 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7fc53886-1e59-4727-abd5-0336d80f17ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:41.098608 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7fc53886-1e59-4727-abd5-0336d80f17ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:41.099372 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7fc53886-1e59-4727-abd5-0336d80f17ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:41.099851 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7fc53886-1e59-4727-abd5-0336d80f17ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:41.185182 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.objects.instance [None req-71c629b5-bd0b-4976-99ba-14db84acb6fc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lazy-loading 'services' on Instance uuid 3594fddd-dbb7-4731-8f30-b3512198e1a9 {{(pid=120897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 03:42:41.217421 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7fc53886-1e59-4727-abd5-0336d80f17ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:42:41.225176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7fc53886-1e59-4727-abd5-0336d80f17ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1568 microversion: 2.1 time: 0.136949 Oct 15 03:42:41.225743 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 269/561] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:42:41 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:42:41.298690 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-71c629b5-bd0b-4976-99ba-14db84acb6fc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments/c7676192-f05b-4d29-8bf5-ed60aecf22a3" status: 202 len: 0 microversion: 2.20 time: 0.244086 Oct 15 03:42:41.299345 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 293/562] 10.222.0.30 () {60 vars in 1456 bytes} [Fri Oct 15 03:42:41 2021] DELETE /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments/c7676192-f05b-4d29-8bf5-ed60aecf22a3 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 15 03:42:41.307530 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c6a0c868-94cc-417c-aca0-2d8d221d0a14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:41.308477 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c6a0c868-94cc-417c-aca0-2d8d221d0a14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:41.314577 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6a0c868-94cc-417c-aca0-2d8d221d0a14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:41.315062 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6a0c868-94cc-417c-aca0-2d8d221d0a14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:41.316253 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6a0c868-94cc-417c-aca0-2d8d221d0a14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:41.316776 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6a0c868-94cc-417c-aca0-2d8d221d0a14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:41.347626 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c6a0c868-94cc-417c-aca0-2d8d221d0a14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043883 Oct 15 03:42:41.348235 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 270/563] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:42:41 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:42:42.242362 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-749c1330-c4f9-4a06-b705-a636eb6c0b05 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:42.243048 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-749c1330-c4f9-4a06-b705-a636eb6c0b05 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:42.249070 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-749c1330-c4f9-4a06-b705-a636eb6c0b05 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:42.249450 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-749c1330-c4f9-4a06-b705-a636eb6c0b05 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:42.250202 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-749c1330-c4f9-4a06-b705-a636eb6c0b05 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:42.250626 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-749c1330-c4f9-4a06-b705-a636eb6c0b05 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:42.358466 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-96559b8b-b32e-4baf-81f8-a84eb9b72f81 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:42.359390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-96559b8b-b32e-4baf-81f8-a84eb9b72f81 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:42.365132 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-96559b8b-b32e-4baf-81f8-a84eb9b72f81 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:42.365595 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-96559b8b-b32e-4baf-81f8-a84eb9b72f81 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:42.366343 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-96559b8b-b32e-4baf-81f8-a84eb9b72f81 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:42.366772 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-96559b8b-b32e-4baf-81f8-a84eb9b72f81 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:42.370499 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-749c1330-c4f9-4a06-b705-a636eb6c0b05 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:42:42.378167 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-749c1330-c4f9-4a06-b705-a636eb6c0b05 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1568 microversion: 2.1 time: 0.139820 Oct 15 03:42:42.378723 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 294/564] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:42:42 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:42:42.397797 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-96559b8b-b32e-4baf-81f8-a84eb9b72f81 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043092 Oct 15 03:42:42.398346 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 271/565] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:42:42 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:42:43.394013 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5d9d3e03-3045-477c-b829-684fd342f9ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:43.394602 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5d9d3e03-3045-477c-b829-684fd342f9ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:43.400361 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5d9d3e03-3045-477c-b829-684fd342f9ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:43.400795 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5d9d3e03-3045-477c-b829-684fd342f9ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:43.401550 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5d9d3e03-3045-477c-b829-684fd342f9ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:43.401975 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5d9d3e03-3045-477c-b829-684fd342f9ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:43.408964 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fe065b0f-8195-4299-86c1-b7b0115c6825 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:43.409860 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fe065b0f-8195-4299-86c1-b7b0115c6825 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:43.415934 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe065b0f-8195-4299-86c1-b7b0115c6825 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:43.416383 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe065b0f-8195-4299-86c1-b7b0115c6825 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:43.417140 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe065b0f-8195-4299-86c1-b7b0115c6825 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:43.417568 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe065b0f-8195-4299-86c1-b7b0115c6825 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:43.446323 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fe065b0f-8195-4299-86c1-b7b0115c6825 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040998 Oct 15 03:42:43.446885 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 272/566] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:42:43 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:42:43.518153 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5d9d3e03-3045-477c-b829-684fd342f9ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:42:43.525656 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5d9d3e03-3045-477c-b829-684fd342f9ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1568 microversion: 2.1 time: 0.135295 Oct 15 03:42:43.526202 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 295/567] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:42:43 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1568 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:42:44.457853 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-66474e08-10d6-470c-b381-ff7a93f367a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:44.458684 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-66474e08-10d6-470c-b381-ff7a93f367a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:44.464798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-66474e08-10d6-470c-b381-ff7a93f367a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:44.465261 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-66474e08-10d6-470c-b381-ff7a93f367a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:44.466004 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-66474e08-10d6-470c-b381-ff7a93f367a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:44.466440 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-66474e08-10d6-470c-b381-ff7a93f367a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:44.494869 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-66474e08-10d6-470c-b381-ff7a93f367a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040930 Oct 15 03:42:44.495418 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 273/568] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:42:44 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:42:44.541920 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7e942ef0-c2da-48d8-92d6-7c11b50a5663 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:44.542557 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7e942ef0-c2da-48d8-92d6-7c11b50a5663 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:44.548248 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7e942ef0-c2da-48d8-92d6-7c11b50a5663 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:44.548690 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7e942ef0-c2da-48d8-92d6-7c11b50a5663 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:44.549442 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7e942ef0-c2da-48d8-92d6-7c11b50a5663 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:44.549873 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7e942ef0-c2da-48d8-92d6-7c11b50a5663 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:44.668040 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7e942ef0-c2da-48d8-92d6-7c11b50a5663 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:42:44.675602 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7e942ef0-c2da-48d8-92d6-7c11b50a5663 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1568 microversion: 2.1 time: 0.137277 Oct 15 03:42:44.676191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 296/569] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:42:44 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:42:45.507125 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3a37217d-e2a3-4b77-aa10-dc2d3e78f71e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:45.507981 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3a37217d-e2a3-4b77-aa10-dc2d3e78f71e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:45.513697 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a37217d-e2a3-4b77-aa10-dc2d3e78f71e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:45.514143 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a37217d-e2a3-4b77-aa10-dc2d3e78f71e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:45.514892 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a37217d-e2a3-4b77-aa10-dc2d3e78f71e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:45.515319 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a37217d-e2a3-4b77-aa10-dc2d3e78f71e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:45.543148 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3a37217d-e2a3-4b77-aa10-dc2d3e78f71e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040584 Oct 15 03:42:45.543685 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 274/570] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:42:45 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:42:45.693683 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a1258687-ef01-41e5-9a86-45e4455d6ee2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:45.694284 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a1258687-ef01-41e5-9a86-45e4455d6ee2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:45.700339 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a1258687-ef01-41e5-9a86-45e4455d6ee2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:45.700781 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a1258687-ef01-41e5-9a86-45e4455d6ee2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:45.701532 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a1258687-ef01-41e5-9a86-45e4455d6ee2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:45.701957 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a1258687-ef01-41e5-9a86-45e4455d6ee2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:45.827133 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a1258687-ef01-41e5-9a86-45e4455d6ee2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:42:45.835811 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a1258687-ef01-41e5-9a86-45e4455d6ee2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1568 microversion: 2.1 time: 0.146233 Oct 15 03:42:45.836366 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 297/571] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:42:45 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:42:46.554846 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ba5ccfee-a4c8-4a08-b04c-73ec810997d0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:46.555778 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ba5ccfee-a4c8-4a08-b04c-73ec810997d0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:46.561450 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ba5ccfee-a4c8-4a08-b04c-73ec810997d0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:46.561892 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ba5ccfee-a4c8-4a08-b04c-73ec810997d0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:46.562655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ba5ccfee-a4c8-4a08-b04c-73ec810997d0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:46.563084 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ba5ccfee-a4c8-4a08-b04c-73ec810997d0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:46.590663 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ba5ccfee-a4c8-4a08-b04c-73ec810997d0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040143 Oct 15 03:42:46.591201 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 275/572] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:42:46 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:42:46.852824 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fd215de1-ffaf-4ac1-93ce-65ace6399893 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:46.853424 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fd215de1-ffaf-4ac1-93ce-65ace6399893 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:46.859396 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fd215de1-ffaf-4ac1-93ce-65ace6399893 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:46.859959 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fd215de1-ffaf-4ac1-93ce-65ace6399893 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:46.860886 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fd215de1-ffaf-4ac1-93ce-65ace6399893 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:46.861201 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fd215de1-ffaf-4ac1-93ce-65ace6399893 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:46.977477 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fd215de1-ffaf-4ac1-93ce-65ace6399893 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:42:46.985043 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fd215de1-ffaf-4ac1-93ce-65ace6399893 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1568 microversion: 2.1 time: 0.135744 Oct 15 03:42:46.985594 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 298/573] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:42:46 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:42:47.601983 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-54801d07-edbd-463b-8525-1733efdf70cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:47.602803 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-54801d07-edbd-463b-8525-1733efdf70cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:47.608513 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-54801d07-edbd-463b-8525-1733efdf70cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:47.608993 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-54801d07-edbd-463b-8525-1733efdf70cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:47.609751 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-54801d07-edbd-463b-8525-1733efdf70cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:47.610212 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-54801d07-edbd-463b-8525-1733efdf70cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:47.637689 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-54801d07-edbd-463b-8525-1733efdf70cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040025 Oct 15 03:42:47.638228 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 276/574] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:42:47 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:42:48.001862 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b8b49395-6110-487b-89ee-10703dc39d9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:48.002480 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b8b49395-6110-487b-89ee-10703dc39d9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:48.008758 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b8b49395-6110-487b-89ee-10703dc39d9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:48.009207 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b8b49395-6110-487b-89ee-10703dc39d9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:48.009969 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b8b49395-6110-487b-89ee-10703dc39d9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:48.010405 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b8b49395-6110-487b-89ee-10703dc39d9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:48.125807 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b8b49395-6110-487b-89ee-10703dc39d9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:42:48.134053 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b8b49395-6110-487b-89ee-10703dc39d9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1568 microversion: 2.1 time: 0.135735 Oct 15 03:42:48.134554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 299/575] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:42:47 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:42:48.649583 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-623c929f-a6fe-4856-a806-01c2ff60f4b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:48.650491 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-623c929f-a6fe-4856-a806-01c2ff60f4b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:48.656237 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-623c929f-a6fe-4856-a806-01c2ff60f4b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:48.656684 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-623c929f-a6fe-4856-a806-01c2ff60f4b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:48.657448 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-623c929f-a6fe-4856-a806-01c2ff60f4b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:48.657884 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-623c929f-a6fe-4856-a806-01c2ff60f4b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:48.685257 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-623c929f-a6fe-4856-a806-01c2ff60f4b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040090 Oct 15 03:42:48.685793 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 277/576] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:42:48 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:42:49.150396 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4b282e82-474a-451d-961b-9e331c520d90 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:49.150996 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4b282e82-474a-451d-961b-9e331c520d90 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:49.156707 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4b282e82-474a-451d-961b-9e331c520d90 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:49.157148 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4b282e82-474a-451d-961b-9e331c520d90 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:49.157890 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4b282e82-474a-451d-961b-9e331c520d90 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:49.158313 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4b282e82-474a-451d-961b-9e331c520d90 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:49.277015 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4b282e82-474a-451d-961b-9e331c520d90 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:42:49.284581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4b282e82-474a-451d-961b-9e331c520d90 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1568 microversion: 2.1 time: 0.138059 Oct 15 03:42:49.285128 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 300/577] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:42:49 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:42:49.697142 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-09dea954-1f62-430d-ac9a-2cddd94326ab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:49.698045 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-09dea954-1f62-430d-ac9a-2cddd94326ab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:49.703909 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09dea954-1f62-430d-ac9a-2cddd94326ab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:49.704361 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09dea954-1f62-430d-ac9a-2cddd94326ab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:49.705120 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09dea954-1f62-430d-ac9a-2cddd94326ab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:49.705555 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09dea954-1f62-430d-ac9a-2cddd94326ab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:49.733447 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-09dea954-1f62-430d-ac9a-2cddd94326ab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040162 Oct 15 03:42:49.733990 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 278/578] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:42:49 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:42:50.302289 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bdf8caf3-9214-478f-afa2-014136753268 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:50.302888 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bdf8caf3-9214-478f-afa2-014136753268 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:50.308724 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bdf8caf3-9214-478f-afa2-014136753268 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:50.309167 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bdf8caf3-9214-478f-afa2-014136753268 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:50.309912 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bdf8caf3-9214-478f-afa2-014136753268 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:50.310341 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bdf8caf3-9214-478f-afa2-014136753268 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:50.425630 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bdf8caf3-9214-478f-afa2-014136753268 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:42:50.433145 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bdf8caf3-9214-478f-afa2-014136753268 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1568 microversion: 2.1 time: 0.135087 Oct 15 03:42:50.433699 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 301/579] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:42:50 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1568 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:42:50.745019 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4f9a050b-9e22-4105-8178-471fdbb19013 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:50.746197 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4f9a050b-9e22-4105-8178-471fdbb19013 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:50.752376 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4f9a050b-9e22-4105-8178-471fdbb19013 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:50.752819 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4f9a050b-9e22-4105-8178-471fdbb19013 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:50.753576 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4f9a050b-9e22-4105-8178-471fdbb19013 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:50.754002 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4f9a050b-9e22-4105-8178-471fdbb19013 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:50.784456 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4f9a050b-9e22-4105-8178-471fdbb19013 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043309 Oct 15 03:42:50.785011 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 279/580] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:42:50 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:42:51.449779 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-18aa76ce-e7ec-4294-a86b-217f7c30ca64 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:51.450307 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-18aa76ce-e7ec-4294-a86b-217f7c30ca64 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:51.456061 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18aa76ce-e7ec-4294-a86b-217f7c30ca64 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:51.456503 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18aa76ce-e7ec-4294-a86b-217f7c30ca64 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:51.457272 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18aa76ce-e7ec-4294-a86b-217f7c30ca64 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:51.457707 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18aa76ce-e7ec-4294-a86b-217f7c30ca64 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:51.777044 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-18aa76ce-e7ec-4294-a86b-217f7c30ca64 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:42:51.784816 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-18aa76ce-e7ec-4294-a86b-217f7c30ca64 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1548 microversion: 2.1 time: 0.338724 Oct 15 03:42:51.785402 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 302/581] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:42:51 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1548 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:42:51.795980 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6195c152-d9c8-40c6-a04a-ba62b00a2d37 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:51.796888 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6195c152-d9c8-40c6-a04a-ba62b00a2d37 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:51.800858 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-be097ef4-8f42-4b55-acbd-169b589bc72e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:51.801934 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-be097ef4-8f42-4b55-acbd-169b589bc72e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:51.803139 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6195c152-d9c8-40c6-a04a-ba62b00a2d37 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:51.803588 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6195c152-d9c8-40c6-a04a-ba62b00a2d37 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:51.804382 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6195c152-d9c8-40c6-a04a-ba62b00a2d37 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:51.804822 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6195c152-d9c8-40c6-a04a-ba62b00a2d37 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:51.807584 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-be097ef4-8f42-4b55-acbd-169b589bc72e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:51.808066 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-be097ef4-8f42-4b55-acbd-169b589bc72e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:51.808947 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-be097ef4-8f42-4b55-acbd-169b589bc72e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:51.809413 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-be097ef4-8f42-4b55-acbd-169b589bc72e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:51.834825 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6195c152-d9c8-40c6-a04a-ba62b00a2d37 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042588 Oct 15 03:42:51.835385 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 280/582] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:42:51 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:42:51.885124 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.wsgi [None req-be097ef4-8f42-4b55-acbd-169b589bc72e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] HTTP exception thrown: Cannot 'detach_volume' instance c33f5b74-7b6d-44da-870a-cff6c079605d while it is in vm_state rescued Oct 15 03:42:51.885722 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-be097ef4-8f42-4b55-acbd-169b589bc72e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Returning 409 to user: Cannot 'detach_volume' instance c33f5b74-7b6d-44da-870a-cff6c079605d while it is in vm_state rescued {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:42:51.886547 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-be097ef4-8f42-4b55-acbd-169b589bc72e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments/06d79cd1-1f75-4ca9-9595-602627841dff" status: 409 len: 152 microversion: 2.1 time: 0.089353 Oct 15 03:42:51.887079 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 303/583] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Oct 15 03:42:51 2021] DELETE /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments/06d79cd1-1f75-4ca9-9595-602627841dff => generated 152 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 15 03:42:51.895578 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c584adfe-a5d9-40ab-8a25-d612dca85292 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:42:51.896145 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c584adfe-a5d9-40ab-8a25-d612dca85292 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:51.901707 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c584adfe-a5d9-40ab-8a25-d612dca85292 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:51.902145 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c584adfe-a5d9-40ab-8a25-d612dca85292 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:51.902887 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c584adfe-a5d9-40ab-8a25-d612dca85292 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:51.903313 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c584adfe-a5d9-40ab-8a25-d612dca85292 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:51.964400 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c584adfe-a5d9-40ab-8a25-d612dca85292 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "POST /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/action" status: 202 len: 0 microversion: 2.1 time: 0.072705 Oct 15 03:42:51.965011 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 281/584] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 03:42:51 2021] POST /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:42:51.973786 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3d6b47b9-b036-4480-942f-30e8d31b74e2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:51.974398 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3d6b47b9-b036-4480-942f-30e8d31b74e2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:51.980519 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3d6b47b9-b036-4480-942f-30e8d31b74e2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:51.981010 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3d6b47b9-b036-4480-942f-30e8d31b74e2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:51.982141 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3d6b47b9-b036-4480-942f-30e8d31b74e2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:51.982854 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3d6b47b9-b036-4480-942f-30e8d31b74e2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:52.161383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3d6b47b9-b036-4480-942f-30e8d31b74e2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:42:52.169024 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3d6b47b9-b036-4480-942f-30e8d31b74e2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1556 microversion: 2.1 time: 0.199675 Oct 15 03:42:52.169581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 304/585] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:42:51 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1556 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:42:52.847185 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7bb37a3e-5cb4-4e59-a9ef-777ed7152bf6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:52.848853 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7bb37a3e-5cb4-4e59-a9ef-777ed7152bf6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:52.854762 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7bb37a3e-5cb4-4e59-a9ef-777ed7152bf6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:52.855207 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7bb37a3e-5cb4-4e59-a9ef-777ed7152bf6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:52.855996 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7bb37a3e-5cb4-4e59-a9ef-777ed7152bf6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:52.856429 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7bb37a3e-5cb4-4e59-a9ef-777ed7152bf6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:52.885763 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7bb37a3e-5cb4-4e59-a9ef-777ed7152bf6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042838 Oct 15 03:42:52.886302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 282/586] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:42:52 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:42:53.185236 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f6c52f5d-760f-45fc-93f5-c00003be23cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:53.185844 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f6c52f5d-760f-45fc-93f5-c00003be23cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:53.191558 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6c52f5d-760f-45fc-93f5-c00003be23cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:53.192547 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6c52f5d-760f-45fc-93f5-c00003be23cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:53.193308 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6c52f5d-760f-45fc-93f5-c00003be23cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:53.193739 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6c52f5d-760f-45fc-93f5-c00003be23cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:53.311002 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f6c52f5d-760f-45fc-93f5-c00003be23cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:42:53.319104 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f6c52f5d-760f-45fc-93f5-c00003be23cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1556 microversion: 2.1 time: 0.137475 Oct 15 03:42:53.319658 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 305/587] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:42:53 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1556 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:42:53.897143 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-af246126-fac3-4095-b3b1-9c155115d045 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:53.898045 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-af246126-fac3-4095-b3b1-9c155115d045 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:53.903761 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-af246126-fac3-4095-b3b1-9c155115d045 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:53.904205 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-af246126-fac3-4095-b3b1-9c155115d045 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:53.904955 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-af246126-fac3-4095-b3b1-9c155115d045 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:53.905378 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-af246126-fac3-4095-b3b1-9c155115d045 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:53.933805 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-af246126-fac3-4095-b3b1-9c155115d045 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040451 Oct 15 03:42:53.934340 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 283/588] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:42:53 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:42:54.336292 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e96b9d59-79f2-4e26-973f-b838bafa19f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:54.337149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e96b9d59-79f2-4e26-973f-b838bafa19f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:54.342658 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e96b9d59-79f2-4e26-973f-b838bafa19f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:54.343101 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e96b9d59-79f2-4e26-973f-b838bafa19f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:54.343880 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e96b9d59-79f2-4e26-973f-b838bafa19f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:54.344305 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e96b9d59-79f2-4e26-973f-b838bafa19f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:54.464529 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e96b9d59-79f2-4e26-973f-b838bafa19f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:42:54.472026 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e96b9d59-79f2-4e26-973f-b838bafa19f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1562 microversion: 2.1 time: 0.139824 Oct 15 03:42:54.472570 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 306/589] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:42:54 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:42:54.535841 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0bb501d4-8f3f-41c6-9bc1-67966f8e25bc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:54.536334 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0bb501d4-8f3f-41c6-9bc1-67966f8e25bc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:54.541992 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0bb501d4-8f3f-41c6-9bc1-67966f8e25bc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:54.542440 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0bb501d4-8f3f-41c6-9bc1-67966f8e25bc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:54.543191 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0bb501d4-8f3f-41c6-9bc1-67966f8e25bc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:54.543619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0bb501d4-8f3f-41c6-9bc1-67966f8e25bc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:54.617145 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.objects.instance [None req-0bb501d4-8f3f-41c6-9bc1-67966f8e25bc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lazy-loading 'services' on Instance uuid c33f5b74-7b6d-44da-870a-cff6c079605d {{(pid=120899) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 03:42:54.683608 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0bb501d4-8f3f-41c6-9bc1-67966f8e25bc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments/06d79cd1-1f75-4ca9-9595-602627841dff" status: 202 len: 0 microversion: 2.1 time: 0.150828 Oct 15 03:42:54.684454 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 284/590] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Oct 15 03:42:54 2021] DELETE /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments/06d79cd1-1f75-4ca9-9595-602627841dff => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:42:54.693209 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8a37e748-f0ec-499f-86da-615e1cb905a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:54.694749 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8a37e748-f0ec-499f-86da-615e1cb905a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:54.704617 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8a37e748-f0ec-499f-86da-615e1cb905a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:54.705330 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8a37e748-f0ec-499f-86da-615e1cb905a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:54.706593 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8a37e748-f0ec-499f-86da-615e1cb905a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:54.707373 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8a37e748-f0ec-499f-86da-615e1cb905a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:54.738408 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8a37e748-f0ec-499f-86da-615e1cb905a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049771 Oct 15 03:42:54.739527 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 307/591] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:42:54 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:42:54.945911 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1cff6998-7355-4968-9213-65a33c396e31 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:54.946827 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1cff6998-7355-4968-9213-65a33c396e31 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:54.952778 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1cff6998-7355-4968-9213-65a33c396e31 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:54.953220 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1cff6998-7355-4968-9213-65a33c396e31 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:54.953973 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1cff6998-7355-4968-9213-65a33c396e31 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:54.954400 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1cff6998-7355-4968-9213-65a33c396e31 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:54.983103 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1cff6998-7355-4968-9213-65a33c396e31 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041543 Oct 15 03:42:54.983628 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 285/592] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:42:54 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:42:55.750283 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-57d85115-48bf-4768-9c98-993077f34433 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:55.751188 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-57d85115-48bf-4768-9c98-993077f34433 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:55.756953 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-57d85115-48bf-4768-9c98-993077f34433 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:55.757394 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-57d85115-48bf-4768-9c98-993077f34433 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:55.758142 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-57d85115-48bf-4768-9c98-993077f34433 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:55.758569 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-57d85115-48bf-4768-9c98-993077f34433 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:55.786839 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-57d85115-48bf-4768-9c98-993077f34433 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040270 Oct 15 03:42:55.787364 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 308/593] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:42:55 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:42:55.994532 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-578bc0a5-c7c6-48fb-9350-89e512104b99 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:55.995423 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-578bc0a5-c7c6-48fb-9350-89e512104b99 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:56.001178 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-578bc0a5-c7c6-48fb-9350-89e512104b99 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:56.001561 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-578bc0a5-c7c6-48fb-9350-89e512104b99 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:56.002344 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-578bc0a5-c7c6-48fb-9350-89e512104b99 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:56.002771 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-578bc0a5-c7c6-48fb-9350-89e512104b99 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:56.031413 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-578bc0a5-c7c6-48fb-9350-89e512104b99 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040754 Oct 15 03:42:56.031981 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 286/594] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:42:55 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:42:56.797959 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d9f22b85-741c-4feb-9ab1-1b7bf1b2bf1d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:56.798863 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d9f22b85-741c-4feb-9ab1-1b7bf1b2bf1d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:56.805335 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d9f22b85-741c-4feb-9ab1-1b7bf1b2bf1d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:56.805777 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d9f22b85-741c-4feb-9ab1-1b7bf1b2bf1d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:56.806551 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d9f22b85-741c-4feb-9ab1-1b7bf1b2bf1d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:56.806975 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d9f22b85-741c-4feb-9ab1-1b7bf1b2bf1d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:56.835014 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d9f22b85-741c-4feb-9ab1-1b7bf1b2bf1d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040755 Oct 15 03:42:56.835550 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 309/595] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:42:56 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:42:57.042684 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-53e19409-c252-4108-9b73-5d9013515c36 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:57.043599 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-53e19409-c252-4108-9b73-5d9013515c36 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:57.049640 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-53e19409-c252-4108-9b73-5d9013515c36 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:57.050042 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-53e19409-c252-4108-9b73-5d9013515c36 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:57.051759 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-53e19409-c252-4108-9b73-5d9013515c36 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:57.052235 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-53e19409-c252-4108-9b73-5d9013515c36 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:57.079840 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-53e19409-c252-4108-9b73-5d9013515c36 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040970 Oct 15 03:42:57.080384 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 287/596] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:42:57 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:42:57.846621 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6db5282e-cee5-42d2-94ef-cd084811d60a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:57.847524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6db5282e-cee5-42d2-94ef-cd084811d60a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:57.853806 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6db5282e-cee5-42d2-94ef-cd084811d60a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:57.854283 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6db5282e-cee5-42d2-94ef-cd084811d60a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:57.855042 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6db5282e-cee5-42d2-94ef-cd084811d60a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:57.855475 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6db5282e-cee5-42d2-94ef-cd084811d60a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:57.883424 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6db5282e-cee5-42d2-94ef-cd084811d60a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040529 Oct 15 03:42:57.884009 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 310/597] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:42:57 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:42:58.090439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5d1321f4-3f7e-4d62-a96b-b4cbb75c154d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:58.091460 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5d1321f4-3f7e-4d62-a96b-b4cbb75c154d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:58.097321 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5d1321f4-3f7e-4d62-a96b-b4cbb75c154d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:58.097707 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5d1321f4-3f7e-4d62-a96b-b4cbb75c154d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:58.099023 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5d1321f4-3f7e-4d62-a96b-b4cbb75c154d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:58.099456 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5d1321f4-3f7e-4d62-a96b-b4cbb75c154d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:58.126811 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5d1321f4-3f7e-4d62-a96b-b4cbb75c154d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040442 Oct 15 03:42:58.127344 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 288/598] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:42:58 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:42:58.894816 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-39898bae-d10c-4a6b-b9d1-cc939f5384e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:58.895728 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-39898bae-d10c-4a6b-b9d1-cc939f5384e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:58.901416 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-39898bae-d10c-4a6b-b9d1-cc939f5384e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:58.901858 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-39898bae-d10c-4a6b-b9d1-cc939f5384e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:58.902605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-39898bae-d10c-4a6b-b9d1-cc939f5384e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:58.903030 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-39898bae-d10c-4a6b-b9d1-cc939f5384e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:58.930656 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-39898bae-d10c-4a6b-b9d1-cc939f5384e4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039622 Oct 15 03:42:58.931181 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 311/599] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:42:58 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:42:59.138139 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-631925fe-e4a7-42d4-8d25-7b767f93891c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:59.139042 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-631925fe-e4a7-42d4-8d25-7b767f93891c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:59.144946 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-631925fe-e4a7-42d4-8d25-7b767f93891c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:59.145333 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-631925fe-e4a7-42d4-8d25-7b767f93891c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:59.146096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-631925fe-e4a7-42d4-8d25-7b767f93891c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:59.146527 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-631925fe-e4a7-42d4-8d25-7b767f93891c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:59.174635 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-631925fe-e4a7-42d4-8d25-7b767f93891c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040287 Oct 15 03:42:59.175171 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 289/600] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:42:59 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:42:59.941253 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bce16d95-d306-49ae-ab24-515743dcdad0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:42:59.942810 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bce16d95-d306-49ae-ab24-515743dcdad0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:42:59.948596 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bce16d95-d306-49ae-ab24-515743dcdad0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:59.949035 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bce16d95-d306-49ae-ab24-515743dcdad0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:59.949778 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bce16d95-d306-49ae-ab24-515743dcdad0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:42:59.950206 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bce16d95-d306-49ae-ab24-515743dcdad0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:42:59.978272 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bce16d95-d306-49ae-ab24-515743dcdad0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040782 Oct 15 03:42:59.978793 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 312/601] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:42:59 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:00.187042 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9ee41b93-d3f7-41c0-80e6-4da028900a22 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:00.187968 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9ee41b93-d3f7-41c0-80e6-4da028900a22 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:00.194453 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ee41b93-d3f7-41c0-80e6-4da028900a22 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:00.194842 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ee41b93-d3f7-41c0-80e6-4da028900a22 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:00.195600 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ee41b93-d3f7-41c0-80e6-4da028900a22 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:00.196063 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ee41b93-d3f7-41c0-80e6-4da028900a22 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:00.225113 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9ee41b93-d3f7-41c0-80e6-4da028900a22 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041846 Oct 15 03:43:00.225675 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 290/602] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:00 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:00.989557 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-743f74a4-7830-475b-81e5-3849bd08bbf0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:00.990473 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-743f74a4-7830-475b-81e5-3849bd08bbf0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:00.996497 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-743f74a4-7830-475b-81e5-3849bd08bbf0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:00.996948 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-743f74a4-7830-475b-81e5-3849bd08bbf0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:00.997711 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-743f74a4-7830-475b-81e5-3849bd08bbf0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:00.998146 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-743f74a4-7830-475b-81e5-3849bd08bbf0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:01.026055 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-743f74a4-7830-475b-81e5-3849bd08bbf0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040274 Oct 15 03:43:01.026593 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 313/603] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:00 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:01.236607 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b07ea8a2-f7c2-4fc2-a6d8-e965488a39ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:01.237428 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b07ea8a2-f7c2-4fc2-a6d8-e965488a39ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:01.243947 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b07ea8a2-f7c2-4fc2-a6d8-e965488a39ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:01.243947 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b07ea8a2-f7c2-4fc2-a6d8-e965488a39ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:01.244569 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b07ea8a2-f7c2-4fc2-a6d8-e965488a39ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:01.245005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b07ea8a2-f7c2-4fc2-a6d8-e965488a39ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:01.273906 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b07ea8a2-f7c2-4fc2-a6d8-e965488a39ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041222 Oct 15 03:43:01.274452 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 291/604] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:01 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:02.037103 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a56a766b-82d4-4da1-8788-ae91cce3b21f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:02.038010 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a56a766b-82d4-4da1-8788-ae91cce3b21f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:02.043787 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a56a766b-82d4-4da1-8788-ae91cce3b21f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:02.044237 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a56a766b-82d4-4da1-8788-ae91cce3b21f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:02.044994 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a56a766b-82d4-4da1-8788-ae91cce3b21f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:02.045423 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a56a766b-82d4-4da1-8788-ae91cce3b21f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:02.073739 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a56a766b-82d4-4da1-8788-ae91cce3b21f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040458 Oct 15 03:43:02.074277 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 314/605] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:02 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:02.285865 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5a79e98f-cf49-40a8-a65f-793e2185d4f6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:02.286763 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5a79e98f-cf49-40a8-a65f-793e2185d4f6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:02.292527 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5a79e98f-cf49-40a8-a65f-793e2185d4f6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:02.292973 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5a79e98f-cf49-40a8-a65f-793e2185d4f6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:02.293753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5a79e98f-cf49-40a8-a65f-793e2185d4f6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:02.294182 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5a79e98f-cf49-40a8-a65f-793e2185d4f6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:02.322015 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5a79e98f-cf49-40a8-a65f-793e2185d4f6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040483 Oct 15 03:43:02.322549 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 292/606] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:02 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:03.085327 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ecf252e4-5bfb-4bf7-adc9-7981945ca0ed tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:03.086238 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ecf252e4-5bfb-4bf7-adc9-7981945ca0ed tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:03.092271 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ecf252e4-5bfb-4bf7-adc9-7981945ca0ed tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:03.092717 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ecf252e4-5bfb-4bf7-adc9-7981945ca0ed tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:03.093470 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ecf252e4-5bfb-4bf7-adc9-7981945ca0ed tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:03.093908 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ecf252e4-5bfb-4bf7-adc9-7981945ca0ed tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:03.127444 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ecf252e4-5bfb-4bf7-adc9-7981945ca0ed tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046348 Oct 15 03:43:03.128033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 315/607] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:03 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:03.333494 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-29645344-fa73-48ff-8803-59cf775eaa87 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:03.334401 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-29645344-fa73-48ff-8803-59cf775eaa87 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:03.340604 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-29645344-fa73-48ff-8803-59cf775eaa87 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:03.340986 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-29645344-fa73-48ff-8803-59cf775eaa87 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:03.341742 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-29645344-fa73-48ff-8803-59cf775eaa87 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:03.342175 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-29645344-fa73-48ff-8803-59cf775eaa87 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:03.370996 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-29645344-fa73-48ff-8803-59cf775eaa87 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041325 Oct 15 03:43:03.371528 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 293/608] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:03 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:04.140266 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9d79782a-c762-486c-9404-c8713041ba9d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:04.141182 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9d79782a-c762-486c-9404-c8713041ba9d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:04.147507 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d79782a-c762-486c-9404-c8713041ba9d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:04.147984 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d79782a-c762-486c-9404-c8713041ba9d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:04.148746 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d79782a-c762-486c-9404-c8713041ba9d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:04.149183 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d79782a-c762-486c-9404-c8713041ba9d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:04.177375 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9d79782a-c762-486c-9404-c8713041ba9d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041128 Oct 15 03:43:04.177906 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 316/609] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:04 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:04.382726 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9741d00b-339d-4336-a0e3-08c3389b2405 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:04.383563 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9741d00b-339d-4336-a0e3-08c3389b2405 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:04.389423 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9741d00b-339d-4336-a0e3-08c3389b2405 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:04.389864 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9741d00b-339d-4336-a0e3-08c3389b2405 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:04.390618 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9741d00b-339d-4336-a0e3-08c3389b2405 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:04.391048 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9741d00b-339d-4336-a0e3-08c3389b2405 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:04.419026 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9741d00b-339d-4336-a0e3-08c3389b2405 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040678 Oct 15 03:43:04.419559 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 294/610] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:04 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:05.188554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-13cdace0-60cf-4325-aec8-0eaba636f20d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:05.189461 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-13cdace0-60cf-4325-aec8-0eaba636f20d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:05.195263 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-13cdace0-60cf-4325-aec8-0eaba636f20d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:05.195734 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-13cdace0-60cf-4325-aec8-0eaba636f20d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:05.196501 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-13cdace0-60cf-4325-aec8-0eaba636f20d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:05.196970 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-13cdace0-60cf-4325-aec8-0eaba636f20d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:05.225192 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-13cdace0-60cf-4325-aec8-0eaba636f20d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040444 Oct 15 03:43:05.225721 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 317/611] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:05 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:05.430205 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e13d06bb-73d4-4664-b6bc-60bf1a674794 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:05.431125 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e13d06bb-73d4-4664-b6bc-60bf1a674794 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:05.436878 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e13d06bb-73d4-4664-b6bc-60bf1a674794 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:05.437319 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e13d06bb-73d4-4664-b6bc-60bf1a674794 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:05.438161 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e13d06bb-73d4-4664-b6bc-60bf1a674794 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:05.438641 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e13d06bb-73d4-4664-b6bc-60bf1a674794 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:05.467323 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e13d06bb-73d4-4664-b6bc-60bf1a674794 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040864 Oct 15 03:43:05.467892 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 295/612] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:05 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:06.236445 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-be03332c-6cd6-4898-b754-1ba2c3ffab5f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:06.237283 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-be03332c-6cd6-4898-b754-1ba2c3ffab5f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:06.243575 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-be03332c-6cd6-4898-b754-1ba2c3ffab5f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:06.244370 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-be03332c-6cd6-4898-b754-1ba2c3ffab5f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:06.244799 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-be03332c-6cd6-4898-b754-1ba2c3ffab5f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:06.245233 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-be03332c-6cd6-4898-b754-1ba2c3ffab5f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:06.274125 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-be03332c-6cd6-4898-b754-1ba2c3ffab5f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041502 Oct 15 03:43:06.274668 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 318/613] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:06 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:06.479226 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1a41e7e7-9928-4c1c-afa0-0007a8de711b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:06.480159 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1a41e7e7-9928-4c1c-afa0-0007a8de711b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:06.486513 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1a41e7e7-9928-4c1c-afa0-0007a8de711b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:06.486905 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1a41e7e7-9928-4c1c-afa0-0007a8de711b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:06.487663 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1a41e7e7-9928-4c1c-afa0-0007a8de711b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:06.488124 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1a41e7e7-9928-4c1c-afa0-0007a8de711b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:06.516466 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1a41e7e7-9928-4c1c-afa0-0007a8de711b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041035 Oct 15 03:43:06.517003 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 296/614] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:06 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:07.285356 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2c96bee4-e98c-4a4a-823a-d7e256c580f0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:07.286794 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2c96bee4-e98c-4a4a-823a-d7e256c580f0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:07.292571 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2c96bee4-e98c-4a4a-823a-d7e256c580f0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:07.293018 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2c96bee4-e98c-4a4a-823a-d7e256c580f0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:07.293775 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2c96bee4-e98c-4a4a-823a-d7e256c580f0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:07.294209 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2c96bee4-e98c-4a4a-823a-d7e256c580f0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:07.322411 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2c96bee4-e98c-4a4a-823a-d7e256c580f0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040836 Oct 15 03:43:07.322940 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 319/615] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:07 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:07.527871 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-bfa583d1-d650-4657-b32f-7cd252e8d126 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:07.528780 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-bfa583d1-d650-4657-b32f-7cd252e8d126 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:07.534518 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfa583d1-d650-4657-b32f-7cd252e8d126 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:07.534964 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfa583d1-d650-4657-b32f-7cd252e8d126 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:07.535743 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfa583d1-d650-4657-b32f-7cd252e8d126 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:07.536679 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfa583d1-d650-4657-b32f-7cd252e8d126 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:07.564971 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-bfa583d1-d650-4657-b32f-7cd252e8d126 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040894 Oct 15 03:43:07.565513 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 297/616] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:07 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:08.334484 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-38975e2a-b197-4d2d-83ba-c667337fa99e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:08.335336 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-38975e2a-b197-4d2d-83ba-c667337fa99e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:08.341365 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-38975e2a-b197-4d2d-83ba-c667337fa99e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:08.341816 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-38975e2a-b197-4d2d-83ba-c667337fa99e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:08.342571 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-38975e2a-b197-4d2d-83ba-c667337fa99e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:08.343004 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-38975e2a-b197-4d2d-83ba-c667337fa99e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:08.370967 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-38975e2a-b197-4d2d-83ba-c667337fa99e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041217 Oct 15 03:43:08.371499 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 320/617] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:08 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:08.576412 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7e2fceff-4b22-46bc-97af-f1024ddee6cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:08.577319 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7e2fceff-4b22-46bc-97af-f1024ddee6cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:08.582982 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7e2fceff-4b22-46bc-97af-f1024ddee6cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:08.583430 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7e2fceff-4b22-46bc-97af-f1024ddee6cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:08.584232 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7e2fceff-4b22-46bc-97af-f1024ddee6cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:08.584716 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7e2fceff-4b22-46bc-97af-f1024ddee6cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:08.612256 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7e2fceff-4b22-46bc-97af-f1024ddee6cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039748 Oct 15 03:43:08.612786 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 298/618] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:08 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:09.382187 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c6f36c36-e726-4e06-b172-2c4783c027cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:09.383098 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c6f36c36-e726-4e06-b172-2c4783c027cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:09.388873 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c6f36c36-e726-4e06-b172-2c4783c027cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:09.389314 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c6f36c36-e726-4e06-b172-2c4783c027cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:09.390065 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c6f36c36-e726-4e06-b172-2c4783c027cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:09.390496 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c6f36c36-e726-4e06-b172-2c4783c027cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:09.418878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c6f36c36-e726-4e06-b172-2c4783c027cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040476 Oct 15 03:43:09.419403 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 321/619] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:09 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:09.624209 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1ce7191f-2969-4c70-b6f0-aaf31bb57c68 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:09.625068 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1ce7191f-2969-4c70-b6f0-aaf31bb57c68 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:09.631308 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1ce7191f-2969-4c70-b6f0-aaf31bb57c68 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:09.631782 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1ce7191f-2969-4c70-b6f0-aaf31bb57c68 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:09.632542 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1ce7191f-2969-4c70-b6f0-aaf31bb57c68 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:09.632976 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1ce7191f-2969-4c70-b6f0-aaf31bb57c68 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:09.661014 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1ce7191f-2969-4c70-b6f0-aaf31bb57c68 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040668 Oct 15 03:43:09.661549 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 299/620] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:09 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:10.430081 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-092052fc-ccae-4514-8b19-1adfb7bb7e37 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:10.430916 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-092052fc-ccae-4514-8b19-1adfb7bb7e37 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:10.436668 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-092052fc-ccae-4514-8b19-1adfb7bb7e37 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:10.437110 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-092052fc-ccae-4514-8b19-1adfb7bb7e37 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:10.437858 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-092052fc-ccae-4514-8b19-1adfb7bb7e37 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:10.438286 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-092052fc-ccae-4514-8b19-1adfb7bb7e37 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:10.466992 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-092052fc-ccae-4514-8b19-1adfb7bb7e37 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040690 Oct 15 03:43:10.467516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 322/621] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:10 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:10.672293 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-dbfad9cc-2e1c-4aae-8b42-076690cd32e5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:10.673195 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-dbfad9cc-2e1c-4aae-8b42-076690cd32e5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:10.679281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dbfad9cc-2e1c-4aae-8b42-076690cd32e5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:10.679753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dbfad9cc-2e1c-4aae-8b42-076690cd32e5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:10.680564 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dbfad9cc-2e1c-4aae-8b42-076690cd32e5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:10.680955 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dbfad9cc-2e1c-4aae-8b42-076690cd32e5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:10.709115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-dbfad9cc-2e1c-4aae-8b42-076690cd32e5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040586 Oct 15 03:43:10.709652 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 300/622] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:10 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:11.478735 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d528e1e9-6add-40a4-99d8-6836e8470069 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:11.479650 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d528e1e9-6add-40a4-99d8-6836e8470069 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:11.487788 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d528e1e9-6add-40a4-99d8-6836e8470069 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:11.488232 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d528e1e9-6add-40a4-99d8-6836e8470069 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:11.488989 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d528e1e9-6add-40a4-99d8-6836e8470069 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:11.489471 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d528e1e9-6add-40a4-99d8-6836e8470069 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:11.516810 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d528e1e9-6add-40a4-99d8-6836e8470069 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041718 Oct 15 03:43:11.517280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 323/623] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:11 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:11.720758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a2558fe9-d466-4d56-bbc2-2fb05e3e523e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:11.721688 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a2558fe9-d466-4d56-bbc2-2fb05e3e523e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:11.727422 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a2558fe9-d466-4d56-bbc2-2fb05e3e523e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:11.727903 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a2558fe9-d466-4d56-bbc2-2fb05e3e523e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:11.728663 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a2558fe9-d466-4d56-bbc2-2fb05e3e523e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:11.729100 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a2558fe9-d466-4d56-bbc2-2fb05e3e523e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:11.757192 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a2558fe9-d466-4d56-bbc2-2fb05e3e523e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040256 Oct 15 03:43:11.757712 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 301/624] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:11 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:12.527306 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-50d39a6e-9576-44a4-8acd-8c3447db113c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:12.528164 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-50d39a6e-9576-44a4-8acd-8c3447db113c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:12.533903 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50d39a6e-9576-44a4-8acd-8c3447db113c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:12.534334 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50d39a6e-9576-44a4-8acd-8c3447db113c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:12.535095 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50d39a6e-9576-44a4-8acd-8c3447db113c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:12.535524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50d39a6e-9576-44a4-8acd-8c3447db113c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:12.564390 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-50d39a6e-9576-44a4-8acd-8c3447db113c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040971 Oct 15 03:43:12.564926 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 324/625] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:12 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:12.768372 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-dcabf2f5-58d9-4788-9155-45f00c015674 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:12.769268 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-dcabf2f5-58d9-4788-9155-45f00c015674 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:12.775002 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dcabf2f5-58d9-4788-9155-45f00c015674 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:12.775439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dcabf2f5-58d9-4788-9155-45f00c015674 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:12.776216 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dcabf2f5-58d9-4788-9155-45f00c015674 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:12.776644 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dcabf2f5-58d9-4788-9155-45f00c015674 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:12.805056 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-dcabf2f5-58d9-4788-9155-45f00c015674 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040372 Oct 15 03:43:12.805525 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 302/626] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:12 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:13.576037 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1070dc05-323c-46e0-8fd6-5b1501f7b5db tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:13.576905 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1070dc05-323c-46e0-8fd6-5b1501f7b5db tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:13.582578 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1070dc05-323c-46e0-8fd6-5b1501f7b5db tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:13.583644 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1070dc05-323c-46e0-8fd6-5b1501f7b5db tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:13.584418 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1070dc05-323c-46e0-8fd6-5b1501f7b5db tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:13.584846 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1070dc05-323c-46e0-8fd6-5b1501f7b5db tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:13.612604 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1070dc05-323c-46e0-8fd6-5b1501f7b5db tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040701 Oct 15 03:43:13.613150 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 325/627] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:13 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:13.816443 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9d687742-5d0c-4eea-855a-690f32266863 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:13.818264 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9d687742-5d0c-4eea-855a-690f32266863 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:13.824114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9d687742-5d0c-4eea-855a-690f32266863 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:13.824562 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9d687742-5d0c-4eea-855a-690f32266863 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:13.825347 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9d687742-5d0c-4eea-855a-690f32266863 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:13.825779 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9d687742-5d0c-4eea-855a-690f32266863 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:13.853614 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9d687742-5d0c-4eea-855a-690f32266863 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041178 Oct 15 03:43:13.854087 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 303/628] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:13 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:14.623756 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f52e9211-6af9-4710-99d0-21bf78de3ac8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:14.624584 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f52e9211-6af9-4710-99d0-21bf78de3ac8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:14.630452 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f52e9211-6af9-4710-99d0-21bf78de3ac8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:14.630899 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f52e9211-6af9-4710-99d0-21bf78de3ac8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:14.631652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f52e9211-6af9-4710-99d0-21bf78de3ac8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:14.632106 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f52e9211-6af9-4710-99d0-21bf78de3ac8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:14.660074 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f52e9211-6af9-4710-99d0-21bf78de3ac8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040143 Oct 15 03:43:14.660625 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 326/629] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:14 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:14.864909 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3f901d8a-d1ea-4096-ae77-06c4be0d15da tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:14.865804 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3f901d8a-d1ea-4096-ae77-06c4be0d15da tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:14.871498 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f901d8a-d1ea-4096-ae77-06c4be0d15da tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:14.871980 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f901d8a-d1ea-4096-ae77-06c4be0d15da tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:14.872730 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f901d8a-d1ea-4096-ae77-06c4be0d15da tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:14.873157 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f901d8a-d1ea-4096-ae77-06c4be0d15da tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:14.902563 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3f901d8a-d1ea-4096-ae77-06c4be0d15da tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041388 Oct 15 03:43:14.903051 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 304/630] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:14 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:15.672050 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-730bd162-fb0d-4b45-b393-236d304bf55d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:15.672877 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-730bd162-fb0d-4b45-b393-236d304bf55d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:15.679163 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-730bd162-fb0d-4b45-b393-236d304bf55d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:15.679605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-730bd162-fb0d-4b45-b393-236d304bf55d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:15.680386 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-730bd162-fb0d-4b45-b393-236d304bf55d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:15.680815 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-730bd162-fb0d-4b45-b393-236d304bf55d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:15.708041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-730bd162-fb0d-4b45-b393-236d304bf55d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039902 Oct 15 03:43:15.708571 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 327/631] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:15 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:15.914537 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-24e45bb6-e117-4cd7-8810-2ec8278f5402 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:15.915442 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-24e45bb6-e117-4cd7-8810-2ec8278f5402 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:15.921112 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-24e45bb6-e117-4cd7-8810-2ec8278f5402 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:15.921558 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-24e45bb6-e117-4cd7-8810-2ec8278f5402 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:15.922359 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-24e45bb6-e117-4cd7-8810-2ec8278f5402 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:15.922749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-24e45bb6-e117-4cd7-8810-2ec8278f5402 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:15.950639 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-24e45bb6-e117-4cd7-8810-2ec8278f5402 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040569 Oct 15 03:43:15.951182 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 305/632] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:15 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:16.719504 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ac8ac244-248b-4cb2-9a3a-647a6424575f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:16.720383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ac8ac244-248b-4cb2-9a3a-647a6424575f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:16.726176 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ac8ac244-248b-4cb2-9a3a-647a6424575f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:16.726624 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ac8ac244-248b-4cb2-9a3a-647a6424575f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:16.727379 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ac8ac244-248b-4cb2-9a3a-647a6424575f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:16.727846 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ac8ac244-248b-4cb2-9a3a-647a6424575f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:16.755525 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ac8ac244-248b-4cb2-9a3a-647a6424575f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039885 Oct 15 03:43:16.756703 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 328/633] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:16 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:16.962295 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-baf9422f-e64b-4d5a-867a-ea31b435c949 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:16.963174 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-baf9422f-e64b-4d5a-867a-ea31b435c949 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:16.968907 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baf9422f-e64b-4d5a-867a-ea31b435c949 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:16.969344 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baf9422f-e64b-4d5a-867a-ea31b435c949 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:16.970141 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baf9422f-e64b-4d5a-867a-ea31b435c949 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:16.970519 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baf9422f-e64b-4d5a-867a-ea31b435c949 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:16.999086 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-baf9422f-e64b-4d5a-867a-ea31b435c949 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040884 Oct 15 03:43:16.999612 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 306/634] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:16 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:17.767547 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-89b97c5d-2a61-4b0f-8af7-66f477f1f722 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:17.768484 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-89b97c5d-2a61-4b0f-8af7-66f477f1f722 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:17.774854 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-89b97c5d-2a61-4b0f-8af7-66f477f1f722 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:17.775301 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-89b97c5d-2a61-4b0f-8af7-66f477f1f722 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:17.776147 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-89b97c5d-2a61-4b0f-8af7-66f477f1f722 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:17.776584 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-89b97c5d-2a61-4b0f-8af7-66f477f1f722 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:17.803903 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-89b97c5d-2a61-4b0f-8af7-66f477f1f722 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040289 Oct 15 03:43:17.804374 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 329/635] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:17 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:18.010762 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3360775f-1bcf-48d4-acc3-6a12616b6c8b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:18.011656 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3360775f-1bcf-48d4-acc3-6a12616b6c8b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:18.017635 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3360775f-1bcf-48d4-acc3-6a12616b6c8b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:18.018078 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3360775f-1bcf-48d4-acc3-6a12616b6c8b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:18.018824 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3360775f-1bcf-48d4-acc3-6a12616b6c8b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:18.019252 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3360775f-1bcf-48d4-acc3-6a12616b6c8b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:18.048503 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3360775f-1bcf-48d4-acc3-6a12616b6c8b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041458 Oct 15 03:43:18.049060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 307/636] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:18 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:18.054146 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:43:18.054302 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 03:43:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:43:18.815211 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0663d235-28c0-4665-8d0a-baab1cbfc02f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:18.816140 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0663d235-28c0-4665-8d0a-baab1cbfc02f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:18.822075 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0663d235-28c0-4665-8d0a-baab1cbfc02f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:18.822513 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0663d235-28c0-4665-8d0a-baab1cbfc02f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:18.823262 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0663d235-28c0-4665-8d0a-baab1cbfc02f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:18.823711 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0663d235-28c0-4665-8d0a-baab1cbfc02f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:18.853217 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0663d235-28c0-4665-8d0a-baab1cbfc02f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042016 Oct 15 03:43:18.853747 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 330/637] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:18 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:19.058830 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a4249f4b-fc80-4b3b-af5b-3870c80f10a8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:19.059761 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a4249f4b-fc80-4b3b-af5b-3870c80f10a8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:19.065733 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4249f4b-fc80-4b3b-af5b-3870c80f10a8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:19.066123 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4249f4b-fc80-4b3b-af5b-3870c80f10a8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:19.066878 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4249f4b-fc80-4b3b-af5b-3870c80f10a8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:19.067312 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4249f4b-fc80-4b3b-af5b-3870c80f10a8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:19.096467 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a4249f4b-fc80-4b3b-af5b-3870c80f10a8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041379 Oct 15 03:43:19.097008 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 308/638] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:19 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:19.864362 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-dfffee29-e7b0-46d2-97a4-d71fa7236990 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:19.865262 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-dfffee29-e7b0-46d2-97a4-d71fa7236990 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:19.870988 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfffee29-e7b0-46d2-97a4-d71fa7236990 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:19.871450 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfffee29-e7b0-46d2-97a4-d71fa7236990 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:19.872226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfffee29-e7b0-46d2-97a4-d71fa7236990 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:19.872652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfffee29-e7b0-46d2-97a4-d71fa7236990 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:19.901045 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-dfffee29-e7b0-46d2-97a4-d71fa7236990 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040388 Oct 15 03:43:19.901567 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 331/639] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:19 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:20.108491 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-797999fc-c24b-4941-9a20-8bb8166cca64 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:20.109484 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-797999fc-c24b-4941-9a20-8bb8166cca64 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:20.115205 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-797999fc-c24b-4941-9a20-8bb8166cca64 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:20.115652 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-797999fc-c24b-4941-9a20-8bb8166cca64 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:20.116439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-797999fc-c24b-4941-9a20-8bb8166cca64 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:20.116873 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-797999fc-c24b-4941-9a20-8bb8166cca64 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:20.144850 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-797999fc-c24b-4941-9a20-8bb8166cca64 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040193 Oct 15 03:43:20.145388 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 309/640] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:20 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:20.912322 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-44d9ebe5-928f-4279-9f2d-30a99bc20293 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:20.913177 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-44d9ebe5-928f-4279-9f2d-30a99bc20293 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:20.919430 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-44d9ebe5-928f-4279-9f2d-30a99bc20293 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:20.919930 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-44d9ebe5-928f-4279-9f2d-30a99bc20293 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:20.920692 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-44d9ebe5-928f-4279-9f2d-30a99bc20293 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:20.921127 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-44d9ebe5-928f-4279-9f2d-30a99bc20293 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:20.949393 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-44d9ebe5-928f-4279-9f2d-30a99bc20293 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040871 Oct 15 03:43:20.949929 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 332/641] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:20 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:21.156987 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-36894496-ffd1-4d34-bcc3-6baab2e56cca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:21.157926 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-36894496-ffd1-4d34-bcc3-6baab2e56cca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:21.163813 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-36894496-ffd1-4d34-bcc3-6baab2e56cca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:21.164205 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-36894496-ffd1-4d34-bcc3-6baab2e56cca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:21.165547 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-36894496-ffd1-4d34-bcc3-6baab2e56cca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:21.165978 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-36894496-ffd1-4d34-bcc3-6baab2e56cca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:21.193334 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-36894496-ffd1-4d34-bcc3-6baab2e56cca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040227 Oct 15 03:43:21.193862 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 310/642] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:21 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:21.961654 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-93e6576b-70d1-48f9-bb69-5c7cbd01a6a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:21.962567 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-93e6576b-70d1-48f9-bb69-5c7cbd01a6a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:21.968360 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-93e6576b-70d1-48f9-bb69-5c7cbd01a6a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:21.968808 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-93e6576b-70d1-48f9-bb69-5c7cbd01a6a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:21.969568 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-93e6576b-70d1-48f9-bb69-5c7cbd01a6a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:21.969999 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-93e6576b-70d1-48f9-bb69-5c7cbd01a6a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:21.997774 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-93e6576b-70d1-48f9-bb69-5c7cbd01a6a1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041011 Oct 15 03:43:21.998305 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 333/643] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:21 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:22.204922 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0a62e5f7-768b-4e3f-b6dd-e05801e89ae1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:22.205823 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0a62e5f7-768b-4e3f-b6dd-e05801e89ae1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:22.211941 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0a62e5f7-768b-4e3f-b6dd-e05801e89ae1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:22.212339 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0a62e5f7-768b-4e3f-b6dd-e05801e89ae1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:22.213096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0a62e5f7-768b-4e3f-b6dd-e05801e89ae1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:22.213527 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0a62e5f7-768b-4e3f-b6dd-e05801e89ae1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:22.242032 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0a62e5f7-768b-4e3f-b6dd-e05801e89ae1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040840 Oct 15 03:43:22.243157 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 311/644] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:22 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:23.008003 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-81041177-61bb-4280-88f8-d13158ebe833 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:23.009431 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-81041177-61bb-4280-88f8-d13158ebe833 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:23.015261 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81041177-61bb-4280-88f8-d13158ebe833 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:23.015720 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81041177-61bb-4280-88f8-d13158ebe833 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:23.016468 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81041177-61bb-4280-88f8-d13158ebe833 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:23.016895 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81041177-61bb-4280-88f8-d13158ebe833 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:23.044715 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-81041177-61bb-4280-88f8-d13158ebe833 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040449 Oct 15 03:43:23.045236 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 334/645] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:23 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:23.254106 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-be6d049b-dd5a-4f5a-94d0-03ce0684c0cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:23.254994 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-be6d049b-dd5a-4f5a-94d0-03ce0684c0cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:23.261437 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-be6d049b-dd5a-4f5a-94d0-03ce0684c0cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:23.261823 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-be6d049b-dd5a-4f5a-94d0-03ce0684c0cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:23.262597 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-be6d049b-dd5a-4f5a-94d0-03ce0684c0cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:23.263026 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-be6d049b-dd5a-4f5a-94d0-03ce0684c0cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:23.290095 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-be6d049b-dd5a-4f5a-94d0-03ce0684c0cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039757 Oct 15 03:43:23.290624 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 312/646] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:23 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:24.055264 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bf881723-9e84-4f92-9b51-2c802f766da2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:24.056218 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bf881723-9e84-4f92-9b51-2c802f766da2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:24.061950 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf881723-9e84-4f92-9b51-2c802f766da2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:24.062393 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf881723-9e84-4f92-9b51-2c802f766da2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:24.063144 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf881723-9e84-4f92-9b51-2c802f766da2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:24.063572 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf881723-9e84-4f92-9b51-2c802f766da2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:24.092057 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bf881723-9e84-4f92-9b51-2c802f766da2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040518 Oct 15 03:43:24.092584 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 335/647] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:24 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:43:24.301333 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-79899b43-d976-4ad2-aa42-01bfe45632ff tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:24.302236 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-79899b43-d976-4ad2-aa42-01bfe45632ff tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:24.307939 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-79899b43-d976-4ad2-aa42-01bfe45632ff tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:24.308334 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-79899b43-d976-4ad2-aa42-01bfe45632ff tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:24.309088 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-79899b43-d976-4ad2-aa42-01bfe45632ff tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:24.309520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-79899b43-d976-4ad2-aa42-01bfe45632ff tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:24.337528 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-79899b43-d976-4ad2-aa42-01bfe45632ff tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039983 Oct 15 03:43:24.338068 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 313/648] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:24 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:25.102673 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a5df6862-205b-4229-88b0-3e3899f4bf40 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:25.103574 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a5df6862-205b-4229-88b0-3e3899f4bf40 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:25.109276 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a5df6862-205b-4229-88b0-3e3899f4bf40 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:25.109717 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a5df6862-205b-4229-88b0-3e3899f4bf40 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:25.110460 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a5df6862-205b-4229-88b0-3e3899f4bf40 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:25.110887 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a5df6862-205b-4229-88b0-3e3899f4bf40 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:25.138571 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a5df6862-205b-4229-88b0-3e3899f4bf40 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040169 Oct 15 03:43:25.139092 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 336/649] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:25 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:25.524499 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ff86e7b7-e139-4b19-9e3f-b87c9eca9661 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:25.525448 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ff86e7b7-e139-4b19-9e3f-b87c9eca9661 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:25.531349 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ff86e7b7-e139-4b19-9e3f-b87c9eca9661 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:25.531824 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ff86e7b7-e139-4b19-9e3f-b87c9eca9661 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:25.532583 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ff86e7b7-e139-4b19-9e3f-b87c9eca9661 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:25.533008 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ff86e7b7-e139-4b19-9e3f-b87c9eca9661 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:25.561634 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ff86e7b7-e139-4b19-9e3f-b87c9eca9661 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.216860 Oct 15 03:43:25.562206 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 314/650] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:25 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:25.613660 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:43:25.613897 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 03:43:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:43:26.150062 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ef6b49e1-6843-4d3f-839f-7e57e80ed329 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:26.150971 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ef6b49e1-6843-4d3f-839f-7e57e80ed329 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:26.156831 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ef6b49e1-6843-4d3f-839f-7e57e80ed329 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:26.157287 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ef6b49e1-6843-4d3f-839f-7e57e80ed329 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:26.158039 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ef6b49e1-6843-4d3f-839f-7e57e80ed329 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:26.158468 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ef6b49e1-6843-4d3f-839f-7e57e80ed329 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:26.186868 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ef6b49e1-6843-4d3f-839f-7e57e80ed329 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040545 Oct 15 03:43:26.187392 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 337/651] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:26 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:26.573201 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2420101e-ce1e-4959-a1a3-4bcb43bc66ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:26.574096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2420101e-ce1e-4959-a1a3-4bcb43bc66ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:26.579805 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2420101e-ce1e-4959-a1a3-4bcb43bc66ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:26.580249 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2420101e-ce1e-4959-a1a3-4bcb43bc66ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:26.581005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2420101e-ce1e-4959-a1a3-4bcb43bc66ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:26.581430 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2420101e-ce1e-4959-a1a3-4bcb43bc66ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:26.610634 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2420101e-ce1e-4959-a1a3-4bcb43bc66ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041208 Oct 15 03:43:26.611172 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 315/652] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:26 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:27.198481 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1120a97f-b427-4930-928d-a55193b096a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:27.199419 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1120a97f-b427-4930-928d-a55193b096a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:27.205222 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1120a97f-b427-4930-928d-a55193b096a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:27.205667 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1120a97f-b427-4930-928d-a55193b096a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:27.206426 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1120a97f-b427-4930-928d-a55193b096a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:27.206861 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1120a97f-b427-4930-928d-a55193b096a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:27.234300 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1120a97f-b427-4930-928d-a55193b096a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040127 Oct 15 03:43:27.234846 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 338/653] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:27 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:27.622710 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-10df1e9a-a126-4faf-98b1-3c0bab26edfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:27.623888 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-10df1e9a-a126-4faf-98b1-3c0bab26edfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:27.629369 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10df1e9a-a126-4faf-98b1-3c0bab26edfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:27.629831 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10df1e9a-a126-4faf-98b1-3c0bab26edfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:27.630573 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10df1e9a-a126-4faf-98b1-3c0bab26edfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:27.631009 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10df1e9a-a126-4faf-98b1-3c0bab26edfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:27.658599 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-10df1e9a-a126-4faf-98b1-3c0bab26edfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040369 Oct 15 03:43:27.659140 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 316/654] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:27 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:28.245445 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ca40c5cb-42df-433e-959a-0aeea21569bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:28.246380 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ca40c5cb-42df-433e-959a-0aeea21569bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:28.252415 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ca40c5cb-42df-433e-959a-0aeea21569bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:28.252854 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ca40c5cb-42df-433e-959a-0aeea21569bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:28.253603 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ca40c5cb-42df-433e-959a-0aeea21569bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:28.254026 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ca40c5cb-42df-433e-959a-0aeea21569bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:28.282386 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ca40c5cb-42df-433e-959a-0aeea21569bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040689 Oct 15 03:43:28.282919 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 339/655] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:28 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:28.669269 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-22c00e8a-0bfd-4789-9817-d3dca388e18d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:28.670171 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-22c00e8a-0bfd-4789-9817-d3dca388e18d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:28.676170 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-22c00e8a-0bfd-4789-9817-d3dca388e18d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:28.676618 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-22c00e8a-0bfd-4789-9817-d3dca388e18d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:28.677408 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-22c00e8a-0bfd-4789-9817-d3dca388e18d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:28.677843 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-22c00e8a-0bfd-4789-9817-d3dca388e18d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:28.706697 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-22c00e8a-0bfd-4789-9817-d3dca388e18d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041256 Oct 15 03:43:28.707244 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 317/656] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:28 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:29.294265 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5b2e64e6-e533-4e9b-8adc-a3a3aab830c7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:29.295224 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5b2e64e6-e533-4e9b-8adc-a3a3aab830c7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:29.300840 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5b2e64e6-e533-4e9b-8adc-a3a3aab830c7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:29.301285 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5b2e64e6-e533-4e9b-8adc-a3a3aab830c7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:29.302743 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5b2e64e6-e533-4e9b-8adc-a3a3aab830c7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:29.303383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5b2e64e6-e533-4e9b-8adc-a3a3aab830c7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:29.332035 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5b2e64e6-e533-4e9b-8adc-a3a3aab830c7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042155 Oct 15 03:43:29.332593 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 340/657] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:29 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:29.718615 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8e685f1c-d13e-467a-a182-7f6ed9297db4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:29.719514 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8e685f1c-d13e-467a-a182-7f6ed9297db4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:29.725169 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8e685f1c-d13e-467a-a182-7f6ed9297db4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:29.725609 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8e685f1c-d13e-467a-a182-7f6ed9297db4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:29.726358 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8e685f1c-d13e-467a-a182-7f6ed9297db4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:29.726793 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8e685f1c-d13e-467a-a182-7f6ed9297db4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:29.754101 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8e685f1c-d13e-467a-a182-7f6ed9297db4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039278 Oct 15 03:43:29.754637 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 318/658] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:29 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:30.343323 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-17e0565b-2402-4d72-923e-4dc1b302de45 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:30.344217 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-17e0565b-2402-4d72-923e-4dc1b302de45 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:30.350109 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-17e0565b-2402-4d72-923e-4dc1b302de45 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:30.350555 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-17e0565b-2402-4d72-923e-4dc1b302de45 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:30.351314 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-17e0565b-2402-4d72-923e-4dc1b302de45 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:30.351774 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-17e0565b-2402-4d72-923e-4dc1b302de45 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:30.380740 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-17e0565b-2402-4d72-923e-4dc1b302de45 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041251 Oct 15 03:43:30.381266 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 341/659] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:30 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:30.754362 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:43:30.755271 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 03:43:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:43:30.771334 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-10d2c390-b1be-473b-b986-93951e8953fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:30.772557 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-10d2c390-b1be-473b-b986-93951e8953fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:30.779613 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10d2c390-b1be-473b-b986-93951e8953fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:30.780094 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10d2c390-b1be-473b-b986-93951e8953fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:30.780870 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10d2c390-b1be-473b-b986-93951e8953fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:30.781303 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10d2c390-b1be-473b-b986-93951e8953fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:30.811022 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-10d2c390-b1be-473b-b986-93951e8953fb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045332 Oct 15 03:43:30.811569 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 319/660] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:30 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:31.391952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d33cba0b-88c0-44d7-b56e-b0114d48115a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:31.392798 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d33cba0b-88c0-44d7-b56e-b0114d48115a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:31.398476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d33cba0b-88c0-44d7-b56e-b0114d48115a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:31.398922 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d33cba0b-88c0-44d7-b56e-b0114d48115a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:31.399665 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d33cba0b-88c0-44d7-b56e-b0114d48115a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:31.400773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d33cba0b-88c0-44d7-b56e-b0114d48115a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:31.429727 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d33cba0b-88c0-44d7-b56e-b0114d48115a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041586 Oct 15 03:43:31.430278 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 342/661] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:31 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:31.822971 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f1b954f9-bc84-4e99-8a0c-78751bbe31b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:31.823917 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f1b954f9-bc84-4e99-8a0c-78751bbe31b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:31.829717 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f1b954f9-bc84-4e99-8a0c-78751bbe31b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:31.830154 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f1b954f9-bc84-4e99-8a0c-78751bbe31b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:31.830913 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f1b954f9-bc84-4e99-8a0c-78751bbe31b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:31.831336 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f1b954f9-bc84-4e99-8a0c-78751bbe31b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:31.861149 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f1b954f9-bc84-4e99-8a0c-78751bbe31b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042639 Oct 15 03:43:31.861708 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 320/662] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:31 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:32.441609 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5057ae27-092d-4e78-beeb-3f1e1e9f03ba tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:32.442442 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5057ae27-092d-4e78-beeb-3f1e1e9f03ba tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:32.448131 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5057ae27-092d-4e78-beeb-3f1e1e9f03ba tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:32.448580 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5057ae27-092d-4e78-beeb-3f1e1e9f03ba tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:32.449336 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5057ae27-092d-4e78-beeb-3f1e1e9f03ba tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:32.449771 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5057ae27-092d-4e78-beeb-3f1e1e9f03ba tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:32.479496 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5057ae27-092d-4e78-beeb-3f1e1e9f03ba tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041446 Oct 15 03:43:32.480068 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 343/663] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:32 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:32.872163 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-05a8742f-c83d-4743-852c-f129c15f4dc8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:32.873065 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-05a8742f-c83d-4743-852c-f129c15f4dc8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:32.878810 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-05a8742f-c83d-4743-852c-f129c15f4dc8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:32.879256 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-05a8742f-c83d-4743-852c-f129c15f4dc8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:32.880042 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-05a8742f-c83d-4743-852c-f129c15f4dc8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:32.880496 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-05a8742f-c83d-4743-852c-f129c15f4dc8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:32.909015 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-05a8742f-c83d-4743-852c-f129c15f4dc8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040624 Oct 15 03:43:32.909598 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 321/664] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:32 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:33.490702 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d7fc5757-b7bc-412a-adaf-866c66fd38bd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:33.491606 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d7fc5757-b7bc-412a-adaf-866c66fd38bd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:33.498119 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7fc5757-b7bc-412a-adaf-866c66fd38bd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:33.498509 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7fc5757-b7bc-412a-adaf-866c66fd38bd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:33.499261 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7fc5757-b7bc-412a-adaf-866c66fd38bd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:33.499703 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7fc5757-b7bc-412a-adaf-866c66fd38bd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:33.527333 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d7fc5757-b7bc-412a-adaf-866c66fd38bd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040467 Oct 15 03:43:33.527891 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 344/665] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:33 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:33.921042 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2e5445db-0cf5-4e46-83d6-0a3ae478f5c8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:33.921952 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2e5445db-0cf5-4e46-83d6-0a3ae478f5c8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:33.927655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2e5445db-0cf5-4e46-83d6-0a3ae478f5c8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:33.928134 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2e5445db-0cf5-4e46-83d6-0a3ae478f5c8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:33.928899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2e5445db-0cf5-4e46-83d6-0a3ae478f5c8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:33.929335 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2e5445db-0cf5-4e46-83d6-0a3ae478f5c8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:33.956884 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2e5445db-0cf5-4e46-83d6-0a3ae478f5c8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039603 Oct 15 03:43:33.957419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 322/666] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:33 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:34.538536 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a003c669-a839-4b15-a033-5a3f72bfeb36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:34.539359 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a003c669-a839-4b15-a033-5a3f72bfeb36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:34.545150 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a003c669-a839-4b15-a033-5a3f72bfeb36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:34.545595 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a003c669-a839-4b15-a033-5a3f72bfeb36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:34.546347 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a003c669-a839-4b15-a033-5a3f72bfeb36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:34.546777 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a003c669-a839-4b15-a033-5a3f72bfeb36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:34.575571 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a003c669-a839-4b15-a033-5a3f72bfeb36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040816 Oct 15 03:43:34.576155 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 345/667] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:34 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:43:34.967961 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4c4aba40-008b-4f1c-88c4-03df5477e97b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:34.968861 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4c4aba40-008b-4f1c-88c4-03df5477e97b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:34.974496 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4c4aba40-008b-4f1c-88c4-03df5477e97b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:34.974946 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4c4aba40-008b-4f1c-88c4-03df5477e97b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:34.975721 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4c4aba40-008b-4f1c-88c4-03df5477e97b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:34.976159 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4c4aba40-008b-4f1c-88c4-03df5477e97b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:35.004642 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4c4aba40-008b-4f1c-88c4-03df5477e97b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040369 Oct 15 03:43:35.005184 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 323/668] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:34 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:35.587226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-70c726cb-ac0f-4222-89b3-912ad73dde48 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:35.588638 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-70c726cb-ac0f-4222-89b3-912ad73dde48 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:35.594649 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-70c726cb-ac0f-4222-89b3-912ad73dde48 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:35.595090 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-70c726cb-ac0f-4222-89b3-912ad73dde48 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:35.595876 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-70c726cb-ac0f-4222-89b3-912ad73dde48 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:35.596304 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-70c726cb-ac0f-4222-89b3-912ad73dde48 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:35.623259 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-70c726cb-ac0f-4222-89b3-912ad73dde48 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040321 Oct 15 03:43:35.623803 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 346/669] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:35 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:36.016177 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fe9bc0f0-71d2-45fb-b1f0-5545c36001de tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:36.017074 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fe9bc0f0-71d2-45fb-b1f0-5545c36001de tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:36.022765 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe9bc0f0-71d2-45fb-b1f0-5545c36001de tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:36.023204 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe9bc0f0-71d2-45fb-b1f0-5545c36001de tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:36.023977 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe9bc0f0-71d2-45fb-b1f0-5545c36001de tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:36.024406 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe9bc0f0-71d2-45fb-b1f0-5545c36001de tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:36.051464 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fe9bc0f0-71d2-45fb-b1f0-5545c36001de tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039046 Oct 15 03:43:36.052025 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 324/670] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:36 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:43:36.634313 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a0f06f00-6363-49b5-ac73-206f6709a739 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:36.635153 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a0f06f00-6363-49b5-ac73-206f6709a739 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:36.640876 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0f06f00-6363-49b5-ac73-206f6709a739 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:36.641325 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0f06f00-6363-49b5-ac73-206f6709a739 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:36.642084 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0f06f00-6363-49b5-ac73-206f6709a739 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:36.642521 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0f06f00-6363-49b5-ac73-206f6709a739 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:36.670461 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a0f06f00-6363-49b5-ac73-206f6709a739 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039970 Oct 15 03:43:36.670990 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 347/671] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:36 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:37.062034 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3302ba31-2db5-4cca-8a0c-ec087bb5233f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:37.062928 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3302ba31-2db5-4cca-8a0c-ec087bb5233f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:37.068637 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3302ba31-2db5-4cca-8a0c-ec087bb5233f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:37.069081 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3302ba31-2db5-4cca-8a0c-ec087bb5233f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:37.069833 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3302ba31-2db5-4cca-8a0c-ec087bb5233f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:37.070259 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3302ba31-2db5-4cca-8a0c-ec087bb5233f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:37.099017 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3302ba31-2db5-4cca-8a0c-ec087bb5233f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040686 Oct 15 03:43:37.099545 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 325/672] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:37 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:37.682133 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f9537562-363b-4946-8deb-d503ffef9d9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:37.683030 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f9537562-363b-4946-8deb-d503ffef9d9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:37.688710 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f9537562-363b-4946-8deb-d503ffef9d9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:37.689153 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f9537562-363b-4946-8deb-d503ffef9d9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:37.689930 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f9537562-363b-4946-8deb-d503ffef9d9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:37.690352 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f9537562-363b-4946-8deb-d503ffef9d9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:37.718388 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f9537562-363b-4946-8deb-d503ffef9d9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040015 Oct 15 03:43:37.718914 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 348/673] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:37 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:38.110093 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9d55193d-622a-4329-8b32-037ed0931cac tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:38.111033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9d55193d-622a-4329-8b32-037ed0931cac tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:38.116838 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9d55193d-622a-4329-8b32-037ed0931cac tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:38.117282 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9d55193d-622a-4329-8b32-037ed0931cac tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:38.118038 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9d55193d-622a-4329-8b32-037ed0931cac tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:38.118468 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9d55193d-622a-4329-8b32-037ed0931cac tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:38.146313 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9d55193d-622a-4329-8b32-037ed0931cac tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039943 Oct 15 03:43:38.146845 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 326/674] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:38 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:38.730206 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-334929ff-25ce-49d7-b568-45929b7ba08e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:38.731110 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-334929ff-25ce-49d7-b568-45929b7ba08e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:38.736850 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-334929ff-25ce-49d7-b568-45929b7ba08e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:38.737286 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-334929ff-25ce-49d7-b568-45929b7ba08e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:38.738036 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-334929ff-25ce-49d7-b568-45929b7ba08e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:38.738530 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-334929ff-25ce-49d7-b568-45929b7ba08e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:38.767214 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-334929ff-25ce-49d7-b568-45929b7ba08e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041267 Oct 15 03:43:38.767789 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 349/675] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:38 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:39.158062 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0864c48c-607b-4787-89e8-2ab0d492ccb3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:39.158959 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0864c48c-607b-4787-89e8-2ab0d492ccb3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:39.164652 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0864c48c-607b-4787-89e8-2ab0d492ccb3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:39.165090 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0864c48c-607b-4787-89e8-2ab0d492ccb3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:39.165923 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0864c48c-607b-4787-89e8-2ab0d492ccb3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:39.166350 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0864c48c-607b-4787-89e8-2ab0d492ccb3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:39.194234 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0864c48c-607b-4787-89e8-2ab0d492ccb3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039882 Oct 15 03:43:39.194758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 327/676] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:39 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:39.778018 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-37049476-ae9f-47d4-8e99-54f06378e342 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:39.778942 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-37049476-ae9f-47d4-8e99-54f06378e342 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:39.784752 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-37049476-ae9f-47d4-8e99-54f06378e342 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:39.785206 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-37049476-ae9f-47d4-8e99-54f06378e342 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:39.785990 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-37049476-ae9f-47d4-8e99-54f06378e342 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:39.786427 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-37049476-ae9f-47d4-8e99-54f06378e342 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:39.814396 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-37049476-ae9f-47d4-8e99-54f06378e342 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040623 Oct 15 03:43:39.814934 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 350/677] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:39 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:40.206001 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b45a0bfc-f2b8-4185-a924-b12f94888cba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:40.206969 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b45a0bfc-f2b8-4185-a924-b12f94888cba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:40.213556 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b45a0bfc-f2b8-4185-a924-b12f94888cba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:40.214066 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b45a0bfc-f2b8-4185-a924-b12f94888cba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:40.214879 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b45a0bfc-f2b8-4185-a924-b12f94888cba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:40.215309 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b45a0bfc-f2b8-4185-a924-b12f94888cba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:40.243884 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b45a0bfc-f2b8-4185-a924-b12f94888cba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041576 Oct 15 03:43:40.244449 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 328/678] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:40 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:40.825875 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-55ebdb0e-f603-4eeb-805d-d0c8a2e5a8f8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:40.826772 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-55ebdb0e-f603-4eeb-805d-d0c8a2e5a8f8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:40.833119 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-55ebdb0e-f603-4eeb-805d-d0c8a2e5a8f8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:40.833560 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-55ebdb0e-f603-4eeb-805d-d0c8a2e5a8f8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:40.834312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-55ebdb0e-f603-4eeb-805d-d0c8a2e5a8f8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:40.834735 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-55ebdb0e-f603-4eeb-805d-d0c8a2e5a8f8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:40.863281 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-55ebdb0e-f603-4eeb-805d-d0c8a2e5a8f8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041127 Oct 15 03:43:40.863809 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 351/679] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:40 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:41.254304 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-cc9b60cb-d8aa-4f4a-b4f5-e10c51a2c874 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:41.255316 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-cc9b60cb-d8aa-4f4a-b4f5-e10c51a2c874 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:41.261124 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc9b60cb-d8aa-4f4a-b4f5-e10c51a2c874 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:41.261571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc9b60cb-d8aa-4f4a-b4f5-e10c51a2c874 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:41.262328 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc9b60cb-d8aa-4f4a-b4f5-e10c51a2c874 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:41.262760 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc9b60cb-d8aa-4f4a-b4f5-e10c51a2c874 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:41.291548 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-cc9b60cb-d8aa-4f4a-b4f5-e10c51a2c874 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041083 Oct 15 03:43:41.292128 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 329/680] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:41 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:41.874197 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-69af78a1-23b2-498f-8ca1-ba5a3e0afbc3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:41.875089 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-69af78a1-23b2-498f-8ca1-ba5a3e0afbc3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:41.880847 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-69af78a1-23b2-498f-8ca1-ba5a3e0afbc3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:41.881288 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-69af78a1-23b2-498f-8ca1-ba5a3e0afbc3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:41.882035 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-69af78a1-23b2-498f-8ca1-ba5a3e0afbc3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:41.882463 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-69af78a1-23b2-498f-8ca1-ba5a3e0afbc3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:41.910749 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-69af78a1-23b2-498f-8ca1-ba5a3e0afbc3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040296 Oct 15 03:43:41.911271 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 352/681] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:41 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:42.302224 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-54d03b4e-af3e-4628-90a9-fd0684f77581 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:42.303123 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-54d03b4e-af3e-4628-90a9-fd0684f77581 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:42.309359 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-54d03b4e-af3e-4628-90a9-fd0684f77581 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:42.309796 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-54d03b4e-af3e-4628-90a9-fd0684f77581 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:42.310549 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-54d03b4e-af3e-4628-90a9-fd0684f77581 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:42.310973 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-54d03b4e-af3e-4628-90a9-fd0684f77581 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:42.339153 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-54d03b4e-af3e-4628-90a9-fd0684f77581 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040672 Oct 15 03:43:42.339696 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 330/682] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:42 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:42.922187 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7c30b31e-657c-475d-bca9-0b67a5360ebb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:42.923112 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7c30b31e-657c-475d-bca9-0b67a5360ebb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:42.928814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7c30b31e-657c-475d-bca9-0b67a5360ebb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:42.929254 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7c30b31e-657c-475d-bca9-0b67a5360ebb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:42.929998 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7c30b31e-657c-475d-bca9-0b67a5360ebb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:42.930423 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7c30b31e-657c-475d-bca9-0b67a5360ebb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:42.958628 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7c30b31e-657c-475d-bca9-0b67a5360ebb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040108 Oct 15 03:43:42.959160 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 353/683] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:42 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:43.350273 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0770a7f6-7116-4555-a074-5e90ecb0907b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:43.351176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0770a7f6-7116-4555-a074-5e90ecb0907b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:43.356859 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0770a7f6-7116-4555-a074-5e90ecb0907b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:43.357297 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0770a7f6-7116-4555-a074-5e90ecb0907b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:43.358038 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0770a7f6-7116-4555-a074-5e90ecb0907b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:43.358462 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0770a7f6-7116-4555-a074-5e90ecb0907b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:43.386908 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0770a7f6-7116-4555-a074-5e90ecb0907b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040359 Oct 15 03:43:43.387456 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 331/684] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:43 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:43.970612 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-378f48bc-d061-4f8c-8058-10cd103c2498 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:43.971520 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-378f48bc-d061-4f8c-8058-10cd103c2498 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:43.977242 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-378f48bc-d061-4f8c-8058-10cd103c2498 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:43.978189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-378f48bc-d061-4f8c-8058-10cd103c2498 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:43.978937 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-378f48bc-d061-4f8c-8058-10cd103c2498 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:43.979365 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-378f48bc-d061-4f8c-8058-10cd103c2498 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:44.007297 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-378f48bc-d061-4f8c-8058-10cd103c2498 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040422 Oct 15 03:43:44.007864 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 354/685] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:43 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:44.398496 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-06d6a367-be6e-47c2-a71d-9b89d73d597c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:44.399430 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-06d6a367-be6e-47c2-a71d-9b89d73d597c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:44.405833 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-06d6a367-be6e-47c2-a71d-9b89d73d597c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:44.406287 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-06d6a367-be6e-47c2-a71d-9b89d73d597c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:44.407084 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-06d6a367-be6e-47c2-a71d-9b89d73d597c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:44.407522 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-06d6a367-be6e-47c2-a71d-9b89d73d597c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:44.435823 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-06d6a367-be6e-47c2-a71d-9b89d73d597c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041008 Oct 15 03:43:44.436363 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 332/686] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:44 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:45.017892 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f11c4732-e411-45a7-b704-b1de6a3da8a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:45.018791 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f11c4732-e411-45a7-b704-b1de6a3da8a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:45.024539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f11c4732-e411-45a7-b704-b1de6a3da8a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:45.024980 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f11c4732-e411-45a7-b704-b1de6a3da8a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:45.025729 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f11c4732-e411-45a7-b704-b1de6a3da8a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:45.026152 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f11c4732-e411-45a7-b704-b1de6a3da8a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:45.054012 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f11c4732-e411-45a7-b704-b1de6a3da8a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039776 Oct 15 03:43:45.054629 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 355/687] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:45 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:45.446950 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f93e8831-d1ff-4ea2-b12c-cbf4f1fb9230 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:45.447885 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f93e8831-d1ff-4ea2-b12c-cbf4f1fb9230 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:45.453601 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f93e8831-d1ff-4ea2-b12c-cbf4f1fb9230 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:45.454052 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f93e8831-d1ff-4ea2-b12c-cbf4f1fb9230 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:45.454810 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f93e8831-d1ff-4ea2-b12c-cbf4f1fb9230 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:45.455243 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f93e8831-d1ff-4ea2-b12c-cbf4f1fb9230 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:45.488272 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f93e8831-d1ff-4ea2-b12c-cbf4f1fb9230 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044695 Oct 15 03:43:45.488833 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 333/688] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:45 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:46.066226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a19db8c0-a3be-4607-95a6-80ac6f984dc4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:46.067125 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a19db8c0-a3be-4607-95a6-80ac6f984dc4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:46.073906 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a19db8c0-a3be-4607-95a6-80ac6f984dc4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:46.074367 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a19db8c0-a3be-4607-95a6-80ac6f984dc4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:46.075144 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a19db8c0-a3be-4607-95a6-80ac6f984dc4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:46.075583 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a19db8c0-a3be-4607-95a6-80ac6f984dc4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:46.105048 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a19db8c0-a3be-4607-95a6-80ac6f984dc4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042560 Oct 15 03:43:46.105596 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 356/689] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:46 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:46.500074 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8bd9540d-b303-477a-8d6f-07f06d09c655 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:46.501140 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8bd9540d-b303-477a-8d6f-07f06d09c655 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:46.508392 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8bd9540d-b303-477a-8d6f-07f06d09c655 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:46.509816 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8bd9540d-b303-477a-8d6f-07f06d09c655 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:46.510912 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8bd9540d-b303-477a-8d6f-07f06d09c655 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:46.511339 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8bd9540d-b303-477a-8d6f-07f06d09c655 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:46.540731 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8bd9540d-b303-477a-8d6f-07f06d09c655 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044367 Oct 15 03:43:46.541283 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 334/690] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:46 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:47.116322 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-49385550-3ead-4b40-a312-716ffe58a2f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:47.117227 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-49385550-3ead-4b40-a312-716ffe58a2f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:47.123793 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-49385550-3ead-4b40-a312-716ffe58a2f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:47.124258 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-49385550-3ead-4b40-a312-716ffe58a2f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:47.125006 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-49385550-3ead-4b40-a312-716ffe58a2f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:47.125458 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-49385550-3ead-4b40-a312-716ffe58a2f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:47.153031 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-49385550-3ead-4b40-a312-716ffe58a2f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040476 Oct 15 03:43:47.153568 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 357/691] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:47 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:47.552169 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6f9c3841-9cdf-424b-89ed-6751f9f22d46 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:47.553078 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6f9c3841-9cdf-424b-89ed-6751f9f22d46 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:47.558748 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f9c3841-9cdf-424b-89ed-6751f9f22d46 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:47.559196 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f9c3841-9cdf-424b-89ed-6751f9f22d46 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:47.559984 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f9c3841-9cdf-424b-89ed-6751f9f22d46 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:47.560419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f9c3841-9cdf-424b-89ed-6751f9f22d46 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:47.589158 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6f9c3841-9cdf-424b-89ed-6751f9f22d46 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040725 Oct 15 03:43:47.589692 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 335/692] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:47 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:48.163770 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-aa17297a-0c4e-4624-8e93-f0a094131c7f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:48.164671 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-aa17297a-0c4e-4624-8e93-f0a094131c7f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:48.170410 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aa17297a-0c4e-4624-8e93-f0a094131c7f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:48.170862 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aa17297a-0c4e-4624-8e93-f0a094131c7f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:48.171609 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aa17297a-0c4e-4624-8e93-f0a094131c7f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:48.172065 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aa17297a-0c4e-4624-8e93-f0a094131c7f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:48.201055 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-aa17297a-0c4e-4624-8e93-f0a094131c7f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041020 Oct 15 03:43:48.201581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 358/693] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:48 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:48.600254 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1e44c373-9c37-4f9d-b09e-6fc2e4ce0fc0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:48.601149 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1e44c373-9c37-4f9d-b09e-6fc2e4ce0fc0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:48.607317 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1e44c373-9c37-4f9d-b09e-6fc2e4ce0fc0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:48.607784 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1e44c373-9c37-4f9d-b09e-6fc2e4ce0fc0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:48.608535 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1e44c373-9c37-4f9d-b09e-6fc2e4ce0fc0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:48.608959 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1e44c373-9c37-4f9d-b09e-6fc2e4ce0fc0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:48.637163 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1e44c373-9c37-4f9d-b09e-6fc2e4ce0fc0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040696 Oct 15 03:43:48.637694 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 336/694] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:48 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:49.213248 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7adfe733-8948-460b-916f-db04b32889a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:49.214439 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7adfe733-8948-460b-916f-db04b32889a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:49.220166 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7adfe733-8948-460b-916f-db04b32889a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:49.220618 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7adfe733-8948-460b-916f-db04b32889a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:49.221397 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7adfe733-8948-460b-916f-db04b32889a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:49.221830 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7adfe733-8948-460b-916f-db04b32889a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:49.250692 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7adfe733-8948-460b-916f-db04b32889a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042574 Oct 15 03:43:49.251235 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 359/695] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:49 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:49.648181 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-304ca130-75fd-45c1-b552-9a8e3ea4ff2f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:49.649099 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-304ca130-75fd-45c1-b552-9a8e3ea4ff2f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:49.655426 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-304ca130-75fd-45c1-b552-9a8e3ea4ff2f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:49.655905 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-304ca130-75fd-45c1-b552-9a8e3ea4ff2f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:49.656663 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-304ca130-75fd-45c1-b552-9a8e3ea4ff2f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:49.657087 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-304ca130-75fd-45c1-b552-9a8e3ea4ff2f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:49.684874 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-304ca130-75fd-45c1-b552-9a8e3ea4ff2f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040488 Oct 15 03:43:49.685407 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 337/696] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:49 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:50.262661 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6d142e91-75eb-439f-b01d-a47c5f36204c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:50.263585 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6d142e91-75eb-439f-b01d-a47c5f36204c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:50.269330 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6d142e91-75eb-439f-b01d-a47c5f36204c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:50.269772 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6d142e91-75eb-439f-b01d-a47c5f36204c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:50.270515 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6d142e91-75eb-439f-b01d-a47c5f36204c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:50.270944 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6d142e91-75eb-439f-b01d-a47c5f36204c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:50.299579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6d142e91-75eb-439f-b01d-a47c5f36204c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041309 Oct 15 03:43:50.300140 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 360/697] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:50 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:50.696126 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1cc9f836-1bf1-45f6-af87-884f685a8386 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:50.697058 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1cc9f836-1bf1-45f6-af87-884f685a8386 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:50.702666 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1cc9f836-1bf1-45f6-af87-884f685a8386 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:50.703114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1cc9f836-1bf1-45f6-af87-884f685a8386 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:50.703907 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1cc9f836-1bf1-45f6-af87-884f685a8386 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:50.704342 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1cc9f836-1bf1-45f6-af87-884f685a8386 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:50.732443 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1cc9f836-1bf1-45f6-af87-884f685a8386 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040101 Oct 15 03:43:50.732978 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 338/698] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:50 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:51.310350 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7df984d2-4bd7-4a09-8341-01368819746a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:51.311254 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7df984d2-4bd7-4a09-8341-01368819746a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:51.317094 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7df984d2-4bd7-4a09-8341-01368819746a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:51.317537 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7df984d2-4bd7-4a09-8341-01368819746a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:51.318340 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7df984d2-4bd7-4a09-8341-01368819746a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:51.318768 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7df984d2-4bd7-4a09-8341-01368819746a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:51.347473 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7df984d2-4bd7-4a09-8341-01368819746a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040840 Oct 15 03:43:51.348061 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 361/699] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:51 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:51.743567 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-cc200dd2-c3aa-419a-9dd7-092b3d9c0b7e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:51.744521 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-cc200dd2-c3aa-419a-9dd7-092b3d9c0b7e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:51.750196 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc200dd2-c3aa-419a-9dd7-092b3d9c0b7e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:51.750639 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc200dd2-c3aa-419a-9dd7-092b3d9c0b7e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:51.751393 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc200dd2-c3aa-419a-9dd7-092b3d9c0b7e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:51.751862 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc200dd2-c3aa-419a-9dd7-092b3d9c0b7e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:51.780246 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-cc200dd2-c3aa-419a-9dd7-092b3d9c0b7e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040370 Oct 15 03:43:51.780784 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 339/700] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:51 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:52.358831 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3e64cea7-677d-4848-af4a-dcfbd466bf87 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:52.359673 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3e64cea7-677d-4848-af4a-dcfbd466bf87 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:52.365373 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3e64cea7-677d-4848-af4a-dcfbd466bf87 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:52.365809 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3e64cea7-677d-4848-af4a-dcfbd466bf87 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:52.366558 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3e64cea7-677d-4848-af4a-dcfbd466bf87 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:52.366988 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3e64cea7-677d-4848-af4a-dcfbd466bf87 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:52.394554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3e64cea7-677d-4848-af4a-dcfbd466bf87 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039581 Oct 15 03:43:52.395110 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 362/701] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:52 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:52.790559 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-26fc0912-c217-4c5c-81ac-bb0aaff68aaa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:52.791459 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-26fc0912-c217-4c5c-81ac-bb0aaff68aaa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:52.797161 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-26fc0912-c217-4c5c-81ac-bb0aaff68aaa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:52.797604 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-26fc0912-c217-4c5c-81ac-bb0aaff68aaa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:52.798357 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-26fc0912-c217-4c5c-81ac-bb0aaff68aaa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:52.798789 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-26fc0912-c217-4c5c-81ac-bb0aaff68aaa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:52.829359 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-26fc0912-c217-4c5c-81ac-bb0aaff68aaa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042583 Oct 15 03:43:52.829898 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 340/702] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:52 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:53.406382 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-01c69027-6d90-44c8-af5e-ab865731a5b6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:53.407312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-01c69027-6d90-44c8-af5e-ab865731a5b6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:53.413097 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-01c69027-6d90-44c8-af5e-ab865731a5b6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:53.413537 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-01c69027-6d90-44c8-af5e-ab865731a5b6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:53.414287 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-01c69027-6d90-44c8-af5e-ab865731a5b6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:53.414717 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-01c69027-6d90-44c8-af5e-ab865731a5b6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:53.442350 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-01c69027-6d90-44c8-af5e-ab865731a5b6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039764 Oct 15 03:43:53.442867 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 363/703] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:53 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:53.841429 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fab1c050-9a6f-4486-b3aa-74ee5c954aa7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:53.842326 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fab1c050-9a6f-4486-b3aa-74ee5c954aa7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:53.847970 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fab1c050-9a6f-4486-b3aa-74ee5c954aa7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:53.848415 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fab1c050-9a6f-4486-b3aa-74ee5c954aa7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:53.849162 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fab1c050-9a6f-4486-b3aa-74ee5c954aa7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:53.849585 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fab1c050-9a6f-4486-b3aa-74ee5c954aa7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:53.876948 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fab1c050-9a6f-4486-b3aa-74ee5c954aa7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039894 Oct 15 03:43:53.877479 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 341/704] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:53 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:54.453646 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b8355eaf-b199-4b42-9ab9-46c29b64dd67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:54.454474 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b8355eaf-b199-4b42-9ab9-46c29b64dd67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:54.460180 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b8355eaf-b199-4b42-9ab9-46c29b64dd67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:54.460622 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b8355eaf-b199-4b42-9ab9-46c29b64dd67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:54.461635 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b8355eaf-b199-4b42-9ab9-46c29b64dd67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:54.462059 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b8355eaf-b199-4b42-9ab9-46c29b64dd67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:54.490227 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b8355eaf-b199-4b42-9ab9-46c29b64dd67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040483 Oct 15 03:43:54.490766 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 364/705] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:54 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:54.887887 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-049ca29a-eb2e-43b9-a299-2f72d5c991a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:54.888793 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-049ca29a-eb2e-43b9-a299-2f72d5c991a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:54.894485 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-049ca29a-eb2e-43b9-a299-2f72d5c991a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:54.894932 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-049ca29a-eb2e-43b9-a299-2f72d5c991a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:54.895700 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-049ca29a-eb2e-43b9-a299-2f72d5c991a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:54.896141 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-049ca29a-eb2e-43b9-a299-2f72d5c991a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:54.924402 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-049ca29a-eb2e-43b9-a299-2f72d5c991a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040346 Oct 15 03:43:54.924946 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 342/706] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:54 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:55.502090 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-67960f4f-f13a-4b81-9778-6f04ecdae77f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:55.502935 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-67960f4f-f13a-4b81-9778-6f04ecdae77f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:55.509302 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-67960f4f-f13a-4b81-9778-6f04ecdae77f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:55.509741 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-67960f4f-f13a-4b81-9778-6f04ecdae77f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:55.510486 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-67960f4f-f13a-4b81-9778-6f04ecdae77f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:55.510915 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-67960f4f-f13a-4b81-9778-6f04ecdae77f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:55.539351 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-67960f4f-f13a-4b81-9778-6f04ecdae77f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041065 Oct 15 03:43:55.539900 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 365/707] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:55 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:55.935560 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-53ed0a15-8b0c-408c-a3a5-3ef3a1128078 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:55.936492 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-53ed0a15-8b0c-408c-a3a5-3ef3a1128078 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:55.942115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-53ed0a15-8b0c-408c-a3a5-3ef3a1128078 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:55.942569 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-53ed0a15-8b0c-408c-a3a5-3ef3a1128078 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:55.943325 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-53ed0a15-8b0c-408c-a3a5-3ef3a1128078 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:55.943782 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-53ed0a15-8b0c-408c-a3a5-3ef3a1128078 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:55.971384 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-53ed0a15-8b0c-408c-a3a5-3ef3a1128078 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039616 Oct 15 03:43:55.971954 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 343/708] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:55 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:56.550432 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ebfe4fc5-2a53-443b-b3c9-193dc8e604dc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:56.551402 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ebfe4fc5-2a53-443b-b3c9-193dc8e604dc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:56.557127 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ebfe4fc5-2a53-443b-b3c9-193dc8e604dc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:56.557569 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ebfe4fc5-2a53-443b-b3c9-193dc8e604dc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:56.558322 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ebfe4fc5-2a53-443b-b3c9-193dc8e604dc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:56.558750 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ebfe4fc5-2a53-443b-b3c9-193dc8e604dc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:56.586581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ebfe4fc5-2a53-443b-b3c9-193dc8e604dc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039592 Oct 15 03:43:56.587722 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 366/709] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:56 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:56.983147 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0cf68bb0-3d0b-4e31-9b5d-4e691e084b91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:56.984080 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0cf68bb0-3d0b-4e31-9b5d-4e691e084b91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:56.989797 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0cf68bb0-3d0b-4e31-9b5d-4e691e084b91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:56.990243 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0cf68bb0-3d0b-4e31-9b5d-4e691e084b91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:56.991002 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0cf68bb0-3d0b-4e31-9b5d-4e691e084b91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:56.991436 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0cf68bb0-3d0b-4e31-9b5d-4e691e084b91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:57.018831 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0cf68bb0-3d0b-4e31-9b5d-4e691e084b91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039949 Oct 15 03:43:57.019371 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 344/710] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:56 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:57.598378 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0fe780aa-e4ae-4514-892b-9490d4af4cb2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:57.599277 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0fe780aa-e4ae-4514-892b-9490d4af4cb2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:57.604982 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0fe780aa-e4ae-4514-892b-9490d4af4cb2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:57.605431 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0fe780aa-e4ae-4514-892b-9490d4af4cb2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:57.606191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0fe780aa-e4ae-4514-892b-9490d4af4cb2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:57.606624 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0fe780aa-e4ae-4514-892b-9490d4af4cb2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:57.634411 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0fe780aa-e4ae-4514-892b-9490d4af4cb2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039780 Oct 15 03:43:57.635458 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 367/711] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:57 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:58.030018 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-37fc6c17-5edb-4200-907c-e70e87f32ee1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:58.030921 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-37fc6c17-5edb-4200-907c-e70e87f32ee1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:58.036641 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-37fc6c17-5edb-4200-907c-e70e87f32ee1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:58.037089 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-37fc6c17-5edb-4200-907c-e70e87f32ee1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:58.037853 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-37fc6c17-5edb-4200-907c-e70e87f32ee1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:58.038288 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-37fc6c17-5edb-4200-907c-e70e87f32ee1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:58.067205 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-37fc6c17-5edb-4200-907c-e70e87f32ee1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040924 Oct 15 03:43:58.067755 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 345/712] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:58 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:43:58.646171 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a8b0c51c-2946-43d3-984b-3fce7a3961c7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:58.646984 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a8b0c51c-2946-43d3-984b-3fce7a3961c7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:58.653620 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a8b0c51c-2946-43d3-984b-3fce7a3961c7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:58.654060 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a8b0c51c-2946-43d3-984b-3fce7a3961c7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:58.654808 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a8b0c51c-2946-43d3-984b-3fce7a3961c7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:58.655234 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a8b0c51c-2946-43d3-984b-3fce7a3961c7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:58.683596 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a8b0c51c-2946-43d3-984b-3fce7a3961c7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041245 Oct 15 03:43:58.684160 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 368/713] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:58 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:43:59.078859 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-17de68e7-e0a2-4de6-ade8-41e84feecee1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:59.079794 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-17de68e7-e0a2-4de6-ade8-41e84feecee1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:59.085496 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-17de68e7-e0a2-4de6-ade8-41e84feecee1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:59.086197 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-17de68e7-e0a2-4de6-ade8-41e84feecee1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:59.086947 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-17de68e7-e0a2-4de6-ade8-41e84feecee1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:59.087373 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-17de68e7-e0a2-4de6-ade8-41e84feecee1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:59.115399 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-17de68e7-e0a2-4de6-ade8-41e84feecee1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040428 Oct 15 03:43:59.115965 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 346/714] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:43:59 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:43:59.694336 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-243295b2-b214-4706-bc11-f186b08d0852 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:43:59.695157 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-243295b2-b214-4706-bc11-f186b08d0852 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:43:59.700932 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-243295b2-b214-4706-bc11-f186b08d0852 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:59.701377 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-243295b2-b214-4706-bc11-f186b08d0852 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:59.702136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-243295b2-b214-4706-bc11-f186b08d0852 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:43:59.702568 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-243295b2-b214-4706-bc11-f186b08d0852 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:43:59.730479 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-243295b2-b214-4706-bc11-f186b08d0852 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039949 Oct 15 03:43:59.731000 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 369/715] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:43:59 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:00.126114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-085322b2-1e01-4f33-89e5-bd7b6487f21c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:00.127023 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-085322b2-1e01-4f33-89e5-bd7b6487f21c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:00.133022 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-085322b2-1e01-4f33-89e5-bd7b6487f21c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:00.133473 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-085322b2-1e01-4f33-89e5-bd7b6487f21c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:00.134234 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-085322b2-1e01-4f33-89e5-bd7b6487f21c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:00.134668 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-085322b2-1e01-4f33-89e5-bd7b6487f21c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:00.162751 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-085322b2-1e01-4f33-89e5-bd7b6487f21c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040380 Oct 15 03:44:00.163298 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 347/716] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:00 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:00.741556 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2189e815-bafc-4fbe-931d-7577fa59c2a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:00.742476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2189e815-bafc-4fbe-931d-7577fa59c2a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:00.748660 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2189e815-bafc-4fbe-931d-7577fa59c2a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:00.749112 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2189e815-bafc-4fbe-931d-7577fa59c2a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:00.749870 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2189e815-bafc-4fbe-931d-7577fa59c2a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:00.750308 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2189e815-bafc-4fbe-931d-7577fa59c2a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:00.778413 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2189e815-bafc-4fbe-931d-7577fa59c2a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040792 Oct 15 03:44:00.778943 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 370/717] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:00 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:01.174209 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ea6e1a2e-361f-4f8e-8136-e4584d704890 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:01.175108 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ea6e1a2e-361f-4f8e-8136-e4584d704890 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:01.180882 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea6e1a2e-361f-4f8e-8136-e4584d704890 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:01.182001 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea6e1a2e-361f-4f8e-8136-e4584d704890 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:01.182768 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea6e1a2e-361f-4f8e-8136-e4584d704890 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:01.183203 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea6e1a2e-361f-4f8e-8136-e4584d704890 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:01.211524 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ea6e1a2e-361f-4f8e-8136-e4584d704890 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040763 Oct 15 03:44:01.212109 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 348/718] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:01 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:01.789211 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-39e5f4c3-275b-4846-8ba7-b32d71b169e9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:01.790112 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-39e5f4c3-275b-4846-8ba7-b32d71b169e9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:01.796434 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-39e5f4c3-275b-4846-8ba7-b32d71b169e9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:01.796872 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-39e5f4c3-275b-4846-8ba7-b32d71b169e9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:01.797616 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-39e5f4c3-275b-4846-8ba7-b32d71b169e9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:01.798041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-39e5f4c3-275b-4846-8ba7-b32d71b169e9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:01.827781 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-39e5f4c3-275b-4846-8ba7-b32d71b169e9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042246 Oct 15 03:44:01.828361 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 371/719] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:01 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:02.223079 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-225b4b28-ba1c-4763-b641-9308aa08c37a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:02.224002 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-225b4b28-ba1c-4763-b641-9308aa08c37a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:02.229785 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-225b4b28-ba1c-4763-b641-9308aa08c37a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:02.230239 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-225b4b28-ba1c-4763-b641-9308aa08c37a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:02.231028 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-225b4b28-ba1c-4763-b641-9308aa08c37a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:02.231462 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-225b4b28-ba1c-4763-b641-9308aa08c37a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:02.260546 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-225b4b28-ba1c-4763-b641-9308aa08c37a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040523 Oct 15 03:44:02.261096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 349/720] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:02 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:02.838838 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3b2e7b7e-fbe0-4632-96b2-b22846ba75ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:02.839758 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3b2e7b7e-fbe0-4632-96b2-b22846ba75ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:02.845515 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b2e7b7e-fbe0-4632-96b2-b22846ba75ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:02.845952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b2e7b7e-fbe0-4632-96b2-b22846ba75ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:02.846695 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b2e7b7e-fbe0-4632-96b2-b22846ba75ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:02.847118 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b2e7b7e-fbe0-4632-96b2-b22846ba75ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:02.874028 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3b2e7b7e-fbe0-4632-96b2-b22846ba75ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039801 Oct 15 03:44:02.874551 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 372/721] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:02 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:03.272134 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c00ee8a4-9dbe-4625-a464-2c550ad3d7cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:03.273029 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c00ee8a4-9dbe-4625-a464-2c550ad3d7cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:03.278751 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c00ee8a4-9dbe-4625-a464-2c550ad3d7cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:03.279197 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c00ee8a4-9dbe-4625-a464-2c550ad3d7cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:03.279968 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c00ee8a4-9dbe-4625-a464-2c550ad3d7cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:03.280403 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c00ee8a4-9dbe-4625-a464-2c550ad3d7cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:03.308585 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c00ee8a4-9dbe-4625-a464-2c550ad3d7cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040338 Oct 15 03:44:03.309119 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 350/722] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:03 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:03.803061 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d2444875-f847-405a-9078-1aa6ef2b1a7c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:03.803554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d2444875-f847-405a-9078-1aa6ef2b1a7c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:03.805924 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: ERROR oslo.messaging._drivers.impl_rabbit [-] [62b4e7dd-437c-4699-815c-b81f4b01b864] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 15 03:44:03.810239 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2444875-f847-405a-9078-1aa6ef2b1a7c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:03.810682 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2444875-f847-405a-9078-1aa6ef2b1a7c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:03.811439 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2444875-f847-405a-9078-1aa6ef2b1a7c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:03.811918 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2444875-f847-405a-9078-1aa6ef2b1a7c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:03.835482 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d2444875-f847-405a-9078-1aa6ef2b1a7c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Going to try to terminate instance {{(pid=120897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 15 03:44:03.885035 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-dc59b60e-0a6a-4a7d-8084-68061cb97c6b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:03.886202 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-dc59b60e-0a6a-4a7d-8084-68061cb97c6b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:03.893155 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dc59b60e-0a6a-4a7d-8084-68061cb97c6b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:03.893605 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dc59b60e-0a6a-4a7d-8084-68061cb97c6b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:03.895470 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dc59b60e-0a6a-4a7d-8084-68061cb97c6b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:03.895929 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dc59b60e-0a6a-4a7d-8084-68061cb97c6b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:03.912732 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d2444875-f847-405a-9078-1aa6ef2b1a7c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 204 len: 0 microversion: 2.1 time: 0.112893 Oct 15 03:44:03.913356 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 373/723] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 03:44:03 2021] DELETE /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 03:44:03.922127 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-acdd7a00-ea77-43c5-9d55-ce231e09b15d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:03.922840 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-acdd7a00-ea77-43c5-9d55-ce231e09b15d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:03.928458 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-acdd7a00-ea77-43c5-9d55-ce231e09b15d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:03.928912 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-acdd7a00-ea77-43c5-9d55-ce231e09b15d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:03.929682 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-acdd7a00-ea77-43c5-9d55-ce231e09b15d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:03.930116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-acdd7a00-ea77-43c5-9d55-ce231e09b15d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:03.933442 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-dc59b60e-0a6a-4a7d-8084-68061cb97c6b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052286 Oct 15 03:44:03.934005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 351/724] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:03 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:44:04.096370 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-acdd7a00-ea77-43c5-9d55-ce231e09b15d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:04.103475 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-acdd7a00-ea77-43c5-9d55-ce231e09b15d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1577 microversion: 2.1 time: 0.185177 Oct 15 03:44:04.104062 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 374/725] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:03 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:04.319988 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2a3d4a68-181b-4ebc-be01-95c6894a2345 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:04.320824 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2a3d4a68-181b-4ebc-be01-95c6894a2345 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:04.326915 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2a3d4a68-181b-4ebc-be01-95c6894a2345 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:04.327393 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2a3d4a68-181b-4ebc-be01-95c6894a2345 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:04.328191 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2a3d4a68-181b-4ebc-be01-95c6894a2345 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:04.328625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2a3d4a68-181b-4ebc-be01-95c6894a2345 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:04.358752 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2a3d4a68-181b-4ebc-be01-95c6894a2345 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042702 Oct 15 03:44:04.359308 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 352/726] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:04 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:04.820323 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ba18b04a-f920-44c3-b8fe-d0b1e6e59345 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:44:04.820858 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ba18b04a-f920-44c3-b8fe-d0b1e6e59345 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:04.838277 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ba18b04a-f920-44c3-b8fe-d0b1e6e59345 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:04.838277 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ba18b04a-f920-44c3-b8fe-d0b1e6e59345 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:04.838898 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ba18b04a-f920-44c3-b8fe-d0b1e6e59345 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:04.839339 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ba18b04a-f920-44c3-b8fe-d0b1e6e59345 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:04.844942 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] [62b4e7dd-437c-4699-815c-b81f4b01b864] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 57450. Oct 15 03:44:04.864608 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.objects.instance [None req-ba18b04a-f920-44c3-b8fe-d0b1e6e59345 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lazy-loading 'flavor' on Instance uuid 37285523-63b9-4079-939b-b156366439e6 {{(pid=120897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 03:44:04.928958 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ba18b04a-f920-44c3-b8fe-d0b1e6e59345 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "POST /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6/action" status: 202 len: 0 microversion: 2.1 time: 0.112346 Oct 15 03:44:04.929584 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 375/727] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 03:44:04 2021] POST /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:44:04.938046 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3838642a-011d-4e1e-b5de-9218915fcf3d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:04.938767 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3838642a-011d-4e1e-b5de-9218915fcf3d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:04.943892 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cd9346dd-ebe8-40e7-9188-206e278df3b4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:04.944762 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3838642a-011d-4e1e-b5de-9218915fcf3d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:04.944954 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cd9346dd-ebe8-40e7-9188-206e278df3b4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:04.945201 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3838642a-011d-4e1e-b5de-9218915fcf3d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:04.945962 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3838642a-011d-4e1e-b5de-9218915fcf3d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:04.946410 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3838642a-011d-4e1e-b5de-9218915fcf3d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:04.951217 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd9346dd-ebe8-40e7-9188-206e278df3b4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:04.951663 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd9346dd-ebe8-40e7-9188-206e278df3b4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:04.952462 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd9346dd-ebe8-40e7-9188-206e278df3b4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:04.952896 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd9346dd-ebe8-40e7-9188-206e278df3b4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:04.982693 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cd9346dd-ebe8-40e7-9188-206e278df3b4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042703 Oct 15 03:44:04.983250 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 376/728] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:04 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:05.118703 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3838642a-011d-4e1e-b5de-9218915fcf3d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:05.121121 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f787690d-ddf1-4d27-8f73-e160d16c34a4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:05.121761 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f787690d-ddf1-4d27-8f73-e160d16c34a4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:05.126551 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3838642a-011d-4e1e-b5de-9218915fcf3d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.192243 Oct 15 03:44:05.127109 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 353/729] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:04 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:05.127724 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f787690d-ddf1-4d27-8f73-e160d16c34a4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:05.128245 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f787690d-ddf1-4d27-8f73-e160d16c34a4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:05.129018 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f787690d-ddf1-4d27-8f73-e160d16c34a4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:05.129459 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f787690d-ddf1-4d27-8f73-e160d16c34a4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:05.251833 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f787690d-ddf1-4d27-8f73-e160d16c34a4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:05.259005 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f787690d-ddf1-4d27-8f73-e160d16c34a4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1577 microversion: 2.1 time: 0.142130 Oct 15 03:44:05.259587 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 377/730] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:05 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1577 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:44:05.370284 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5225c888-fde5-4c9d-9370-665bce18a3ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:05.371114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5225c888-fde5-4c9d-9370-665bce18a3ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:05.376875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5225c888-fde5-4c9d-9370-665bce18a3ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:05.377326 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5225c888-fde5-4c9d-9370-665bce18a3ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:05.378083 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5225c888-fde5-4c9d-9370-665bce18a3ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:05.378513 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5225c888-fde5-4c9d-9370-665bce18a3ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:05.407029 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5225c888-fde5-4c9d-9370-665bce18a3ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040648 Oct 15 03:44:05.407572 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 354/731] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:05 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:05.994829 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-810cc83e-f47c-4af3-b3ca-9498ee4cd128 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:05.995790 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-810cc83e-f47c-4af3-b3ca-9498ee4cd128 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:06.001492 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-810cc83e-f47c-4af3-b3ca-9498ee4cd128 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:06.001942 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-810cc83e-f47c-4af3-b3ca-9498ee4cd128 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:06.002700 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-810cc83e-f47c-4af3-b3ca-9498ee4cd128 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:06.003134 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-810cc83e-f47c-4af3-b3ca-9498ee4cd128 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:06.032345 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-810cc83e-f47c-4af3-b3ca-9498ee4cd128 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041765 Oct 15 03:44:06.032895 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 378/732] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:05 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:44:06.143893 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d24f2ba9-bdf4-4058-98b6-5b8973c75fa5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:06.144497 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d24f2ba9-bdf4-4058-98b6-5b8973c75fa5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:06.150299 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d24f2ba9-bdf4-4058-98b6-5b8973c75fa5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:06.150709 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d24f2ba9-bdf4-4058-98b6-5b8973c75fa5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:06.151459 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d24f2ba9-bdf4-4058-98b6-5b8973c75fa5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:06.151921 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d24f2ba9-bdf4-4058-98b6-5b8973c75fa5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:06.278030 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e8aefc95-bc7e-4263-a066-91f1b9cf5f97 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:06.278666 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e8aefc95-bc7e-4263-a066-91f1b9cf5f97 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:06.285248 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e8aefc95-bc7e-4263-a066-91f1b9cf5f97 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:06.285823 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e8aefc95-bc7e-4263-a066-91f1b9cf5f97 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:06.286769 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e8aefc95-bc7e-4263-a066-91f1b9cf5f97 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:06.287206 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e8aefc95-bc7e-4263-a066-91f1b9cf5f97 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:06.347911 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d24f2ba9-bdf4-4058-98b6-5b8973c75fa5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:06.355584 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d24f2ba9-bdf4-4058-98b6-5b8973c75fa5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.215410 Oct 15 03:44:06.361485 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 355/733] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:06 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:06.368099 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e8aefc95-bc7e-4263-a066-91f1b9cf5f97 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:06.376065 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e8aefc95-bc7e-4263-a066-91f1b9cf5f97 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1510 microversion: 2.1 time: 0.103445 Oct 15 03:44:06.376941 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 379/734] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:06 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1510 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:06.419465 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e6ab1e30-e8cd-49a7-994d-0ce762b0e398 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:06.421012 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e6ab1e30-e8cd-49a7-994d-0ce762b0e398 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:06.426918 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e6ab1e30-e8cd-49a7-994d-0ce762b0e398 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:06.427363 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e6ab1e30-e8cd-49a7-994d-0ce762b0e398 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:06.428502 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e6ab1e30-e8cd-49a7-994d-0ce762b0e398 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:06.428932 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e6ab1e30-e8cd-49a7-994d-0ce762b0e398 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:06.464281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e6ab1e30-e8cd-49a7-994d-0ce762b0e398 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049003 Oct 15 03:44:06.468898 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 356/735] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:06 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:44:06.532786 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-fc3c1db5-7b9e-42e7-b40c-97915ca48ea8 req-6f67a644-4cae-4bbf-a8d9-f43091dcbb3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e429526-26c8-4d98-8691-73770db59513", "name": "network-vif-deleted", "tag": "b203b749-dead-423e-8bfb-4c494e6c63ab"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:44:06.534309 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:44:06.534309 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:44:06.541982 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-fc3c1db5-7b9e-42e7-b40c-97915ca48ea8 req-6f67a644-4cae-4bbf-a8d9-f43091dcbb3f service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:06.542427 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-fc3c1db5-7b9e-42e7-b40c-97915ca48ea8 req-6f67a644-4cae-4bbf-a8d9-f43091dcbb3f service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:06.553212 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-fc3c1db5-7b9e-42e7-b40c-97915ca48ea8 req-6f67a644-4cae-4bbf-a8d9-f43091dcbb3f service nova] Creating event network-vif-deleted:b203b749-dead-423e-8bfb-4c494e6c63ab for instance 6e429526-26c8-4d98-8691-73770db59513 on hv-cinder-81410 Oct 15 03:44:06.559337 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-fc3c1db5-7b9e-42e7-b40c-97915ca48ea8 req-6f67a644-4cae-4bbf-a8d9-f43091dcbb3f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095912 Oct 15 03:44:06.560726 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 380/736] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:44:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:44:07.045614 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e3bab6e9-002c-4670-a5f7-b54757f4ddb3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:07.047520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e3bab6e9-002c-4670-a5f7-b54757f4ddb3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:07.054434 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e3bab6e9-002c-4670-a5f7-b54757f4ddb3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:07.055131 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e3bab6e9-002c-4670-a5f7-b54757f4ddb3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:07.056219 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e3bab6e9-002c-4670-a5f7-b54757f4ddb3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:07.056655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e3bab6e9-002c-4670-a5f7-b54757f4ddb3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:07.086295 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e3bab6e9-002c-4670-a5f7-b54757f4ddb3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046018 Oct 15 03:44:07.086861 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 357/737] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:07 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:07.373509 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-50382e8e-fa20-4239-a0d2-10ecff6a6d94 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:07.374190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-50382e8e-fa20-4239-a0d2-10ecff6a6d94 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:07.380122 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50382e8e-fa20-4239-a0d2-10ecff6a6d94 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:07.380642 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50382e8e-fa20-4239-a0d2-10ecff6a6d94 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:07.381433 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50382e8e-fa20-4239-a0d2-10ecff6a6d94 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:07.381906 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50382e8e-fa20-4239-a0d2-10ecff6a6d94 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:07.393323 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d80cbbd8-057b-4399-a133-b6f2bfcedfc3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:07.394490 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d80cbbd8-057b-4399-a133-b6f2bfcedfc3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:07.401744 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d80cbbd8-057b-4399-a133-b6f2bfcedfc3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:07.402545 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d80cbbd8-057b-4399-a133-b6f2bfcedfc3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:07.403617 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d80cbbd8-057b-4399-a133-b6f2bfcedfc3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:07.404359 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d80cbbd8-057b-4399-a133-b6f2bfcedfc3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:07.490611 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d80cbbd8-057b-4399-a133-b6f2bfcedfc3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:07.500008 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d80cbbd8-057b-4399-a133-b6f2bfcedfc3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.110592 Oct 15 03:44:07.500780 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 358/738] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:07 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:07.514399 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ae374dd0-e208-4b62-b4dd-aa74f887a5fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:07.515400 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ae374dd0-e208-4b62-b4dd-aa74f887a5fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:07.521439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae374dd0-e208-4b62-b4dd-aa74f887a5fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:07.521889 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae374dd0-e208-4b62-b4dd-aa74f887a5fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:07.522655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae374dd0-e208-4b62-b4dd-aa74f887a5fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:07.523086 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae374dd0-e208-4b62-b4dd-aa74f887a5fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:07.551749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ae374dd0-e208-4b62-b4dd-aa74f887a5fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040805 Oct 15 03:44:07.552227 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 359/739] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:07 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:07.557264 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-50382e8e-fa20-4239-a0d2-10ecff6a6d94 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:07.564692 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-50382e8e-fa20-4239-a0d2-10ecff6a6d94 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.195149 Oct 15 03:44:07.565237 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 381/740] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:07 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:08.098060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c48712d4-4696-4dfa-a0ac-2e1be41f4516 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:08.098926 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c48712d4-4696-4dfa-a0ac-2e1be41f4516 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:08.105236 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c48712d4-4696-4dfa-a0ac-2e1be41f4516 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:08.105685 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c48712d4-4696-4dfa-a0ac-2e1be41f4516 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:08.106447 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c48712d4-4696-4dfa-a0ac-2e1be41f4516 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:08.106878 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c48712d4-4696-4dfa-a0ac-2e1be41f4516 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:08.135285 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c48712d4-4696-4dfa-a0ac-2e1be41f4516 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041067 Oct 15 03:44:08.135864 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 360/741] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:08 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:08.516840 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-607585f2-7a10-4545-99ef-f2e6199facb3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:08.517383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-607585f2-7a10-4545-99ef-f2e6199facb3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:08.523490 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-607585f2-7a10-4545-99ef-f2e6199facb3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:08.523958 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-607585f2-7a10-4545-99ef-f2e6199facb3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:08.524709 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-607585f2-7a10-4545-99ef-f2e6199facb3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:08.525643 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-607585f2-7a10-4545-99ef-f2e6199facb3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:08.562838 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-76897c38-ff35-4467-9316-5c6832b053ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:08.563781 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-76897c38-ff35-4467-9316-5c6832b053ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:08.569481 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-76897c38-ff35-4467-9316-5c6832b053ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:08.569931 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-76897c38-ff35-4467-9316-5c6832b053ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:08.570700 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-76897c38-ff35-4467-9316-5c6832b053ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:08.571136 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-76897c38-ff35-4467-9316-5c6832b053ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:08.588818 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-607585f2-7a10-4545-99ef-f2e6199facb3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:08.595996 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-607585f2-7a10-4545-99ef-f2e6199facb3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.083135 Oct 15 03:44:08.596566 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 382/742] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:08 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:08.601008 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f23a513c-9fc9-4f84-91db-e7a9cbfb876e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:08.601607 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f23a513c-9fc9-4f84-91db-e7a9cbfb876e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:08.607045 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f23a513c-9fc9-4f84-91db-e7a9cbfb876e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:08.607496 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f23a513c-9fc9-4f84-91db-e7a9cbfb876e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:08.608295 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f23a513c-9fc9-4f84-91db-e7a9cbfb876e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:08.608418 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-76897c38-ff35-4467-9316-5c6832b053ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049286 Oct 15 03:44:08.608736 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f23a513c-9fc9-4f84-91db-e7a9cbfb876e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:08.608968 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 361/743] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:08 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:44:08.725203 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f23a513c-9fc9-4f84-91db-e7a9cbfb876e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:08.732388 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f23a513c-9fc9-4f84-91db-e7a9cbfb876e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.134896 Oct 15 03:44:08.732948 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 383/744] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:08 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:09.146325 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b40da160-2f01-48ef-913f-27dc1b4f5e36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:09.147233 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b40da160-2f01-48ef-913f-27dc1b4f5e36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:09.153046 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b40da160-2f01-48ef-913f-27dc1b4f5e36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:09.153497 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b40da160-2f01-48ef-913f-27dc1b4f5e36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:09.154255 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b40da160-2f01-48ef-913f-27dc1b4f5e36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:09.154687 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b40da160-2f01-48ef-913f-27dc1b4f5e36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:09.182587 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b40da160-2f01-48ef-913f-27dc1b4f5e36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040055 Oct 15 03:44:09.183124 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 362/745] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:09 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:09.613035 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-397263a9-22ea-4a24-8542-bb567e9c3716 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:09.613636 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-397263a9-22ea-4a24-8542-bb567e9c3716 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:09.619387 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a4601cf5-48ba-469b-aefc-f7c991ca08d1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:09.620008 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-397263a9-22ea-4a24-8542-bb567e9c3716 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:09.620343 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a4601cf5-48ba-469b-aefc-f7c991ca08d1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:09.620468 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-397263a9-22ea-4a24-8542-bb567e9c3716 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:09.621201 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-397263a9-22ea-4a24-8542-bb567e9c3716 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:09.621636 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-397263a9-22ea-4a24-8542-bb567e9c3716 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:09.626076 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4601cf5-48ba-469b-aefc-f7c991ca08d1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:09.626521 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4601cf5-48ba-469b-aefc-f7c991ca08d1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:09.627284 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4601cf5-48ba-469b-aefc-f7c991ca08d1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:09.627737 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4601cf5-48ba-469b-aefc-f7c991ca08d1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:09.655796 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a4601cf5-48ba-469b-aefc-f7c991ca08d1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040704 Oct 15 03:44:09.656349 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 363/746] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:09 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:44:09.679496 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-397263a9-22ea-4a24-8542-bb567e9c3716 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:09.687479 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-397263a9-22ea-4a24-8542-bb567e9c3716 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.078129 Oct 15 03:44:09.688076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 384/747] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:09 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:09.748985 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-66359c12-f5db-420e-9dc1-648882a6f174 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:09.749581 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-66359c12-f5db-420e-9dc1-648882a6f174 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:09.755314 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-66359c12-f5db-420e-9dc1-648882a6f174 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:09.755793 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-66359c12-f5db-420e-9dc1-648882a6f174 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:09.756544 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-66359c12-f5db-420e-9dc1-648882a6f174 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:09.756969 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-66359c12-f5db-420e-9dc1-648882a6f174 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:09.873226 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-66359c12-f5db-420e-9dc1-648882a6f174 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:09.880409 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-66359c12-f5db-420e-9dc1-648882a6f174 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.134958 Oct 15 03:44:09.880938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 364/748] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:09 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:10.193640 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9bf7c702-abc7-4c14-a94c-cfb0339ebdb6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:10.194570 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9bf7c702-abc7-4c14-a94c-cfb0339ebdb6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:10.200889 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9bf7c702-abc7-4c14-a94c-cfb0339ebdb6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:10.201338 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9bf7c702-abc7-4c14-a94c-cfb0339ebdb6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:10.202090 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9bf7c702-abc7-4c14-a94c-cfb0339ebdb6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:10.202521 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9bf7c702-abc7-4c14-a94c-cfb0339ebdb6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:10.232199 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9bf7c702-abc7-4c14-a94c-cfb0339ebdb6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042338 Oct 15 03:44:10.232740 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 385/749] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:10 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:10.666273 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-afeba1a1-c628-4d9a-8922-27f37ac9b9b3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:10.667218 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-afeba1a1-c628-4d9a-8922-27f37ac9b9b3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:10.672881 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-afeba1a1-c628-4d9a-8922-27f37ac9b9b3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:10.673331 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-afeba1a1-c628-4d9a-8922-27f37ac9b9b3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:10.674084 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-afeba1a1-c628-4d9a-8922-27f37ac9b9b3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:10.674520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-afeba1a1-c628-4d9a-8922-27f37ac9b9b3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:10.703519 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-afeba1a1-c628-4d9a-8922-27f37ac9b9b3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041022 Oct 15 03:44:10.704190 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 365/750] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:10 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:10.704432 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4393f5cc-7d33-4bd6-a524-ab95f570b7ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:10.705117 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4393f5cc-7d33-4bd6-a524-ab95f570b7ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:10.711047 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4393f5cc-7d33-4bd6-a524-ab95f570b7ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:10.711501 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4393f5cc-7d33-4bd6-a524-ab95f570b7ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:10.712335 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4393f5cc-7d33-4bd6-a524-ab95f570b7ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:10.712772 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4393f5cc-7d33-4bd6-a524-ab95f570b7ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:10.773316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4393f5cc-7d33-4bd6-a524-ab95f570b7ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:10.780380 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4393f5cc-7d33-4bd6-a524-ab95f570b7ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.080057 Oct 15 03:44:10.780921 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 386/751] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:10 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:44:10.897128 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b3c92ba8-c12d-4a9e-b155-cd65751b3c5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:10.897748 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b3c92ba8-c12d-4a9e-b155-cd65751b3c5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:10.903439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b3c92ba8-c12d-4a9e-b155-cd65751b3c5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:10.903929 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b3c92ba8-c12d-4a9e-b155-cd65751b3c5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:10.904691 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b3c92ba8-c12d-4a9e-b155-cd65751b3c5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:10.905123 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b3c92ba8-c12d-4a9e-b155-cd65751b3c5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:11.021527 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b3c92ba8-c12d-4a9e-b155-cd65751b3c5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:11.028645 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b3c92ba8-c12d-4a9e-b155-cd65751b3c5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.135149 Oct 15 03:44:11.029204 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 366/752] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:10 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:11.243652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f6b33ea1-b18d-4f31-9ad0-acdf9161a36d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:11.244594 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f6b33ea1-b18d-4f31-9ad0-acdf9161a36d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:11.250425 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6b33ea1-b18d-4f31-9ad0-acdf9161a36d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:11.250872 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6b33ea1-b18d-4f31-9ad0-acdf9161a36d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:11.251626 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6b33ea1-b18d-4f31-9ad0-acdf9161a36d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:11.252082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6b33ea1-b18d-4f31-9ad0-acdf9161a36d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:11.279749 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f6b33ea1-b18d-4f31-9ad0-acdf9161a36d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039927 Oct 15 03:44:11.280280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 387/753] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:11 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:11.715208 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ac52519b-7438-4ed3-9a11-deeba07b7521 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:11.716070 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ac52519b-7438-4ed3-9a11-deeba07b7521 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:11.721903 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ac52519b-7438-4ed3-9a11-deeba07b7521 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:11.722358 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ac52519b-7438-4ed3-9a11-deeba07b7521 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:11.723121 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ac52519b-7438-4ed3-9a11-deeba07b7521 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:11.723553 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ac52519b-7438-4ed3-9a11-deeba07b7521 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:11.756319 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ac52519b-7438-4ed3-9a11-deeba07b7521 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045156 Oct 15 03:44:11.756875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 367/754] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:11 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:11.797035 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c61786d2-4c12-4657-88d7-6bbd4c0df2f5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:11.797631 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c61786d2-4c12-4657-88d7-6bbd4c0df2f5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:11.803348 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c61786d2-4c12-4657-88d7-6bbd4c0df2f5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:11.803829 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c61786d2-4c12-4657-88d7-6bbd4c0df2f5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:11.804582 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c61786d2-4c12-4657-88d7-6bbd4c0df2f5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:11.805016 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c61786d2-4c12-4657-88d7-6bbd4c0df2f5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:11.863478 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c61786d2-4c12-4657-88d7-6bbd4c0df2f5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:11.871312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c61786d2-4c12-4657-88d7-6bbd4c0df2f5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077901 Oct 15 03:44:11.871894 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 388/755] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:11 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:12.045900 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4f07e92f-f31c-4ef6-b773-8ef2dd6818ce tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:12.046800 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4f07e92f-f31c-4ef6-b773-8ef2dd6818ce tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:12.052561 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4f07e92f-f31c-4ef6-b773-8ef2dd6818ce tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:12.053012 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4f07e92f-f31c-4ef6-b773-8ef2dd6818ce tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:12.053770 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4f07e92f-f31c-4ef6-b773-8ef2dd6818ce tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:12.054206 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4f07e92f-f31c-4ef6-b773-8ef2dd6818ce tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:12.172020 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4f07e92f-f31c-4ef6-b773-8ef2dd6818ce tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:12.179172 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4f07e92f-f31c-4ef6-b773-8ef2dd6818ce tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.136870 Oct 15 03:44:12.179751 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 368/756] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:12 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:12.290115 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0c271a46-e49f-4cac-bb67-f201ff3be5be tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:12.291606 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0c271a46-e49f-4cac-bb67-f201ff3be5be tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:12.297369 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0c271a46-e49f-4cac-bb67-f201ff3be5be tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:12.297757 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0c271a46-e49f-4cac-bb67-f201ff3be5be tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:12.298516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0c271a46-e49f-4cac-bb67-f201ff3be5be tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:12.298947 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0c271a46-e49f-4cac-bb67-f201ff3be5be tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:12.326740 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0c271a46-e49f-4cac-bb67-f201ff3be5be tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040374 Oct 15 03:44:12.327265 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 389/757] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:12 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:12.767736 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4791f89b-e189-4478-a58c-3ceaa78368c1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:12.768634 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4791f89b-e189-4478-a58c-3ceaa78368c1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:12.774325 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4791f89b-e189-4478-a58c-3ceaa78368c1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:12.774769 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4791f89b-e189-4478-a58c-3ceaa78368c1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:12.775520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4791f89b-e189-4478-a58c-3ceaa78368c1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:12.775971 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4791f89b-e189-4478-a58c-3ceaa78368c1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:12.804031 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4791f89b-e189-4478-a58c-3ceaa78368c1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040011 Oct 15 03:44:12.804570 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 369/758] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:12 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:12.887731 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b2c9dea7-94d0-4f5b-9843-0091d16797cf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:12.888378 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b2c9dea7-94d0-4f5b-9843-0091d16797cf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:12.894062 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b2c9dea7-94d0-4f5b-9843-0091d16797cf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:12.894506 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b2c9dea7-94d0-4f5b-9843-0091d16797cf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:12.895289 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b2c9dea7-94d0-4f5b-9843-0091d16797cf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:12.895742 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b2c9dea7-94d0-4f5b-9843-0091d16797cf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:12.953064 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b2c9dea7-94d0-4f5b-9843-0091d16797cf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:12.960169 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b2c9dea7-94d0-4f5b-9843-0091d16797cf tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.076699 Oct 15 03:44:12.960972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 390/759] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:12 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:13.195863 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d3629769-75ca-439d-b687-223b704f609a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:13.196386 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d3629769-75ca-439d-b687-223b704f609a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:13.202093 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3629769-75ca-439d-b687-223b704f609a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:13.202534 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3629769-75ca-439d-b687-223b704f609a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:13.203276 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3629769-75ca-439d-b687-223b704f609a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:13.203725 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3629769-75ca-439d-b687-223b704f609a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:13.318114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d3629769-75ca-439d-b687-223b704f609a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:13.325250 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d3629769-75ca-439d-b687-223b704f609a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.133120 Oct 15 03:44:13.325793 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 370/760] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:13 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:13.337895 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-661577f2-51c2-4acf-974f-c061a6752129 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:13.338793 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-661577f2-51c2-4acf-974f-c061a6752129 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:13.344480 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-661577f2-51c2-4acf-974f-c061a6752129 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:13.344919 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-661577f2-51c2-4acf-974f-c061a6752129 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:13.345661 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-661577f2-51c2-4acf-974f-c061a6752129 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:13.346086 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-661577f2-51c2-4acf-974f-c061a6752129 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:13.374988 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-661577f2-51c2-4acf-974f-c061a6752129 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041006 Oct 15 03:44:13.375507 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 391/761] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:13 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:13.815917 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-51609faf-79c6-45b3-9c3f-3eeeb0a4b8b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:13.816828 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-51609faf-79c6-45b3-9c3f-3eeeb0a4b8b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:13.823646 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51609faf-79c6-45b3-9c3f-3eeeb0a4b8b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:13.824146 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51609faf-79c6-45b3-9c3f-3eeeb0a4b8b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:13.825064 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51609faf-79c6-45b3-9c3f-3eeeb0a4b8b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:13.825498 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51609faf-79c6-45b3-9c3f-3eeeb0a4b8b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:13.855093 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-51609faf-79c6-45b3-9c3f-3eeeb0a4b8b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042991 Oct 15 03:44:13.855644 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 371/762] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:13 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:13.976544 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-02ab3909-3e6d-4649-ab1b-b07e22c85d7e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:13.977141 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-02ab3909-3e6d-4649-ab1b-b07e22c85d7e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:13.982919 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-02ab3909-3e6d-4649-ab1b-b07e22c85d7e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:13.983370 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-02ab3909-3e6d-4649-ab1b-b07e22c85d7e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:13.984137 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-02ab3909-3e6d-4649-ab1b-b07e22c85d7e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:13.984563 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-02ab3909-3e6d-4649-ab1b-b07e22c85d7e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:14.041235 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-02ab3909-3e6d-4649-ab1b-b07e22c85d7e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:14.048220 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-02ab3909-3e6d-4649-ab1b-b07e22c85d7e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.075300 Oct 15 03:44:14.048758 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 392/763] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:13 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:14.342210 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6a67154d-a32d-4256-842c-6c69b5ea8497 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:14.342968 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6a67154d-a32d-4256-842c-6c69b5ea8497 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:14.348890 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6a67154d-a32d-4256-842c-6c69b5ea8497 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:14.349327 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6a67154d-a32d-4256-842c-6c69b5ea8497 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:14.350074 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6a67154d-a32d-4256-842c-6c69b5ea8497 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:14.350498 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6a67154d-a32d-4256-842c-6c69b5ea8497 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:14.386791 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c2ec8346-abda-465a-aca8-93a7900e8f87 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:14.387621 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c2ec8346-abda-465a-aca8-93a7900e8f87 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:14.393584 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c2ec8346-abda-465a-aca8-93a7900e8f87 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:14.394027 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c2ec8346-abda-465a-aca8-93a7900e8f87 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:14.394864 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c2ec8346-abda-465a-aca8-93a7900e8f87 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:14.395292 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c2ec8346-abda-465a-aca8-93a7900e8f87 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:14.423179 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c2ec8346-abda-465a-aca8-93a7900e8f87 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040932 Oct 15 03:44:14.423754 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 393/764] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:14 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:44:14.469997 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6a67154d-a32d-4256-842c-6c69b5ea8497 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:14.477383 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6a67154d-a32d-4256-842c-6c69b5ea8497 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.139223 Oct 15 03:44:14.477975 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 372/765] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:14 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:14.866540 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-49545766-706c-4565-a151-5bfb31bfad94 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:14.867442 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-49545766-706c-4565-a151-5bfb31bfad94 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:14.876723 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-49545766-706c-4565-a151-5bfb31bfad94 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:14.877161 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-49545766-706c-4565-a151-5bfb31bfad94 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:14.877922 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-49545766-706c-4565-a151-5bfb31bfad94 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:14.878350 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-49545766-706c-4565-a151-5bfb31bfad94 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:14.907097 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-49545766-706c-4565-a151-5bfb31bfad94 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044332 Oct 15 03:44:14.907637 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 394/766] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:14 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:15.064623 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-aa02a243-81dc-4323-a576-86199f03e436 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:15.065231 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-aa02a243-81dc-4323-a576-86199f03e436 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:15.070971 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aa02a243-81dc-4323-a576-86199f03e436 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:15.071418 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aa02a243-81dc-4323-a576-86199f03e436 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:15.072214 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aa02a243-81dc-4323-a576-86199f03e436 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:15.072653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aa02a243-81dc-4323-a576-86199f03e436 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:15.134377 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-aa02a243-81dc-4323-a576-86199f03e436 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:15.141724 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-aa02a243-81dc-4323-a576-86199f03e436 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.080709 Oct 15 03:44:15.142301 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 373/767] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:15 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:15.434367 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-633b5c35-0d6b-46fc-bdd2-cda981ba058a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:15.435275 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-633b5c35-0d6b-46fc-bdd2-cda981ba058a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:15.440914 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-633b5c35-0d6b-46fc-bdd2-cda981ba058a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:15.441362 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-633b5c35-0d6b-46fc-bdd2-cda981ba058a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:15.442117 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-633b5c35-0d6b-46fc-bdd2-cda981ba058a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:15.442545 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-633b5c35-0d6b-46fc-bdd2-cda981ba058a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:15.471749 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-633b5c35-0d6b-46fc-bdd2-cda981ba058a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041188 Oct 15 03:44:15.472298 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 395/768] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:15 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:15.494080 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9adae960-ce28-401d-a4d2-6e2b0fb7f83b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:15.494688 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9adae960-ce28-401d-a4d2-6e2b0fb7f83b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:15.500296 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9adae960-ce28-401d-a4d2-6e2b0fb7f83b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:15.500745 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9adae960-ce28-401d-a4d2-6e2b0fb7f83b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:15.501519 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9adae960-ce28-401d-a4d2-6e2b0fb7f83b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:15.501951 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9adae960-ce28-401d-a4d2-6e2b0fb7f83b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:15.672949 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-9adae960-ce28-401d-a4d2-6e2b0fb7f83b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:15.680086 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9adae960-ce28-401d-a4d2-6e2b0fb7f83b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.189663 Oct 15 03:44:15.680671 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 374/769] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:15 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:15.918541 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4625af0d-79de-436a-aa38-e1c34329fc76 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:15.919476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4625af0d-79de-436a-aa38-e1c34329fc76 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:15.925242 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4625af0d-79de-436a-aa38-e1c34329fc76 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:15.925631 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4625af0d-79de-436a-aa38-e1c34329fc76 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:15.926389 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4625af0d-79de-436a-aa38-e1c34329fc76 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:15.926826 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4625af0d-79de-436a-aa38-e1c34329fc76 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:15.956687 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4625af0d-79de-436a-aa38-e1c34329fc76 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042045 Oct 15 03:44:15.957228 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 396/770] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:15 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:16.158252 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ec536577-2cef-474f-8d1a-3e71af801099 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:16.158904 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ec536577-2cef-474f-8d1a-3e71af801099 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:16.164637 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ec536577-2cef-474f-8d1a-3e71af801099 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:16.165081 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ec536577-2cef-474f-8d1a-3e71af801099 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:16.166339 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ec536577-2cef-474f-8d1a-3e71af801099 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:16.166781 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ec536577-2cef-474f-8d1a-3e71af801099 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:16.226489 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ec536577-2cef-474f-8d1a-3e71af801099 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:16.234192 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ec536577-2cef-474f-8d1a-3e71af801099 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.079657 Oct 15 03:44:16.234754 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 375/771] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:16 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:16.483523 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d96019cf-5cb3-4d4a-b2db-36d81252c900 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:16.484374 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d96019cf-5cb3-4d4a-b2db-36d81252c900 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:16.490358 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d96019cf-5cb3-4d4a-b2db-36d81252c900 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:16.490802 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d96019cf-5cb3-4d4a-b2db-36d81252c900 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:16.491649 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d96019cf-5cb3-4d4a-b2db-36d81252c900 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:16.492138 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d96019cf-5cb3-4d4a-b2db-36d81252c900 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:16.521025 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d96019cf-5cb3-4d4a-b2db-36d81252c900 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041305 Oct 15 03:44:16.521556 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 397/772] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:16 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:16.697062 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-64a4839b-c123-469a-9ce4-21a9fbc60b16 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:16.697664 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-64a4839b-c123-469a-9ce4-21a9fbc60b16 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:16.703446 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-64a4839b-c123-469a-9ce4-21a9fbc60b16 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:16.703936 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-64a4839b-c123-469a-9ce4-21a9fbc60b16 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:16.704695 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-64a4839b-c123-469a-9ce4-21a9fbc60b16 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:16.705127 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-64a4839b-c123-469a-9ce4-21a9fbc60b16 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:16.821077 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-64a4839b-c123-469a-9ce4-21a9fbc60b16 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:16.828765 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-64a4839b-c123-469a-9ce4-21a9fbc60b16 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.135419 Oct 15 03:44:16.829313 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 376/773] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:16 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:16.970939 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5919c0f7-5425-4775-8a2b-9d8a7faeee2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:16.971927 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5919c0f7-5425-4775-8a2b-9d8a7faeee2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:16.979235 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5919c0f7-5425-4775-8a2b-9d8a7faeee2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:16.979672 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5919c0f7-5425-4775-8a2b-9d8a7faeee2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:16.980450 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5919c0f7-5425-4775-8a2b-9d8a7faeee2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:16.980874 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5919c0f7-5425-4775-8a2b-9d8a7faeee2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:17.009634 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5919c0f7-5425-4775-8a2b-9d8a7faeee2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044262 Oct 15 03:44:17.010468 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 398/774] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:16 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:17.250123 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-987c74bc-7953-4dab-9bca-69691fbb7b25 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:17.250734 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-987c74bc-7953-4dab-9bca-69691fbb7b25 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:17.256770 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-987c74bc-7953-4dab-9bca-69691fbb7b25 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:17.257219 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-987c74bc-7953-4dab-9bca-69691fbb7b25 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:17.257983 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-987c74bc-7953-4dab-9bca-69691fbb7b25 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:17.258420 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-987c74bc-7953-4dab-9bca-69691fbb7b25 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:17.324499 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-987c74bc-7953-4dab-9bca-69691fbb7b25 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:17.332026 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-987c74bc-7953-4dab-9bca-69691fbb7b25 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.085534 Oct 15 03:44:17.332587 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 377/775] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:17 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:17.532887 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-08710b7c-10ce-4d01-bf1b-c1f6f094dbd8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:17.533748 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-08710b7c-10ce-4d01-bf1b-c1f6f094dbd8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:17.539379 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-08710b7c-10ce-4d01-bf1b-c1f6f094dbd8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:17.539868 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-08710b7c-10ce-4d01-bf1b-c1f6f094dbd8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:17.541282 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-08710b7c-10ce-4d01-bf1b-c1f6f094dbd8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:17.541701 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-08710b7c-10ce-4d01-bf1b-c1f6f094dbd8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:17.569646 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-08710b7c-10ce-4d01-bf1b-c1f6f094dbd8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040663 Oct 15 03:44:17.570215 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 399/776] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:17 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:17.846485 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-426ceb62-58bd-46a4-8dca-00a3df61e810 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:17.847014 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-426ceb62-58bd-46a4-8dca-00a3df61e810 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:17.852759 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-426ceb62-58bd-46a4-8dca-00a3df61e810 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:17.853203 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-426ceb62-58bd-46a4-8dca-00a3df61e810 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:17.853958 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-426ceb62-58bd-46a4-8dca-00a3df61e810 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:17.854395 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-426ceb62-58bd-46a4-8dca-00a3df61e810 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:17.972121 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-426ceb62-58bd-46a4-8dca-00a3df61e810 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:17.979304 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-426ceb62-58bd-46a4-8dca-00a3df61e810 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.136528 Oct 15 03:44:17.979896 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 378/777] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:17 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:18.021159 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d7fbaff6-87e6-47fe-92d2-13951985932c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:18.022064 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d7fbaff6-87e6-47fe-92d2-13951985932c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:18.027809 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7fbaff6-87e6-47fe-92d2-13951985932c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:18.028261 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7fbaff6-87e6-47fe-92d2-13951985932c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:18.029012 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7fbaff6-87e6-47fe-92d2-13951985932c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:18.029445 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7fbaff6-87e6-47fe-92d2-13951985932c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:18.057784 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d7fbaff6-87e6-47fe-92d2-13951985932c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040371 Oct 15 03:44:18.058317 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 400/778] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:18 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:18.349196 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-85ecc94a-32ff-4344-8992-b55e52741a84 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:18.349798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-85ecc94a-32ff-4344-8992-b55e52741a84 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:18.356221 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-85ecc94a-32ff-4344-8992-b55e52741a84 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:18.356666 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-85ecc94a-32ff-4344-8992-b55e52741a84 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:18.357415 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-85ecc94a-32ff-4344-8992-b55e52741a84 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:18.357840 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-85ecc94a-32ff-4344-8992-b55e52741a84 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:18.418092 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-85ecc94a-32ff-4344-8992-b55e52741a84 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:18.425146 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-85ecc94a-32ff-4344-8992-b55e52741a84 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.079609 Oct 15 03:44:18.425703 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 379/779] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:18 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:18.581219 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7ad11856-1c14-4646-b490-0b534ae1830d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:18.582248 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7ad11856-1c14-4646-b490-0b534ae1830d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:18.588362 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7ad11856-1c14-4646-b490-0b534ae1830d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:18.588813 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7ad11856-1c14-4646-b490-0b534ae1830d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:18.589571 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7ad11856-1c14-4646-b490-0b534ae1830d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:18.590003 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7ad11856-1c14-4646-b490-0b534ae1830d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:18.617973 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7ad11856-1c14-4646-b490-0b534ae1830d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040478 Oct 15 03:44:18.619103 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 401/780] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:18 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:18.996128 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0980e0ff-ba79-45ee-ae99-5ad339f24422 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:18.996732 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0980e0ff-ba79-45ee-ae99-5ad339f24422 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:19.002398 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0980e0ff-ba79-45ee-ae99-5ad339f24422 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:19.002837 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0980e0ff-ba79-45ee-ae99-5ad339f24422 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:19.003589 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0980e0ff-ba79-45ee-ae99-5ad339f24422 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:19.004040 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0980e0ff-ba79-45ee-ae99-5ad339f24422 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:19.069183 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6fa7dbb7-9224-4bff-bfbf-7aee4ede83ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:19.070123 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6fa7dbb7-9224-4bff-bfbf-7aee4ede83ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:19.076475 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6fa7dbb7-9224-4bff-bfbf-7aee4ede83ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:19.076923 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6fa7dbb7-9224-4bff-bfbf-7aee4ede83ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:19.077687 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6fa7dbb7-9224-4bff-bfbf-7aee4ede83ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:19.078120 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6fa7dbb7-9224-4bff-bfbf-7aee4ede83ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:19.107912 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6fa7dbb7-9224-4bff-bfbf-7aee4ede83ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042361 Oct 15 03:44:19.108519 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 402/781] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:19 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:44:19.122105 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0980e0ff-ba79-45ee-ae99-5ad339f24422 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:19.130468 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0980e0ff-ba79-45ee-ae99-5ad339f24422 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.138124 Oct 15 03:44:19.131036 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 380/782] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:18 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:19.442136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d0579901-6b98-4217-afe2-eda4275e8082 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:19.442670 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d0579901-6b98-4217-afe2-eda4275e8082 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:19.449022 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d0579901-6b98-4217-afe2-eda4275e8082 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:19.449469 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d0579901-6b98-4217-afe2-eda4275e8082 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:19.450223 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d0579901-6b98-4217-afe2-eda4275e8082 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:19.450659 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d0579901-6b98-4217-afe2-eda4275e8082 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:19.507240 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d0579901-6b98-4217-afe2-eda4275e8082 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:19.514991 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d0579901-6b98-4217-afe2-eda4275e8082 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.076593 Oct 15 03:44:19.515541 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 403/783] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:19 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:19.629669 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-38dd0bbb-0a86-45d8-abeb-4821fa8b2723 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:19.630571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-38dd0bbb-0a86-45d8-abeb-4821fa8b2723 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:19.636931 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-38dd0bbb-0a86-45d8-abeb-4821fa8b2723 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:19.637375 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-38dd0bbb-0a86-45d8-abeb-4821fa8b2723 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:19.638124 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-38dd0bbb-0a86-45d8-abeb-4821fa8b2723 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:19.638548 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-38dd0bbb-0a86-45d8-abeb-4821fa8b2723 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:19.665917 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-38dd0bbb-0a86-45d8-abeb-4821fa8b2723 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040004 Oct 15 03:44:19.666448 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 381/784] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:19 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:20.120223 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2450ec3f-6426-480a-a88f-44fc40fba01d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:20.121327 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2450ec3f-6426-480a-a88f-44fc40fba01d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:20.127330 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2450ec3f-6426-480a-a88f-44fc40fba01d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:20.127809 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2450ec3f-6426-480a-a88f-44fc40fba01d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:20.128581 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2450ec3f-6426-480a-a88f-44fc40fba01d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:20.129015 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2450ec3f-6426-480a-a88f-44fc40fba01d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:20.131038 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-0bb308b4-b897-4733-99d6-f6708d9e48a1 req-842a5b90-e0b5-4e38-b923-c0b1e2163d35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37285523-63b9-4079-939b-b156366439e6", "name": "network-vif-unplugged", "status": "completed", "tag": "6991361a-3fd3-4d0d-8d4b-edd950821f5d"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:44:20.133192 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:44:20.133192 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:44:20.141031 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-0bb308b4-b897-4733-99d6-f6708d9e48a1 req-842a5b90-e0b5-4e38-b923-c0b1e2163d35 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:20.141487 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-0bb308b4-b897-4733-99d6-f6708d9e48a1 req-842a5b90-e0b5-4e38-b923-c0b1e2163d35 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:20.157698 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-0bb308b4-b897-4733-99d6-f6708d9e48a1 req-842a5b90-e0b5-4e38-b923-c0b1e2163d35 service nova] Creating event network-vif-unplugged:6991361a-3fd3-4d0d-8d4b-edd950821f5d for instance 37285523-63b9-4079-939b-b156366439e6 on hv-cinder-81410 Oct 15 03:44:20.162637 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-0bb308b4-b897-4733-99d6-f6708d9e48a1 req-842a5b90-e0b5-4e38-b923-c0b1e2163d35 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092427 Oct 15 03:44:20.162778 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2450ec3f-6426-480a-a88f-44fc40fba01d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046852 Oct 15 03:44:20.163491 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 404/785] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:44:20 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:20.163614 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 382/786] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:20 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:20.169749 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e7c08831-d33a-4682-bb0b-613d6b7e4572 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:20.170529 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e7c08831-d33a-4682-bb0b-613d6b7e4572 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:20.176402 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e7c08831-d33a-4682-bb0b-613d6b7e4572 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:20.176843 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e7c08831-d33a-4682-bb0b-613d6b7e4572 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:20.177590 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e7c08831-d33a-4682-bb0b-613d6b7e4572 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:20.178015 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e7c08831-d33a-4682-bb0b-613d6b7e4572 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:20.297310 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e7c08831-d33a-4682-bb0b-613d6b7e4572 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:20.304438 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e7c08831-d33a-4682-bb0b-613d6b7e4572 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.139417 Oct 15 03:44:20.304994 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 405/787] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:20 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:20.531223 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ae7a6244-47d7-468f-bbe0-6c43c80ab3b1 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:20.531793 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ae7a6244-47d7-468f-bbe0-6c43c80ab3b1 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:20.537556 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae7a6244-47d7-468f-bbe0-6c43c80ab3b1 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:20.538004 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae7a6244-47d7-468f-bbe0-6c43c80ab3b1 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:20.538759 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae7a6244-47d7-468f-bbe0-6c43c80ab3b1 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:20.539198 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae7a6244-47d7-468f-bbe0-6c43c80ab3b1 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:20.597386 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ae7a6244-47d7-468f-bbe0-6c43c80ab3b1 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:20.605441 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ae7a6244-47d7-468f-bbe0-6c43c80ab3b1 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077875 Oct 15 03:44:20.605996 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 383/788] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:20 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:20.677119 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1a477f66-bce3-43c8-b284-fcaefcad94b2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:20.678025 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1a477f66-bce3-43c8-b284-fcaefcad94b2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:20.683602 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1a477f66-bce3-43c8-b284-fcaefcad94b2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:20.684080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1a477f66-bce3-43c8-b284-fcaefcad94b2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:20.684836 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1a477f66-bce3-43c8-b284-fcaefcad94b2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:20.685287 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1a477f66-bce3-43c8-b284-fcaefcad94b2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:20.714518 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1a477f66-bce3-43c8-b284-fcaefcad94b2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041175 Oct 15 03:44:20.715051 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 406/789] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:20 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:21.174829 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a4c3b806-7ed8-4ba7-9263-0c0a6e965bd5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:21.175750 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a4c3b806-7ed8-4ba7-9263-0c0a6e965bd5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:21.182101 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4c3b806-7ed8-4ba7-9263-0c0a6e965bd5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:21.182541 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4c3b806-7ed8-4ba7-9263-0c0a6e965bd5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:21.183292 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4c3b806-7ed8-4ba7-9263-0c0a6e965bd5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:21.183761 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4c3b806-7ed8-4ba7-9263-0c0a6e965bd5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:21.212287 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a4c3b806-7ed8-4ba7-9263-0c0a6e965bd5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041278 Oct 15 03:44:21.212823 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 384/790] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:21 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:44:21.320983 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-721f4133-bb01-4d0f-ab43-021c59dcf2ac tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:21.321592 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-721f4133-bb01-4d0f-ab43-021c59dcf2ac tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:21.327319 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-721f4133-bb01-4d0f-ab43-021c59dcf2ac tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:21.327790 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-721f4133-bb01-4d0f-ab43-021c59dcf2ac tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:21.328546 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-721f4133-bb01-4d0f-ab43-021c59dcf2ac tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:21.328978 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-721f4133-bb01-4d0f-ab43-021c59dcf2ac tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:21.443261 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-721f4133-bb01-4d0f-ab43-021c59dcf2ac tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:21.451041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-721f4133-bb01-4d0f-ab43-021c59dcf2ac tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.133720 Oct 15 03:44:21.451599 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 407/791] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:21 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:21.621927 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-bd4cd8f1-92cd-46c8-b94c-03d5d9574e47 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:21.622532 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-bd4cd8f1-92cd-46c8-b94c-03d5d9574e47 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:21.628404 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bd4cd8f1-92cd-46c8-b94c-03d5d9574e47 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:21.628852 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bd4cd8f1-92cd-46c8-b94c-03d5d9574e47 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:21.629614 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bd4cd8f1-92cd-46c8-b94c-03d5d9574e47 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:21.630047 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bd4cd8f1-92cd-46c8-b94c-03d5d9574e47 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:21.686747 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-bd4cd8f1-92cd-46c8-b94c-03d5d9574e47 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:21.693848 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-bd4cd8f1-92cd-46c8-b94c-03d5d9574e47 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.076140 Oct 15 03:44:21.694354 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 385/792] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:21 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:21.725495 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b6390683-09d8-447f-9a0a-37b24761b571 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:21.726439 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b6390683-09d8-447f-9a0a-37b24761b571 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:21.732671 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b6390683-09d8-447f-9a0a-37b24761b571 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:21.733115 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b6390683-09d8-447f-9a0a-37b24761b571 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:21.733869 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b6390683-09d8-447f-9a0a-37b24761b571 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:21.734299 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b6390683-09d8-447f-9a0a-37b24761b571 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:21.761875 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b6390683-09d8-447f-9a0a-37b24761b571 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040113 Oct 15 03:44:21.762400 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 408/793] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:21 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:22.223812 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ea69dc0f-5cd0-4caa-b07f-5db4d9e2d45f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:22.224732 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ea69dc0f-5cd0-4caa-b07f-5db4d9e2d45f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:22.230502 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea69dc0f-5cd0-4caa-b07f-5db4d9e2d45f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:22.230948 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea69dc0f-5cd0-4caa-b07f-5db4d9e2d45f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:22.231729 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea69dc0f-5cd0-4caa-b07f-5db4d9e2d45f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:22.232163 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea69dc0f-5cd0-4caa-b07f-5db4d9e2d45f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:22.264506 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ea69dc0f-5cd0-4caa-b07f-5db4d9e2d45f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044525 Oct 15 03:44:22.265054 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 386/794] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:22 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:22.467281 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-18f188c6-033b-475b-92b9-ece7e7db6af2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:22.467830 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-18f188c6-033b-475b-92b9-ece7e7db6af2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:22.473465 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18f188c6-033b-475b-92b9-ece7e7db6af2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:22.473905 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18f188c6-033b-475b-92b9-ece7e7db6af2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:22.474652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18f188c6-033b-475b-92b9-ece7e7db6af2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:22.475075 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18f188c6-033b-475b-92b9-ece7e7db6af2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:22.595703 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-18f188c6-033b-475b-92b9-ece7e7db6af2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:22.602733 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-18f188c6-033b-475b-92b9-ece7e7db6af2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.139047 Oct 15 03:44:22.603283 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 409/795] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:22 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:22.709944 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f2ee3baf-9552-47ef-9002-71d875c11c4c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:22.710934 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f2ee3baf-9552-47ef-9002-71d875c11c4c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:22.716663 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f2ee3baf-9552-47ef-9002-71d875c11c4c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:22.717109 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f2ee3baf-9552-47ef-9002-71d875c11c4c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:22.717916 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f2ee3baf-9552-47ef-9002-71d875c11c4c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:22.718300 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f2ee3baf-9552-47ef-9002-71d875c11c4c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:22.772302 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1e45a504-9a1b-4742-a837-8c503bbaf2ba tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:22.773651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1e45a504-9a1b-4742-a837-8c503bbaf2ba tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:22.775629 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f2ee3baf-9552-47ef-9002-71d875c11c4c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:22.779245 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e45a504-9a1b-4742-a837-8c503bbaf2ba tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:22.779790 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e45a504-9a1b-4742-a837-8c503bbaf2ba tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:22.780651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e45a504-9a1b-4742-a837-8c503bbaf2ba tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:22.781153 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e45a504-9a1b-4742-a837-8c503bbaf2ba tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:22.782862 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f2ee3baf-9552-47ef-9002-71d875c11c4c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.076545 Oct 15 03:44:22.783424 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 387/796] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:22 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:22.810220 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1e45a504-9a1b-4742-a837-8c503bbaf2ba tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041691 Oct 15 03:44:22.810754 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 410/797] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:22 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:44:23.275986 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3903b3de-7f67-404f-aed8-dbd1aca10a6b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:23.276898 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3903b3de-7f67-404f-aed8-dbd1aca10a6b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:23.282623 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3903b3de-7f67-404f-aed8-dbd1aca10a6b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:23.283085 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3903b3de-7f67-404f-aed8-dbd1aca10a6b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:23.283854 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3903b3de-7f67-404f-aed8-dbd1aca10a6b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:23.284291 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3903b3de-7f67-404f-aed8-dbd1aca10a6b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:23.313605 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3903b3de-7f67-404f-aed8-dbd1aca10a6b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042031 Oct 15 03:44:23.314141 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 388/798] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:23 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:23.619478 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c4e76608-4ecf-411b-8241-ca7bc3a911ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:23.620094 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c4e76608-4ecf-411b-8241-ca7bc3a911ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:23.625808 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c4e76608-4ecf-411b-8241-ca7bc3a911ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:23.626249 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c4e76608-4ecf-411b-8241-ca7bc3a911ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:23.626992 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c4e76608-4ecf-411b-8241-ca7bc3a911ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:23.627420 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c4e76608-4ecf-411b-8241-ca7bc3a911ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:23.742677 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c4e76608-4ecf-411b-8241-ca7bc3a911ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:23.749718 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c4e76608-4ecf-411b-8241-ca7bc3a911ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.133993 Oct 15 03:44:23.750268 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 411/799] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:23 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:23.799753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ae4e65d4-7b37-41ea-b20e-0e636d748b65 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:23.800355 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ae4e65d4-7b37-41ea-b20e-0e636d748b65 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:23.806174 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae4e65d4-7b37-41ea-b20e-0e636d748b65 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:23.806614 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae4e65d4-7b37-41ea-b20e-0e636d748b65 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:23.807360 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae4e65d4-7b37-41ea-b20e-0e636d748b65 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:23.807811 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae4e65d4-7b37-41ea-b20e-0e636d748b65 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:23.820944 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c9f68059-242f-4f8b-8de7-d84daf7a56b0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:23.822658 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c9f68059-242f-4f8b-8de7-d84daf7a56b0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:23.828486 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c9f68059-242f-4f8b-8de7-d84daf7a56b0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:23.828970 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c9f68059-242f-4f8b-8de7-d84daf7a56b0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:23.829748 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c9f68059-242f-4f8b-8de7-d84daf7a56b0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:23.830210 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c9f68059-242f-4f8b-8de7-d84daf7a56b0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:23.859520 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c9f68059-242f-4f8b-8de7-d84daf7a56b0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042214 Oct 15 03:44:23.860105 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 412/800] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:23 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:44:23.869271 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ae4e65d4-7b37-41ea-b20e-0e636d748b65 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:23.876538 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ae4e65d4-7b37-41ea-b20e-0e636d748b65 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.080393 Oct 15 03:44:23.877028 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 389/801] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:23 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:24.325194 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-75547e8f-312a-4695-8bd1-b9f734d9d278 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:24.326092 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-75547e8f-312a-4695-8bd1-b9f734d9d278 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:24.332007 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-75547e8f-312a-4695-8bd1-b9f734d9d278 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:24.332499 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-75547e8f-312a-4695-8bd1-b9f734d9d278 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:24.333262 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-75547e8f-312a-4695-8bd1-b9f734d9d278 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:24.333747 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-75547e8f-312a-4695-8bd1-b9f734d9d278 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:24.362670 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-75547e8f-312a-4695-8bd1-b9f734d9d278 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041389 Oct 15 03:44:24.363260 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 413/802] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:24 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:24.767068 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9bd242cb-f2f2-4cd0-b710-842e9d3ac999 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:24.767732 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9bd242cb-f2f2-4cd0-b710-842e9d3ac999 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:24.773419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bd242cb-f2f2-4cd0-b710-842e9d3ac999 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:24.773866 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bd242cb-f2f2-4cd0-b710-842e9d3ac999 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:24.775129 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bd242cb-f2f2-4cd0-b710-842e9d3ac999 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:24.775561 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bd242cb-f2f2-4cd0-b710-842e9d3ac999 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:24.870163 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-468b5475-b769-4a44-b1b0-9b6b401279a0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:24.871070 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-468b5475-b769-4a44-b1b0-9b6b401279a0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:24.876765 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-468b5475-b769-4a44-b1b0-9b6b401279a0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:24.877212 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-468b5475-b769-4a44-b1b0-9b6b401279a0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:24.877981 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-468b5475-b769-4a44-b1b0-9b6b401279a0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:24.878415 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-468b5475-b769-4a44-b1b0-9b6b401279a0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:24.895777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-9bd242cb-f2f2-4cd0-b710-842e9d3ac999 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:24.903560 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9bd242cb-f2f2-4cd0-b710-842e9d3ac999 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.140201 Oct 15 03:44:24.904231 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 390/803] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:24 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:24.907348 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-468b5475-b769-4a44-b1b0-9b6b401279a0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040864 Oct 15 03:44:24.908582 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-09df5813-bcda-4efc-a44d-4488cec864b7 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:24.909410 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-09df5813-bcda-4efc-a44d-4488cec864b7 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:24.910938 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 414/804] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:24 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:44:24.915129 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09df5813-bcda-4efc-a44d-4488cec864b7 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:24.916182 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09df5813-bcda-4efc-a44d-4488cec864b7 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:24.916944 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09df5813-bcda-4efc-a44d-4488cec864b7 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:24.917375 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09df5813-bcda-4efc-a44d-4488cec864b7 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:24.974548 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-09df5813-bcda-4efc-a44d-4488cec864b7 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:24.983400 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-09df5813-bcda-4efc-a44d-4488cec864b7 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077288 Oct 15 03:44:24.984343 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 391/805] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:24 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:25.374018 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-db0a0c5f-5c66-4464-9ec9-67972935d82e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:25.374920 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-db0a0c5f-5c66-4464-9ec9-67972935d82e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:25.380714 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-db0a0c5f-5c66-4464-9ec9-67972935d82e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:25.381159 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-db0a0c5f-5c66-4464-9ec9-67972935d82e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:25.381913 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-db0a0c5f-5c66-4464-9ec9-67972935d82e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:25.382338 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-db0a0c5f-5c66-4464-9ec9-67972935d82e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:25.410841 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-db0a0c5f-5c66-4464-9ec9-67972935d82e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040730 Oct 15 03:44:25.411379 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 415/806] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:25 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:25.918818 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-537fd360-8125-4b82-b88e-8ab9847bf25b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:25.919741 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-537fd360-8125-4b82-b88e-8ab9847bf25b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:25.919881 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-01471990-5b6d-4efe-8327-5c2355eddd3d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:25.920414 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-01471990-5b6d-4efe-8327-5c2355eddd3d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:25.925485 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-537fd360-8125-4b82-b88e-8ab9847bf25b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:25.925909 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-537fd360-8125-4b82-b88e-8ab9847bf25b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:25.926153 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-01471990-5b6d-4efe-8327-5c2355eddd3d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:25.926603 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-01471990-5b6d-4efe-8327-5c2355eddd3d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:25.926709 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-537fd360-8125-4b82-b88e-8ab9847bf25b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:25.927088 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-537fd360-8125-4b82-b88e-8ab9847bf25b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:25.927356 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-01471990-5b6d-4efe-8327-5c2355eddd3d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:25.927812 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-01471990-5b6d-4efe-8327-5c2355eddd3d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:25.955577 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-537fd360-8125-4b82-b88e-8ab9847bf25b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041003 Oct 15 03:44:25.956498 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 392/807] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:25 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:26.000268 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f3c405b0-02d3-454f-9387-4e7fb905ebec tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:26.000881 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f3c405b0-02d3-454f-9387-4e7fb905ebec tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:26.006634 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f3c405b0-02d3-454f-9387-4e7fb905ebec tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:26.007088 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f3c405b0-02d3-454f-9387-4e7fb905ebec tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:26.007897 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f3c405b0-02d3-454f-9387-4e7fb905ebec tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:26.008336 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f3c405b0-02d3-454f-9387-4e7fb905ebec tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:26.057511 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-01471990-5b6d-4efe-8327-5c2355eddd3d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:26.064625 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-01471990-5b6d-4efe-8327-5c2355eddd3d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.148390 Oct 15 03:44:26.065175 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 416/808] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:25 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:44:26.071534 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f3c405b0-02d3-454f-9387-4e7fb905ebec tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:26.078866 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f3c405b0-02d3-454f-9387-4e7fb905ebec tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.082185 Oct 15 03:44:26.079420 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 393/809] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:25 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:44:26.422260 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-984aeef3-711c-4200-b836-01cbd2881e05 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:26.423157 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-984aeef3-711c-4200-b836-01cbd2881e05 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:26.428877 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-984aeef3-711c-4200-b836-01cbd2881e05 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:26.429316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-984aeef3-711c-4200-b836-01cbd2881e05 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:26.430059 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-984aeef3-711c-4200-b836-01cbd2881e05 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:26.430485 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-984aeef3-711c-4200-b836-01cbd2881e05 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:26.458227 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-984aeef3-711c-4200-b836-01cbd2881e05 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039737 Oct 15 03:44:26.458750 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 417/810] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:26 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:26.966469 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ca013201-7869-4371-a0ad-7dd8bebd735b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:26.967376 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ca013201-7869-4371-a0ad-7dd8bebd735b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:26.973110 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca013201-7869-4371-a0ad-7dd8bebd735b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:26.973565 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca013201-7869-4371-a0ad-7dd8bebd735b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:26.974332 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca013201-7869-4371-a0ad-7dd8bebd735b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:26.974768 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca013201-7869-4371-a0ad-7dd8bebd735b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:27.002738 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ca013201-7869-4371-a0ad-7dd8bebd735b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040038 Oct 15 03:44:27.003279 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 394/811] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:26 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:27.081225 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3b9ddabd-46f1-48dc-9289-027d4232a946 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:27.081831 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3b9ddabd-46f1-48dc-9289-027d4232a946 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:27.087872 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b9ddabd-46f1-48dc-9289-027d4232a946 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:27.088315 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b9ddabd-46f1-48dc-9289-027d4232a946 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:27.089072 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b9ddabd-46f1-48dc-9289-027d4232a946 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:27.089503 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b9ddabd-46f1-48dc-9289-027d4232a946 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:27.095198 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b558eda4-9ce2-4e33-b2a1-715bffeab1c6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:27.095880 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b558eda4-9ce2-4e33-b2a1-715bffeab1c6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:27.101553 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b558eda4-9ce2-4e33-b2a1-715bffeab1c6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:27.102007 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b558eda4-9ce2-4e33-b2a1-715bffeab1c6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:27.102827 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b558eda4-9ce2-4e33-b2a1-715bffeab1c6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:27.103272 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b558eda4-9ce2-4e33-b2a1-715bffeab1c6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:27.172852 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b558eda4-9ce2-4e33-b2a1-715bffeab1c6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:27.179996 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b558eda4-9ce2-4e33-b2a1-715bffeab1c6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.088345 Oct 15 03:44:27.180553 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 395/812] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:27 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:44:27.231699 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3b9ddabd-46f1-48dc-9289-027d4232a946 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:27.238915 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3b9ddabd-46f1-48dc-9289-027d4232a946 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.161273 Oct 15 03:44:27.239474 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 418/813] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:27 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:27.469485 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9e072610-3fbd-48d9-8669-5686ae5daf9e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:27.470416 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9e072610-3fbd-48d9-8669-5686ae5daf9e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:27.476137 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9e072610-3fbd-48d9-8669-5686ae5daf9e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:27.476579 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9e072610-3fbd-48d9-8669-5686ae5daf9e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:27.477327 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9e072610-3fbd-48d9-8669-5686ae5daf9e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:27.478264 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9e072610-3fbd-48d9-8669-5686ae5daf9e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:27.506615 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9e072610-3fbd-48d9-8669-5686ae5daf9e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040931 Oct 15 03:44:27.507147 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 396/814] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:27 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:28.013837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f9a39ee1-b0e4-4689-8c21-9adf86fc38a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:28.014745 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f9a39ee1-b0e4-4689-8c21-9adf86fc38a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:28.020543 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f9a39ee1-b0e4-4689-8c21-9adf86fc38a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:28.021004 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f9a39ee1-b0e4-4689-8c21-9adf86fc38a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:28.021748 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f9a39ee1-b0e4-4689-8c21-9adf86fc38a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:28.022175 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f9a39ee1-b0e4-4689-8c21-9adf86fc38a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:28.050481 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f9a39ee1-b0e4-4689-8c21-9adf86fc38a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040333 Oct 15 03:44:28.051011 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 419/815] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:28 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:28.197437 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5450a4c6-055e-4330-9959-bb23c75cd81b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:28.198047 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5450a4c6-055e-4330-9959-bb23c75cd81b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:28.203830 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5450a4c6-055e-4330-9959-bb23c75cd81b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:28.204281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5450a4c6-055e-4330-9959-bb23c75cd81b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:28.205042 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5450a4c6-055e-4330-9959-bb23c75cd81b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:28.205474 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5450a4c6-055e-4330-9959-bb23c75cd81b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:28.256022 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d38b8f82-a0e5-46e4-8714-b87348c68700 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:28.256628 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d38b8f82-a0e5-46e4-8714-b87348c68700 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:28.262812 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d38b8f82-a0e5-46e4-8714-b87348c68700 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:28.263632 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d38b8f82-a0e5-46e4-8714-b87348c68700 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:28.264086 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d38b8f82-a0e5-46e4-8714-b87348c68700 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:28.264466 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d38b8f82-a0e5-46e4-8714-b87348c68700 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:28.265792 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5450a4c6-055e-4330-9959-bb23c75cd81b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:28.273065 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5450a4c6-055e-4330-9959-bb23c75cd81b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.079753 Oct 15 03:44:28.273663 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 397/816] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:28 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:28.379723 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d38b8f82-a0e5-46e4-8714-b87348c68700 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:28.387408 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d38b8f82-a0e5-46e4-8714-b87348c68700 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.134982 Oct 15 03:44:28.388258 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 420/817] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:28 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:44:28.517971 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4db451cf-09a0-49d5-9a25-b5294d388f01 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:28.518798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4db451cf-09a0-49d5-9a25-b5294d388f01 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:28.524605 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4db451cf-09a0-49d5-9a25-b5294d388f01 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:28.525052 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4db451cf-09a0-49d5-9a25-b5294d388f01 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:28.525808 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4db451cf-09a0-49d5-9a25-b5294d388f01 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:28.526240 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4db451cf-09a0-49d5-9a25-b5294d388f01 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:28.553608 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4db451cf-09a0-49d5-9a25-b5294d388f01 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039530 Oct 15 03:44:28.554151 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 398/818] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:28 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:29.062213 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-afa7dc89-a81b-4fb2-9d3e-7cf4e40804c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:29.063122 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-afa7dc89-a81b-4fb2-9d3e-7cf4e40804c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:29.068913 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-afa7dc89-a81b-4fb2-9d3e-7cf4e40804c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:29.069359 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-afa7dc89-a81b-4fb2-9d3e-7cf4e40804c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:29.070116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-afa7dc89-a81b-4fb2-9d3e-7cf4e40804c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:29.070548 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-afa7dc89-a81b-4fb2-9d3e-7cf4e40804c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:29.099037 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-afa7dc89-a81b-4fb2-9d3e-7cf4e40804c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040586 Oct 15 03:44:29.099566 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 421/819] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:29 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:29.290079 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-517f949f-7e50-4386-8426-bf9d92e77303 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:29.291224 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-517f949f-7e50-4386-8426-bf9d92e77303 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:29.297054 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-517f949f-7e50-4386-8426-bf9d92e77303 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:29.297505 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-517f949f-7e50-4386-8426-bf9d92e77303 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:29.298265 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-517f949f-7e50-4386-8426-bf9d92e77303 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:29.298698 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-517f949f-7e50-4386-8426-bf9d92e77303 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:29.357314 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-517f949f-7e50-4386-8426-bf9d92e77303 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:29.364805 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-517f949f-7e50-4386-8426-bf9d92e77303 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.078416 Oct 15 03:44:29.365360 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 399/820] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:29 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:29.404709 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1b024c02-60b1-4e1b-8f94-a24fff06cb44 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:29.405316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1b024c02-60b1-4e1b-8f94-a24fff06cb44 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:29.410884 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b024c02-60b1-4e1b-8f94-a24fff06cb44 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:29.411330 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b024c02-60b1-4e1b-8f94-a24fff06cb44 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:29.412116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b024c02-60b1-4e1b-8f94-a24fff06cb44 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:29.412549 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b024c02-60b1-4e1b-8f94-a24fff06cb44 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:29.527153 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1b024c02-60b1-4e1b-8f94-a24fff06cb44 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:29.534277 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1b024c02-60b1-4e1b-8f94-a24fff06cb44 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.133147 Oct 15 03:44:29.534827 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 422/821] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:29 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:29.565331 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b2e4d56a-eab9-43a5-badd-3251449c03b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:29.566235 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b2e4d56a-eab9-43a5-badd-3251449c03b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:29.572365 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b2e4d56a-eab9-43a5-badd-3251449c03b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:29.572814 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b2e4d56a-eab9-43a5-badd-3251449c03b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:29.573570 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b2e4d56a-eab9-43a5-badd-3251449c03b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:29.574000 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b2e4d56a-eab9-43a5-badd-3251449c03b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:29.603427 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b2e4d56a-eab9-43a5-badd-3251449c03b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041864 Oct 15 03:44:29.603998 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 400/822] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:29 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:30.110691 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8ed35239-94a8-4980-8e89-27c3a6e5b308 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:30.111540 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8ed35239-94a8-4980-8e89-27c3a6e5b308 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:30.117529 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8ed35239-94a8-4980-8e89-27c3a6e5b308 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:30.118009 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8ed35239-94a8-4980-8e89-27c3a6e5b308 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:30.118787 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8ed35239-94a8-4980-8e89-27c3a6e5b308 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:30.119222 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8ed35239-94a8-4980-8e89-27c3a6e5b308 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:30.149262 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8ed35239-94a8-4980-8e89-27c3a6e5b308 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042549 Oct 15 03:44:30.150346 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 423/823] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:30 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:30.381355 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4786507b-cff6-46cd-9455-67c3b2347f0e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:30.381938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4786507b-cff6-46cd-9455-67c3b2347f0e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:30.388086 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4786507b-cff6-46cd-9455-67c3b2347f0e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:30.388526 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4786507b-cff6-46cd-9455-67c3b2347f0e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:30.389294 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4786507b-cff6-46cd-9455-67c3b2347f0e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:30.389734 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4786507b-cff6-46cd-9455-67c3b2347f0e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:30.457189 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4786507b-cff6-46cd-9455-67c3b2347f0e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:30.465300 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4786507b-cff6-46cd-9455-67c3b2347f0e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.087668 Oct 15 03:44:30.466085 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 401/824] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:30 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:30.551720 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a91485bc-8be2-42db-bba6-04facd7f6910 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:30.552329 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a91485bc-8be2-42db-bba6-04facd7f6910 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:30.558081 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a91485bc-8be2-42db-bba6-04facd7f6910 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:30.558528 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a91485bc-8be2-42db-bba6-04facd7f6910 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:30.559286 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a91485bc-8be2-42db-bba6-04facd7f6910 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:30.559737 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a91485bc-8be2-42db-bba6-04facd7f6910 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:30.614250 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3960fc4e-176e-4e90-8d1e-8d0408338b23 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:30.615298 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3960fc4e-176e-4e90-8d1e-8d0408338b23 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:30.621048 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3960fc4e-176e-4e90-8d1e-8d0408338b23 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:30.621499 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3960fc4e-176e-4e90-8d1e-8d0408338b23 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:30.622266 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3960fc4e-176e-4e90-8d1e-8d0408338b23 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:30.622704 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3960fc4e-176e-4e90-8d1e-8d0408338b23 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:30.654045 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3960fc4e-176e-4e90-8d1e-8d0408338b23 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043448 Oct 15 03:44:30.654956 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 402/825] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:30 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:44:30.677922 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a91485bc-8be2-42db-bba6-04facd7f6910 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:30.685644 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a91485bc-8be2-42db-bba6-04facd7f6910 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.137542 Oct 15 03:44:30.686199 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 424/826] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:30 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:31.161106 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-febcd7a6-1b00-4f7a-aeca-1d3dd1a7c9f4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:31.162046 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-febcd7a6-1b00-4f7a-aeca-1d3dd1a7c9f4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:31.167894 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-febcd7a6-1b00-4f7a-aeca-1d3dd1a7c9f4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:31.168346 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-febcd7a6-1b00-4f7a-aeca-1d3dd1a7c9f4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:31.169138 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-febcd7a6-1b00-4f7a-aeca-1d3dd1a7c9f4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:31.169575 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-febcd7a6-1b00-4f7a-aeca-1d3dd1a7c9f4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:31.197982 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-febcd7a6-1b00-4f7a-aeca-1d3dd1a7c9f4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040633 Oct 15 03:44:31.198536 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 403/827] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:31 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:31.481999 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5a134bab-4742-42b1-993f-eaf26d988c46 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:31.482539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5a134bab-4742-42b1-993f-eaf26d988c46 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:31.488323 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a134bab-4742-42b1-993f-eaf26d988c46 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:31.488776 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a134bab-4742-42b1-993f-eaf26d988c46 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:31.489541 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a134bab-4742-42b1-993f-eaf26d988c46 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:31.489976 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a134bab-4742-42b1-993f-eaf26d988c46 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:31.547771 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5a134bab-4742-42b1-993f-eaf26d988c46 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:31.554836 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5a134bab-4742-42b1-993f-eaf26d988c46 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.076647 Oct 15 03:44:31.555378 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 425/828] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:31 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:31.664514 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-184c8f2c-5a4e-45cc-83da-58cfc0014a4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:31.665432 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-184c8f2c-5a4e-45cc-83da-58cfc0014a4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:31.671208 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-184c8f2c-5a4e-45cc-83da-58cfc0014a4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:31.671670 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-184c8f2c-5a4e-45cc-83da-58cfc0014a4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:31.672474 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-184c8f2c-5a4e-45cc-83da-58cfc0014a4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:31.672915 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-184c8f2c-5a4e-45cc-83da-58cfc0014a4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:31.702366 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-184c8f2c-5a4e-45cc-83da-58cfc0014a4d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041600 Oct 15 03:44:31.702741 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b2966b89-7000-4e17-9b37-20d016dfdefe tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:31.702983 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 404/829] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:31 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:31.703350 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b2966b89-7000-4e17-9b37-20d016dfdefe tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:31.709058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b2966b89-7000-4e17-9b37-20d016dfdefe tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:31.709502 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b2966b89-7000-4e17-9b37-20d016dfdefe tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:31.710260 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b2966b89-7000-4e17-9b37-20d016dfdefe tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:31.710956 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b2966b89-7000-4e17-9b37-20d016dfdefe tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:31.838937 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b2966b89-7000-4e17-9b37-20d016dfdefe tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:31.846715 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b2966b89-7000-4e17-9b37-20d016dfdefe tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.147491 Oct 15 03:44:31.847556 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 426/830] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:31 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:44:32.209586 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b36b501b-25f2-415f-99ef-254427e07c59 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:32.210735 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b36b501b-25f2-415f-99ef-254427e07c59 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:32.216936 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b36b501b-25f2-415f-99ef-254427e07c59 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:32.217378 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b36b501b-25f2-415f-99ef-254427e07c59 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:32.218130 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b36b501b-25f2-415f-99ef-254427e07c59 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:32.218555 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b36b501b-25f2-415f-99ef-254427e07c59 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:32.246888 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b36b501b-25f2-415f-99ef-254427e07c59 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040974 Oct 15 03:44:32.247439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 405/831] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:32 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:32.572293 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6dd9216f-5c6a-446d-91da-3c56cffd6b1f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:32.572901 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6dd9216f-5c6a-446d-91da-3c56cffd6b1f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:32.578599 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6dd9216f-5c6a-446d-91da-3c56cffd6b1f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:32.579047 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6dd9216f-5c6a-446d-91da-3c56cffd6b1f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:32.579833 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6dd9216f-5c6a-446d-91da-3c56cffd6b1f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:32.580296 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6dd9216f-5c6a-446d-91da-3c56cffd6b1f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:32.638051 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6dd9216f-5c6a-446d-91da-3c56cffd6b1f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:32.645182 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6dd9216f-5c6a-446d-91da-3c56cffd6b1f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077017 Oct 15 03:44:32.645735 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 427/832] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:32 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:32.714794 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ca83405b-7dbd-4137-a467-1b749424dea1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:32.715758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ca83405b-7dbd-4137-a467-1b749424dea1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:32.721623 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca83405b-7dbd-4137-a467-1b749424dea1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:32.722075 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca83405b-7dbd-4137-a467-1b749424dea1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:32.722844 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca83405b-7dbd-4137-a467-1b749424dea1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:32.723280 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca83405b-7dbd-4137-a467-1b749424dea1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:32.751182 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ca83405b-7dbd-4137-a467-1b749424dea1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041124 Oct 15 03:44:32.751740 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 406/833] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:32 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:32.864051 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1b4aeeb7-53bc-4151-bc55-aa0615656f74 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:32.864586 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1b4aeeb7-53bc-4151-bc55-aa0615656f74 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:32.870409 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b4aeeb7-53bc-4151-bc55-aa0615656f74 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:32.870881 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b4aeeb7-53bc-4151-bc55-aa0615656f74 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:32.871637 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b4aeeb7-53bc-4151-bc55-aa0615656f74 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:32.872096 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b4aeeb7-53bc-4151-bc55-aa0615656f74 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:32.988365 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1b4aeeb7-53bc-4151-bc55-aa0615656f74 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:32.997267 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1b4aeeb7-53bc-4151-bc55-aa0615656f74 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.136870 Oct 15 03:44:32.997843 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 428/834] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:32 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:33.258205 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-040d583b-4227-48eb-b7a7-973e4823b5b4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:33.259908 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-040d583b-4227-48eb-b7a7-973e4823b5b4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:33.265604 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-040d583b-4227-48eb-b7a7-973e4823b5b4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:33.266042 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-040d583b-4227-48eb-b7a7-973e4823b5b4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:33.266790 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-040d583b-4227-48eb-b7a7-973e4823b5b4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:33.267216 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-040d583b-4227-48eb-b7a7-973e4823b5b4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:33.294899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-040d583b-4227-48eb-b7a7-973e4823b5b4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040467 Oct 15 03:44:33.295426 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 407/835] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:33 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:33.662121 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a92229df-d3b4-4260-8bcb-2544f5ceab80 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:33.662673 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a92229df-d3b4-4260-8bcb-2544f5ceab80 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:33.668870 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a92229df-d3b4-4260-8bcb-2544f5ceab80 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:33.669311 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a92229df-d3b4-4260-8bcb-2544f5ceab80 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:33.670056 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a92229df-d3b4-4260-8bcb-2544f5ceab80 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:33.670483 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a92229df-d3b4-4260-8bcb-2544f5ceab80 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:33.731266 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a92229df-d3b4-4260-8bcb-2544f5ceab80 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:33.738364 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a92229df-d3b4-4260-8bcb-2544f5ceab80 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.079961 Oct 15 03:44:33.738909 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 429/836] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:33 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:33.762140 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-91bebac2-50b8-45b6-9738-713a1ac55042 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:33.763106 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-91bebac2-50b8-45b6-9738-713a1ac55042 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:33.768808 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-91bebac2-50b8-45b6-9738-713a1ac55042 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:33.769259 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-91bebac2-50b8-45b6-9738-713a1ac55042 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:33.770017 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-91bebac2-50b8-45b6-9738-713a1ac55042 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:33.770460 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-91bebac2-50b8-45b6-9738-713a1ac55042 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:33.799542 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-91bebac2-50b8-45b6-9738-713a1ac55042 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041141 Oct 15 03:44:33.800111 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 408/837] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:33 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:34.013757 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fcffb9d9-9401-4e19-a9a6-1665a6de3d5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:34.014362 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fcffb9d9-9401-4e19-a9a6-1665a6de3d5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:34.020159 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fcffb9d9-9401-4e19-a9a6-1665a6de3d5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:34.020628 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fcffb9d9-9401-4e19-a9a6-1665a6de3d5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:34.021392 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fcffb9d9-9401-4e19-a9a6-1665a6de3d5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:34.021823 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fcffb9d9-9401-4e19-a9a6-1665a6de3d5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:34.136889 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fcffb9d9-9401-4e19-a9a6-1665a6de3d5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:34.144177 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fcffb9d9-9401-4e19-a9a6-1665a6de3d5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.133990 Oct 15 03:44:34.144737 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 430/838] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:34 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:34.306175 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1cb5c52f-87cb-43de-8087-1caa07257de5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:34.307069 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1cb5c52f-87cb-43de-8087-1caa07257de5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:34.312798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1cb5c52f-87cb-43de-8087-1caa07257de5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:34.313240 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1cb5c52f-87cb-43de-8087-1caa07257de5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:34.313985 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1cb5c52f-87cb-43de-8087-1caa07257de5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:34.314412 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1cb5c52f-87cb-43de-8087-1caa07257de5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:34.343558 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1cb5c52f-87cb-43de-8087-1caa07257de5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041166 Oct 15 03:44:34.344132 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 409/839] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:34 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:34.754245 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d4665630-3bd2-4a84-a68e-92b09d29300b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:34.754887 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d4665630-3bd2-4a84-a68e-92b09d29300b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:34.761174 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4665630-3bd2-4a84-a68e-92b09d29300b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:34.761631 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4665630-3bd2-4a84-a68e-92b09d29300b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:34.762387 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4665630-3bd2-4a84-a68e-92b09d29300b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:34.762817 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4665630-3bd2-4a84-a68e-92b09d29300b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:34.810890 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e0182302-b34b-474f-9ecc-5ae2b9391e5a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:34.811818 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e0182302-b34b-474f-9ecc-5ae2b9391e5a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:34.817966 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e0182302-b34b-474f-9ecc-5ae2b9391e5a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:34.817966 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e0182302-b34b-474f-9ecc-5ae2b9391e5a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:34.818706 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e0182302-b34b-474f-9ecc-5ae2b9391e5a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:34.819176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e0182302-b34b-474f-9ecc-5ae2b9391e5a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:34.820223 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d4665630-3bd2-4a84-a68e-92b09d29300b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:34.829292 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d4665630-3bd2-4a84-a68e-92b09d29300b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.078631 Oct 15 03:44:34.829870 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 431/840] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:34 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:34.856200 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e0182302-b34b-474f-9ecc-5ae2b9391e5a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048946 Oct 15 03:44:34.856754 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 410/841] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:34 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:44:35.162332 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-29b95434-47d4-45a5-8b2d-0ad37ed78520 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:35.162945 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-29b95434-47d4-45a5-8b2d-0ad37ed78520 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:35.171190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-29b95434-47d4-45a5-8b2d-0ad37ed78520 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:35.171805 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-29b95434-47d4-45a5-8b2d-0ad37ed78520 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:35.173170 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-29b95434-47d4-45a5-8b2d-0ad37ed78520 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:35.173769 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-29b95434-47d4-45a5-8b2d-0ad37ed78520 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:35.288025 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-29b95434-47d4-45a5-8b2d-0ad37ed78520 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:35.296328 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-29b95434-47d4-45a5-8b2d-0ad37ed78520 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.137765 Oct 15 03:44:35.296884 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 432/842] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:35 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:35.356666 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-51438fd2-d2eb-44b9-a228-0bab980736d3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:35.357565 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-51438fd2-d2eb-44b9-a228-0bab980736d3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:35.363233 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51438fd2-d2eb-44b9-a228-0bab980736d3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:35.363674 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51438fd2-d2eb-44b9-a228-0bab980736d3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:35.364452 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51438fd2-d2eb-44b9-a228-0bab980736d3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:35.364877 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51438fd2-d2eb-44b9-a228-0bab980736d3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:35.392327 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-51438fd2-d2eb-44b9-a228-0bab980736d3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041070 Oct 15 03:44:35.392874 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 411/843] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:35 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:35.846068 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9c16f3c3-024a-46c8-83d7-23618c535b1c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:35.846681 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9c16f3c3-024a-46c8-83d7-23618c535b1c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:35.853489 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9c16f3c3-024a-46c8-83d7-23618c535b1c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:35.853934 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9c16f3c3-024a-46c8-83d7-23618c535b1c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:35.854691 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9c16f3c3-024a-46c8-83d7-23618c535b1c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:35.855118 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9c16f3c3-024a-46c8-83d7-23618c535b1c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:35.867523 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ca70d4e7-6999-45f5-a2f6-9d7f31ed2f28 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:35.868549 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ca70d4e7-6999-45f5-a2f6-9d7f31ed2f28 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:35.874173 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca70d4e7-6999-45f5-a2f6-9d7f31ed2f28 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:35.874618 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca70d4e7-6999-45f5-a2f6-9d7f31ed2f28 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:35.875377 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca70d4e7-6999-45f5-a2f6-9d7f31ed2f28 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:35.875836 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca70d4e7-6999-45f5-a2f6-9d7f31ed2f28 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:35.906026 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ca70d4e7-6999-45f5-a2f6-9d7f31ed2f28 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042015 Oct 15 03:44:35.910023 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 412/844] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:35 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:44:35.921135 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9c16f3c3-024a-46c8-83d7-23618c535b1c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:35.928334 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9c16f3c3-024a-46c8-83d7-23618c535b1c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.085918 Oct 15 03:44:35.928887 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 433/845] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:35 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:36.312742 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6dce31a6-c2ec-4814-9045-8621ce728407 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:36.313348 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6dce31a6-c2ec-4814-9045-8621ce728407 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:36.319068 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6dce31a6-c2ec-4814-9045-8621ce728407 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:36.319510 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6dce31a6-c2ec-4814-9045-8621ce728407 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:36.320312 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6dce31a6-c2ec-4814-9045-8621ce728407 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:36.320773 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6dce31a6-c2ec-4814-9045-8621ce728407 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:36.403311 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2e1f937c-dca6-4d6f-b667-2ccf9f12a213 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:36.404268 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2e1f937c-dca6-4d6f-b667-2ccf9f12a213 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:36.410040 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2e1f937c-dca6-4d6f-b667-2ccf9f12a213 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:36.410487 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2e1f937c-dca6-4d6f-b667-2ccf9f12a213 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:36.411244 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2e1f937c-dca6-4d6f-b667-2ccf9f12a213 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:36.411701 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2e1f937c-dca6-4d6f-b667-2ccf9f12a213 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:36.436041 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6dce31a6-c2ec-4814-9045-8621ce728407 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:36.440878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2e1f937c-dca6-4d6f-b667-2ccf9f12a213 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041195 Oct 15 03:44:36.441429 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 434/846] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:36 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:44:36.443196 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6dce31a6-c2ec-4814-9045-8621ce728407 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.134105 Oct 15 03:44:36.443764 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 413/847] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:36 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:36.917444 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cd8058c4-81cb-42d5-8bbe-6c4d6926e829 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:36.918342 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cd8058c4-81cb-42d5-8bbe-6c4d6926e829 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:36.924150 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd8058c4-81cb-42d5-8bbe-6c4d6926e829 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:36.924597 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd8058c4-81cb-42d5-8bbe-6c4d6926e829 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:36.925351 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd8058c4-81cb-42d5-8bbe-6c4d6926e829 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:36.925781 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd8058c4-81cb-42d5-8bbe-6c4d6926e829 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:36.944919 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0db051bf-1ef5-4416-9bbe-ff6240f58747 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:36.945527 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0db051bf-1ef5-4416-9bbe-ff6240f58747 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:36.951145 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0db051bf-1ef5-4416-9bbe-ff6240f58747 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:36.951586 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0db051bf-1ef5-4416-9bbe-ff6240f58747 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:36.952373 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0db051bf-1ef5-4416-9bbe-ff6240f58747 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:36.952800 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0db051bf-1ef5-4416-9bbe-ff6240f58747 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:36.953437 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cd8058c4-81cb-42d5-8bbe-6c4d6926e829 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040293 Oct 15 03:44:36.953980 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 435/848] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:36 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:37.010936 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0db051bf-1ef5-4416-9bbe-ff6240f58747 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:37.018007 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0db051bf-1ef5-4416-9bbe-ff6240f58747 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.076645 Oct 15 03:44:37.018573 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 414/849] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:36 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:44:37.452891 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f7ba0159-332f-40fc-b747-15b868adeb7c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:37.453796 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f7ba0159-332f-40fc-b747-15b868adeb7c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:37.459723 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f7ba0159-332f-40fc-b747-15b868adeb7c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:37.460094 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f7ba0159-332f-40fc-b747-15b868adeb7c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:37.460986 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b3c8c15b-a676-4c14-a87f-cc8f74332b35 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:37.461118 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f7ba0159-332f-40fc-b747-15b868adeb7c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:37.461544 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f7ba0159-332f-40fc-b747-15b868adeb7c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:37.461725 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b3c8c15b-a676-4c14-a87f-cc8f74332b35 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:37.467563 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b3c8c15b-a676-4c14-a87f-cc8f74332b35 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:37.468038 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b3c8c15b-a676-4c14-a87f-cc8f74332b35 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:37.468794 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b3c8c15b-a676-4c14-a87f-cc8f74332b35 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:37.469223 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b3c8c15b-a676-4c14-a87f-cc8f74332b35 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:37.490936 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f7ba0159-332f-40fc-b747-15b868adeb7c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041757 Oct 15 03:44:37.491500 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 436/850] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:37 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:44:37.589208 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b3c8c15b-a676-4c14-a87f-cc8f74332b35 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:37.596365 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b3c8c15b-a676-4c14-a87f-cc8f74332b35 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.139452 Oct 15 03:44:37.596922 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 415/851] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:37 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:37.965224 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9d740db8-6aea-4323-bb3e-7627050c7bdd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:37.966037 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9d740db8-6aea-4323-bb3e-7627050c7bdd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:37.971775 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d740db8-6aea-4323-bb3e-7627050c7bdd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:37.972221 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d740db8-6aea-4323-bb3e-7627050c7bdd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:37.972967 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d740db8-6aea-4323-bb3e-7627050c7bdd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:37.973393 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d740db8-6aea-4323-bb3e-7627050c7bdd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:38.001763 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9d740db8-6aea-4323-bb3e-7627050c7bdd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040467 Oct 15 03:44:38.002292 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 437/852] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:37 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:38.034510 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8cba1140-85ff-4c8c-9a87-bd2cbb5c57ae tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:38.035112 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8cba1140-85ff-4c8c-9a87-bd2cbb5c57ae tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:38.041278 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8cba1140-85ff-4c8c-9a87-bd2cbb5c57ae tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:38.041719 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8cba1140-85ff-4c8c-9a87-bd2cbb5c57ae tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:38.042462 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8cba1140-85ff-4c8c-9a87-bd2cbb5c57ae tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:38.042887 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8cba1140-85ff-4c8c-9a87-bd2cbb5c57ae tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:38.099511 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8cba1140-85ff-4c8c-9a87-bd2cbb5c57ae tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:38.107254 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8cba1140-85ff-4c8c-9a87-bd2cbb5c57ae tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.076260 Oct 15 03:44:38.107842 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 416/853] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:38 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:38.502569 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-15d99d47-8197-4bab-a21d-214cf8b97f08 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:38.503411 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-15d99d47-8197-4bab-a21d-214cf8b97f08 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:38.509805 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-15d99d47-8197-4bab-a21d-214cf8b97f08 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:38.510246 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-15d99d47-8197-4bab-a21d-214cf8b97f08 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:38.510993 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-15d99d47-8197-4bab-a21d-214cf8b97f08 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:38.511417 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-15d99d47-8197-4bab-a21d-214cf8b97f08 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:38.538403 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-15d99d47-8197-4bab-a21d-214cf8b97f08 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039636 Oct 15 03:44:38.538920 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 438/854] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:38 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:38.613924 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-80dcc19d-7268-4d03-86e1-4977c489d0b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:38.614532 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-80dcc19d-7268-4d03-86e1-4977c489d0b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:38.620995 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-80dcc19d-7268-4d03-86e1-4977c489d0b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:38.621446 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-80dcc19d-7268-4d03-86e1-4977c489d0b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:38.622211 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-80dcc19d-7268-4d03-86e1-4977c489d0b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:38.622644 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-80dcc19d-7268-4d03-86e1-4977c489d0b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:38.737356 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-80dcc19d-7268-4d03-86e1-4977c489d0b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:38.745058 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-80dcc19d-7268-4d03-86e1-4977c489d0b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.134743 Oct 15 03:44:38.748887 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 417/855] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:38 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:39.013147 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a3255c33-c594-4d22-956d-e43f60f53ec0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:39.014047 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a3255c33-c594-4d22-956d-e43f60f53ec0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:39.019785 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a3255c33-c594-4d22-956d-e43f60f53ec0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:39.020255 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a3255c33-c594-4d22-956d-e43f60f53ec0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:39.020998 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a3255c33-c594-4d22-956d-e43f60f53ec0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:39.021421 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a3255c33-c594-4d22-956d-e43f60f53ec0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:39.049717 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a3255c33-c594-4d22-956d-e43f60f53ec0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040365 Oct 15 03:44:39.050244 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 439/856] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:39 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:39.123462 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-97d0c8e6-03aa-45b4-8684-67278d8e7fca tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:39.124126 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-97d0c8e6-03aa-45b4-8684-67278d8e7fca tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:39.129788 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-97d0c8e6-03aa-45b4-8684-67278d8e7fca tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:39.130231 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-97d0c8e6-03aa-45b4-8684-67278d8e7fca tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:39.130991 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-97d0c8e6-03aa-45b4-8684-67278d8e7fca tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:39.131421 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-97d0c8e6-03aa-45b4-8684-67278d8e7fca tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:39.191103 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-97d0c8e6-03aa-45b4-8684-67278d8e7fca tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:39.198370 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-97d0c8e6-03aa-45b4-8684-67278d8e7fca tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.078491 Oct 15 03:44:39.198926 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 418/857] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:39 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:39.549161 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-18cea55d-7435-4dd1-8262-660e015469ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:39.550061 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-18cea55d-7435-4dd1-8262-660e015469ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:39.555974 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18cea55d-7435-4dd1-8262-660e015469ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:39.556426 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18cea55d-7435-4dd1-8262-660e015469ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:39.557185 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18cea55d-7435-4dd1-8262-660e015469ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:39.557620 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18cea55d-7435-4dd1-8262-660e015469ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:39.585661 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-18cea55d-7435-4dd1-8262-660e015469ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040039 Oct 15 03:44:39.586195 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 440/858] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:39 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:39.761664 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-871188cd-f988-4b42-bd10-643d2ac67458 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:39.762275 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-871188cd-f988-4b42-bd10-643d2ac67458 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:39.767969 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-871188cd-f988-4b42-bd10-643d2ac67458 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:39.768420 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-871188cd-f988-4b42-bd10-643d2ac67458 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:39.769174 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-871188cd-f988-4b42-bd10-643d2ac67458 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:39.769606 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-871188cd-f988-4b42-bd10-643d2ac67458 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:39.892874 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-871188cd-f988-4b42-bd10-643d2ac67458 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:39.900585 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-871188cd-f988-4b42-bd10-643d2ac67458 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.142442 Oct 15 03:44:39.901165 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 419/859] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:39 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:40.061260 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3ca6dc05-cec5-4f22-b9ea-a1f500f3953d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:40.062168 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3ca6dc05-cec5-4f22-b9ea-a1f500f3953d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:40.067951 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3ca6dc05-cec5-4f22-b9ea-a1f500f3953d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:40.068408 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3ca6dc05-cec5-4f22-b9ea-a1f500f3953d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:40.069169 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3ca6dc05-cec5-4f22-b9ea-a1f500f3953d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:40.069608 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3ca6dc05-cec5-4f22-b9ea-a1f500f3953d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:40.098472 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3ca6dc05-cec5-4f22-b9ea-a1f500f3953d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041064 Oct 15 03:44:40.099006 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 441/860] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:40 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:40.214815 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a08ea20c-d6f6-4051-9cb0-b38916069bfd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:40.215452 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a08ea20c-d6f6-4051-9cb0-b38916069bfd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:40.221891 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a08ea20c-d6f6-4051-9cb0-b38916069bfd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:40.222333 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a08ea20c-d6f6-4051-9cb0-b38916069bfd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:40.223089 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a08ea20c-d6f6-4051-9cb0-b38916069bfd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:40.223524 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a08ea20c-d6f6-4051-9cb0-b38916069bfd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:40.281270 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-a08ea20c-d6f6-4051-9cb0-b38916069bfd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:40.288453 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a08ea20c-d6f6-4051-9cb0-b38916069bfd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077275 Oct 15 03:44:40.289009 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 420/861] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:40 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:40.597867 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8430236d-b5ca-4a31-ba63-4d82d1195340 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:40.598806 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8430236d-b5ca-4a31-ba63-4d82d1195340 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:40.604830 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8430236d-b5ca-4a31-ba63-4d82d1195340 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:40.605280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8430236d-b5ca-4a31-ba63-4d82d1195340 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:40.606038 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8430236d-b5ca-4a31-ba63-4d82d1195340 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:40.606468 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8430236d-b5ca-4a31-ba63-4d82d1195340 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:40.637907 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8430236d-b5ca-4a31-ba63-4d82d1195340 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044742 Oct 15 03:44:40.638446 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 442/862] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:40 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:40.918773 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d4ee681c-6577-4e64-a9b9-8423ecd79943 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:40.919301 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d4ee681c-6577-4e64-a9b9-8423ecd79943 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:40.925608 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d4ee681c-6577-4e64-a9b9-8423ecd79943 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:40.926060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d4ee681c-6577-4e64-a9b9-8423ecd79943 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:40.926834 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d4ee681c-6577-4e64-a9b9-8423ecd79943 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:40.927254 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d4ee681c-6577-4e64-a9b9-8423ecd79943 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:41.045967 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d4ee681c-6577-4e64-a9b9-8423ecd79943 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:41.053817 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d4ee681c-6577-4e64-a9b9-8423ecd79943 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.140092 Oct 15 03:44:41.054384 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 421/863] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:40 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:41.109746 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5c4bcbc1-7f50-4baf-b272-669ec3ad1a90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:41.111284 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5c4bcbc1-7f50-4baf-b272-669ec3ad1a90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:41.117289 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c4bcbc1-7f50-4baf-b272-669ec3ad1a90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:41.117739 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c4bcbc1-7f50-4baf-b272-669ec3ad1a90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:41.119209 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c4bcbc1-7f50-4baf-b272-669ec3ad1a90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:41.119641 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c4bcbc1-7f50-4baf-b272-669ec3ad1a90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:41.147509 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5c4bcbc1-7f50-4baf-b272-669ec3ad1a90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041588 Oct 15 03:44:41.148069 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 443/864] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:41 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:41.304163 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-722112eb-8030-4e53-a23f-ffe4629d8778 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:41.304772 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-722112eb-8030-4e53-a23f-ffe4629d8778 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:41.310571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-722112eb-8030-4e53-a23f-ffe4629d8778 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:41.311017 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-722112eb-8030-4e53-a23f-ffe4629d8778 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:41.311797 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-722112eb-8030-4e53-a23f-ffe4629d8778 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:41.312231 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-722112eb-8030-4e53-a23f-ffe4629d8778 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:41.372424 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-722112eb-8030-4e53-a23f-ffe4629d8778 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:41.379558 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-722112eb-8030-4e53-a23f-ffe4629d8778 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.079004 Oct 15 03:44:41.380214 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 422/865] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:41 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:41.648376 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d4c6d352-e093-47a0-b6bb-7faec33c736c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:41.649211 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d4c6d352-e093-47a0-b6bb-7faec33c736c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:41.655145 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4c6d352-e093-47a0-b6bb-7faec33c736c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:41.655586 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4c6d352-e093-47a0-b6bb-7faec33c736c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:41.656366 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4c6d352-e093-47a0-b6bb-7faec33c736c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:41.656790 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4c6d352-e093-47a0-b6bb-7faec33c736c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:41.685050 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d4c6d352-e093-47a0-b6bb-7faec33c736c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040416 Oct 15 03:44:41.685575 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 444/866] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:41 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:42.071120 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-763cb61f-31c0-4b9a-ba93-ae8a98ff6ee2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:42.071744 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-763cb61f-31c0-4b9a-ba93-ae8a98ff6ee2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:42.082061 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-763cb61f-31c0-4b9a-ba93-ae8a98ff6ee2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:42.082061 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-763cb61f-31c0-4b9a-ba93-ae8a98ff6ee2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:42.082061 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-763cb61f-31c0-4b9a-ba93-ae8a98ff6ee2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:42.082061 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-763cb61f-31c0-4b9a-ba93-ae8a98ff6ee2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:42.159636 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c780909e-9e8e-4c08-8181-a4e33343378a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:42.161284 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c780909e-9e8e-4c08-8181-a4e33343378a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:42.168123 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c780909e-9e8e-4c08-8181-a4e33343378a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:42.168652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c780909e-9e8e-4c08-8181-a4e33343378a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:42.169492 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c780909e-9e8e-4c08-8181-a4e33343378a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:42.170156 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c780909e-9e8e-4c08-8181-a4e33343378a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:42.200821 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c780909e-9e8e-4c08-8181-a4e33343378a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045200 Oct 15 03:44:42.201386 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 445/867] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:42 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:44:42.205832 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-763cb61f-31c0-4b9a-ba93-ae8a98ff6ee2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:42.213933 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-763cb61f-31c0-4b9a-ba93-ae8a98ff6ee2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.146475 Oct 15 03:44:42.214486 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 423/868] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:42 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:42.395553 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-01ae40b1-d785-42b9-82c0-a64e74cc872d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:42.396097 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-01ae40b1-d785-42b9-82c0-a64e74cc872d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:42.402315 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-01ae40b1-d785-42b9-82c0-a64e74cc872d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:42.402766 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-01ae40b1-d785-42b9-82c0-a64e74cc872d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:42.403524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-01ae40b1-d785-42b9-82c0-a64e74cc872d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:42.403989 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-01ae40b1-d785-42b9-82c0-a64e74cc872d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:42.464064 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-01ae40b1-d785-42b9-82c0-a64e74cc872d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:42.471397 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-01ae40b1-d785-42b9-82c0-a64e74cc872d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.079623 Oct 15 03:44:42.471980 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 446/869] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:42 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:42.696119 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c11b4025-9a99-4cd4-b934-8a21ea7acaec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:42.696935 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c11b4025-9a99-4cd4-b934-8a21ea7acaec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:42.702995 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c11b4025-9a99-4cd4-b934-8a21ea7acaec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:42.703441 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c11b4025-9a99-4cd4-b934-8a21ea7acaec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:42.704218 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c11b4025-9a99-4cd4-b934-8a21ea7acaec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:42.704649 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c11b4025-9a99-4cd4-b934-8a21ea7acaec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:42.733925 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c11b4025-9a99-4cd4-b934-8a21ea7acaec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041682 Oct 15 03:44:42.734459 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 424/870] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:42 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:43.212792 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d37d4e36-5940-4049-a80d-b881e0c054b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:43.213689 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d37d4e36-5940-4049-a80d-b881e0c054b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:43.219360 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d37d4e36-5940-4049-a80d-b881e0c054b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:43.219828 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d37d4e36-5940-4049-a80d-b881e0c054b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:43.220579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d37d4e36-5940-4049-a80d-b881e0c054b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:43.220996 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d37d4e36-5940-4049-a80d-b881e0c054b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:43.231465 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-68a3e3ec-7ce2-4135-9f10-ae8dc756835c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:43.232153 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-68a3e3ec-7ce2-4135-9f10-ae8dc756835c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:43.237934 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-68a3e3ec-7ce2-4135-9f10-ae8dc756835c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:43.238384 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-68a3e3ec-7ce2-4135-9f10-ae8dc756835c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:43.239191 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-68a3e3ec-7ce2-4135-9f10-ae8dc756835c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:43.239564 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-68a3e3ec-7ce2-4135-9f10-ae8dc756835c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:43.250454 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d37d4e36-5940-4049-a80d-b881e0c054b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042141 Oct 15 03:44:43.251450 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 447/871] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:43 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:43.356618 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-68a3e3ec-7ce2-4135-9f10-ae8dc756835c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:43.363762 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-68a3e3ec-7ce2-4135-9f10-ae8dc756835c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.135892 Oct 15 03:44:43.364325 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 425/872] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:43 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:44:43.488035 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-76e5797f-0878-40b6-af29-8e4eea61115b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:43.488564 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-76e5797f-0878-40b6-af29-8e4eea61115b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:43.494712 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-76e5797f-0878-40b6-af29-8e4eea61115b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:43.495152 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-76e5797f-0878-40b6-af29-8e4eea61115b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:43.495945 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-76e5797f-0878-40b6-af29-8e4eea61115b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:43.496377 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-76e5797f-0878-40b6-af29-8e4eea61115b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:43.555645 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-76e5797f-0878-40b6-af29-8e4eea61115b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:43.563256 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-76e5797f-0878-40b6-af29-8e4eea61115b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.078874 Oct 15 03:44:43.563837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 448/873] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:43 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:43.745551 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e10316a2-26ce-46a1-a02d-3661d65b8734 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:43.746471 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e10316a2-26ce-46a1-a02d-3661d65b8734 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:43.752119 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e10316a2-26ce-46a1-a02d-3661d65b8734 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:43.752568 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e10316a2-26ce-46a1-a02d-3661d65b8734 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:43.753331 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e10316a2-26ce-46a1-a02d-3661d65b8734 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:43.753762 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e10316a2-26ce-46a1-a02d-3661d65b8734 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:43.782018 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e10316a2-26ce-46a1-a02d-3661d65b8734 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040753 Oct 15 03:44:43.782554 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 426/874] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:43 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:44.261819 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3acd661d-314a-4316-9984-548ad77d820a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:44.262724 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3acd661d-314a-4316-9984-548ad77d820a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:44.268499 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3acd661d-314a-4316-9984-548ad77d820a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:44.268944 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3acd661d-314a-4316-9984-548ad77d820a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:44.269698 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3acd661d-314a-4316-9984-548ad77d820a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:44.270138 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3acd661d-314a-4316-9984-548ad77d820a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:44.298720 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3acd661d-314a-4316-9984-548ad77d820a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040710 Oct 15 03:44:44.299249 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 449/875] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:44 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:44.380430 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5617cea8-ffb0-4958-b041-d894afb79756 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:44.381036 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5617cea8-ffb0-4958-b041-d894afb79756 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:44.386746 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5617cea8-ffb0-4958-b041-d894afb79756 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:44.387137 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5617cea8-ffb0-4958-b041-d894afb79756 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:44.387991 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5617cea8-ffb0-4958-b041-d894afb79756 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:44.388431 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5617cea8-ffb0-4958-b041-d894afb79756 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:44.503383 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5617cea8-ffb0-4958-b041-d894afb79756 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:44.511064 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5617cea8-ffb0-4958-b041-d894afb79756 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.134264 Oct 15 03:44:44.511619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 427/876] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:44 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:44.579983 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fdc95f7d-6923-4925-a2aa-030ea82d12d0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:44.580595 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fdc95f7d-6923-4925-a2aa-030ea82d12d0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:44.586884 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fdc95f7d-6923-4925-a2aa-030ea82d12d0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:44.587335 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fdc95f7d-6923-4925-a2aa-030ea82d12d0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:44.589342 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fdc95f7d-6923-4925-a2aa-030ea82d12d0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:44.589871 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fdc95f7d-6923-4925-a2aa-030ea82d12d0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:44.646651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fdc95f7d-6923-4925-a2aa-030ea82d12d0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:44.654475 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fdc95f7d-6923-4925-a2aa-030ea82d12d0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.078095 Oct 15 03:44:44.655025 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 450/877] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:44 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:44.885303 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2198f1f6-7777-49fd-9595-f5a70df7239c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:44.886541 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2198f1f6-7777-49fd-9595-f5a70df7239c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:44.892281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2198f1f6-7777-49fd-9595-f5a70df7239c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:44.892719 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2198f1f6-7777-49fd-9595-f5a70df7239c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:44.893463 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2198f1f6-7777-49fd-9595-f5a70df7239c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:44.893886 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2198f1f6-7777-49fd-9595-f5a70df7239c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:44.922424 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2198f1f6-7777-49fd-9595-f5a70df7239c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132905 Oct 15 03:44:44.922911 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 428/878] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:44 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:45.310361 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-64882b59-b94e-4f66-a9b9-58179c4ae535 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:45.311263 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-64882b59-b94e-4f66-a9b9-58179c4ae535 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:45.317191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64882b59-b94e-4f66-a9b9-58179c4ae535 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:45.317629 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64882b59-b94e-4f66-a9b9-58179c4ae535 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:45.318378 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64882b59-b94e-4f66-a9b9-58179c4ae535 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:45.318804 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64882b59-b94e-4f66-a9b9-58179c4ae535 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:45.348237 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-64882b59-b94e-4f66-a9b9-58179c4ae535 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041955 Oct 15 03:44:45.348779 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 451/879] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:45 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:45.527625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-88be2560-713a-450e-8058-b3bd9bf75007 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:45.528177 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-88be2560-713a-450e-8058-b3bd9bf75007 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:45.533854 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-88be2560-713a-450e-8058-b3bd9bf75007 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:45.534294 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-88be2560-713a-450e-8058-b3bd9bf75007 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:45.535037 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-88be2560-713a-450e-8058-b3bd9bf75007 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:45.535462 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-88be2560-713a-450e-8058-b3bd9bf75007 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:45.652809 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-88be2560-713a-450e-8058-b3bd9bf75007 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:45.659816 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-88be2560-713a-450e-8058-b3bd9bf75007 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.136490 Oct 15 03:44:45.660371 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 429/880] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:45 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:45.669952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8257f2b1-02bf-4efc-adf7-9818b48cf62d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:45.670561 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8257f2b1-02bf-4efc-adf7-9818b48cf62d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:45.676173 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8257f2b1-02bf-4efc-adf7-9818b48cf62d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:45.676624 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8257f2b1-02bf-4efc-adf7-9818b48cf62d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:45.677380 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8257f2b1-02bf-4efc-adf7-9818b48cf62d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:45.677816 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8257f2b1-02bf-4efc-adf7-9818b48cf62d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:45.735436 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8257f2b1-02bf-4efc-adf7-9818b48cf62d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:45.742476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8257f2b1-02bf-4efc-adf7-9818b48cf62d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.076171 Oct 15 03:44:45.743023 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 452/881] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:45 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:45.934143 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-16e91045-98cc-4ad4-a7ba-08e1b8b1fb2e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:45.934962 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-16e91045-98cc-4ad4-a7ba-08e1b8b1fb2e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:45.940616 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-16e91045-98cc-4ad4-a7ba-08e1b8b1fb2e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:45.941057 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-16e91045-98cc-4ad4-a7ba-08e1b8b1fb2e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:45.941803 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-16e91045-98cc-4ad4-a7ba-08e1b8b1fb2e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:45.942230 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-16e91045-98cc-4ad4-a7ba-08e1b8b1fb2e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:45.971307 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-16e91045-98cc-4ad4-a7ba-08e1b8b1fb2e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041489 Oct 15 03:44:45.971872 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 430/882] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:45 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:46.359328 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-13e332c8-21eb-43fe-9127-4f62e0a1cedb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:46.360253 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-13e332c8-21eb-43fe-9127-4f62e0a1cedb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:46.365956 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-13e332c8-21eb-43fe-9127-4f62e0a1cedb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:46.366396 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-13e332c8-21eb-43fe-9127-4f62e0a1cedb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:46.367144 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-13e332c8-21eb-43fe-9127-4f62e0a1cedb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:46.367569 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-13e332c8-21eb-43fe-9127-4f62e0a1cedb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:46.395395 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-13e332c8-21eb-43fe-9127-4f62e0a1cedb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039931 Oct 15 03:44:46.395964 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 453/883] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:46 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:46.675759 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c4c29613-2c8c-457b-a5e1-36754d18da47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:46.676289 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c4c29613-2c8c-457b-a5e1-36754d18da47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:46.682007 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c4c29613-2c8c-457b-a5e1-36754d18da47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:46.682439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c4c29613-2c8c-457b-a5e1-36754d18da47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:46.683193 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c4c29613-2c8c-457b-a5e1-36754d18da47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:46.683626 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c4c29613-2c8c-457b-a5e1-36754d18da47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:46.759511 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9e9fddd6-f1e1-43bb-8ebe-a3f94a0bfd84 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:46.761015 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9e9fddd6-f1e1-43bb-8ebe-a3f94a0bfd84 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:46.766397 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9e9fddd6-f1e1-43bb-8ebe-a3f94a0bfd84 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:46.766837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9e9fddd6-f1e1-43bb-8ebe-a3f94a0bfd84 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:46.767589 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9e9fddd6-f1e1-43bb-8ebe-a3f94a0bfd84 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:46.768043 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9e9fddd6-f1e1-43bb-8ebe-a3f94a0bfd84 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:46.800749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c4c29613-2c8c-457b-a5e1-36754d18da47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:46.807858 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c4c29613-2c8c-457b-a5e1-36754d18da47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.135846 Oct 15 03:44:46.808657 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 431/884] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:46 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:46.828373 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9e9fddd6-f1e1-43bb-8ebe-a3f94a0bfd84 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:46.835790 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9e9fddd6-f1e1-43bb-8ebe-a3f94a0bfd84 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.079744 Oct 15 03:44:46.836335 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 454/885] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:46 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:44:46.982468 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0da893bc-36b2-4f40-a9fc-c8bebffaf5bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:46.983300 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0da893bc-36b2-4f40-a9fc-c8bebffaf5bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:46.989095 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0da893bc-36b2-4f40-a9fc-c8bebffaf5bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:46.989540 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0da893bc-36b2-4f40-a9fc-c8bebffaf5bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:46.990297 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0da893bc-36b2-4f40-a9fc-c8bebffaf5bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:46.990730 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0da893bc-36b2-4f40-a9fc-c8bebffaf5bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:47.021146 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0da893bc-36b2-4f40-a9fc-c8bebffaf5bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042539 Oct 15 03:44:47.021695 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 432/886] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:46 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:47.406645 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f8bdc095-239a-4687-b81b-2d658b821f8f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:47.407549 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f8bdc095-239a-4687-b81b-2d658b821f8f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:47.413315 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f8bdc095-239a-4687-b81b-2d658b821f8f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:47.413754 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f8bdc095-239a-4687-b81b-2d658b821f8f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:47.414504 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f8bdc095-239a-4687-b81b-2d658b821f8f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:47.414928 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f8bdc095-239a-4687-b81b-2d658b821f8f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:47.442656 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f8bdc095-239a-4687-b81b-2d658b821f8f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039778 Oct 15 03:44:47.443182 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 455/887] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:47 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:47.824939 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-eda4dac1-64a7-4d01-a9b5-17936aec422d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:47.825539 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-eda4dac1-64a7-4d01-a9b5-17936aec422d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:47.831170 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eda4dac1-64a7-4d01-a9b5-17936aec422d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:47.831612 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eda4dac1-64a7-4d01-a9b5-17936aec422d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:47.832393 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eda4dac1-64a7-4d01-a9b5-17936aec422d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:47.832821 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eda4dac1-64a7-4d01-a9b5-17936aec422d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:47.852465 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e0aa04d4-e7cc-424a-9728-fbb5dcce9fd2 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:47.853061 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e0aa04d4-e7cc-424a-9728-fbb5dcce9fd2 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:47.859082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0aa04d4-e7cc-424a-9728-fbb5dcce9fd2 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:47.859522 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0aa04d4-e7cc-424a-9728-fbb5dcce9fd2 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:47.860301 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0aa04d4-e7cc-424a-9728-fbb5dcce9fd2 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:47.860730 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0aa04d4-e7cc-424a-9728-fbb5dcce9fd2 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:47.922389 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e0aa04d4-e7cc-424a-9728-fbb5dcce9fd2 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:47.929466 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e0aa04d4-e7cc-424a-9728-fbb5dcce9fd2 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.080508 Oct 15 03:44:47.930017 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 456/888] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:47 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:44:47.975394 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-eda4dac1-64a7-4d01-a9b5-17936aec422d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:47.983112 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-eda4dac1-64a7-4d01-a9b5-17936aec422d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.162268 Oct 15 03:44:47.983711 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 433/889] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:47 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:48.032897 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ee2a7b7d-6f98-418e-b5cb-4b398d45df03 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:48.033798 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ee2a7b7d-6f98-418e-b5cb-4b398d45df03 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:48.039774 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ee2a7b7d-6f98-418e-b5cb-4b398d45df03 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:48.040228 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ee2a7b7d-6f98-418e-b5cb-4b398d45df03 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:48.041671 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ee2a7b7d-6f98-418e-b5cb-4b398d45df03 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:48.042103 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ee2a7b7d-6f98-418e-b5cb-4b398d45df03 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:48.070639 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ee2a7b7d-6f98-418e-b5cb-4b398d45df03 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041563 Oct 15 03:44:48.071176 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 457/890] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:48 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:48.454364 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9652ae23-7f95-493c-8c6e-d0947321f17d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:48.455226 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9652ae23-7f95-493c-8c6e-d0947321f17d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:48.461479 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9652ae23-7f95-493c-8c6e-d0947321f17d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:48.461931 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9652ae23-7f95-493c-8c6e-d0947321f17d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:48.463316 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9652ae23-7f95-493c-8c6e-d0947321f17d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:48.463804 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9652ae23-7f95-493c-8c6e-d0947321f17d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:48.491393 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9652ae23-7f95-493c-8c6e-d0947321f17d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040993 Oct 15 03:44:48.491987 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 434/891] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:48 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:48.945765 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-941cc481-0c37-46f7-bbb9-e70bbc6b50e4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:48.946369 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-941cc481-0c37-46f7-bbb9-e70bbc6b50e4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:48.952793 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-941cc481-0c37-46f7-bbb9-e70bbc6b50e4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:48.953233 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-941cc481-0c37-46f7-bbb9-e70bbc6b50e4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:48.953979 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-941cc481-0c37-46f7-bbb9-e70bbc6b50e4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:48.954413 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-941cc481-0c37-46f7-bbb9-e70bbc6b50e4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:49.000376 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3a6c7d14-7072-4a45-9de4-0d77fddb1f88 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:49.001003 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3a6c7d14-7072-4a45-9de4-0d77fddb1f88 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:49.007054 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a6c7d14-7072-4a45-9de4-0d77fddb1f88 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:49.007500 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a6c7d14-7072-4a45-9de4-0d77fddb1f88 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:49.008281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a6c7d14-7072-4a45-9de4-0d77fddb1f88 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:49.008709 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a6c7d14-7072-4a45-9de4-0d77fddb1f88 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:49.012490 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-941cc481-0c37-46f7-bbb9-e70bbc6b50e4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:49.019747 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-941cc481-0c37-46f7-bbb9-e70bbc6b50e4 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077568 Oct 15 03:44:49.020304 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 458/892] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:48 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:49.081994 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7a0dc147-c4bb-48e8-8842-2f9622c44e1e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:49.082932 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7a0dc147-c4bb-48e8-8842-2f9622c44e1e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:49.088790 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7a0dc147-c4bb-48e8-8842-2f9622c44e1e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:49.089230 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7a0dc147-c4bb-48e8-8842-2f9622c44e1e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:49.089967 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7a0dc147-c4bb-48e8-8842-2f9622c44e1e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:49.090393 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7a0dc147-c4bb-48e8-8842-2f9622c44e1e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:49.120364 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7a0dc147-c4bb-48e8-8842-2f9622c44e1e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042052 Oct 15 03:44:49.120921 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 459/893] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:49 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:44:49.131043 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3a6c7d14-7072-4a45-9de4-0d77fddb1f88 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:49.138206 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3a6c7d14-7072-4a45-9de4-0d77fddb1f88 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.141424 Oct 15 03:44:49.138758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 435/894] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:48 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:44:49.502319 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f372504f-7439-48ec-bb22-8e20066603b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:49.503142 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f372504f-7439-48ec-bb22-8e20066603b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:49.509014 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f372504f-7439-48ec-bb22-8e20066603b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:49.509461 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f372504f-7439-48ec-bb22-8e20066603b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:49.510223 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f372504f-7439-48ec-bb22-8e20066603b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:49.510653 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f372504f-7439-48ec-bb22-8e20066603b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:49.538516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f372504f-7439-48ec-bb22-8e20066603b1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040049 Oct 15 03:44:49.539043 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 460/895] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:49 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:50.036286 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-062f51eb-2dd8-46a9-9c7c-843026fe2d9f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:50.036939 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-062f51eb-2dd8-46a9-9c7c-843026fe2d9f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:50.042638 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-062f51eb-2dd8-46a9-9c7c-843026fe2d9f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:50.043083 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-062f51eb-2dd8-46a9-9c7c-843026fe2d9f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:50.043871 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-062f51eb-2dd8-46a9-9c7c-843026fe2d9f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:50.044307 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-062f51eb-2dd8-46a9-9c7c-843026fe2d9f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:50.103744 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-062f51eb-2dd8-46a9-9c7c-843026fe2d9f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:50.110929 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-062f51eb-2dd8-46a9-9c7c-843026fe2d9f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.078321 Oct 15 03:44:50.111501 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 436/896] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:50 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:50.131386 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cf1dbc1d-326f-468d-a970-5eb3c8a3fa30 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:50.132331 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cf1dbc1d-326f-468d-a970-5eb3c8a3fa30 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:50.138838 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cf1dbc1d-326f-468d-a970-5eb3c8a3fa30 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:50.139284 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cf1dbc1d-326f-468d-a970-5eb3c8a3fa30 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:50.140174 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cf1dbc1d-326f-468d-a970-5eb3c8a3fa30 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:50.140495 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cf1dbc1d-326f-468d-a970-5eb3c8a3fa30 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:50.154479 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e1bef736-1179-4938-9ba2-46de7f34024a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:50.155086 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e1bef736-1179-4938-9ba2-46de7f34024a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:50.160920 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e1bef736-1179-4938-9ba2-46de7f34024a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:50.161372 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e1bef736-1179-4938-9ba2-46de7f34024a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:50.162135 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e1bef736-1179-4938-9ba2-46de7f34024a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:50.162571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e1bef736-1179-4938-9ba2-46de7f34024a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:50.169217 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cf1dbc1d-326f-468d-a970-5eb3c8a3fa30 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041503 Oct 15 03:44:50.169757 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 461/897] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:50 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:50.279183 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e1bef736-1179-4938-9ba2-46de7f34024a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:50.286414 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e1bef736-1179-4938-9ba2-46de7f34024a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.136036 Oct 15 03:44:50.286915 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 437/898] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:50 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:44:50.550734 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-214644e9-07af-4a17-b695-b03d35008542 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:50.551597 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-214644e9-07af-4a17-b695-b03d35008542 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:50.557858 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-214644e9-07af-4a17-b695-b03d35008542 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:50.558295 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-214644e9-07af-4a17-b695-b03d35008542 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:50.559039 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-214644e9-07af-4a17-b695-b03d35008542 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:50.559465 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-214644e9-07af-4a17-b695-b03d35008542 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:50.586552 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-214644e9-07af-4a17-b695-b03d35008542 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039666 Oct 15 03:44:50.587076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 462/899] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:50 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:51.127243 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f7bcf185-6e35-4f4d-b6ee-b440a78802f2 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:51.127875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f7bcf185-6e35-4f4d-b6ee-b440a78802f2 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:51.133793 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f7bcf185-6e35-4f4d-b6ee-b440a78802f2 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:51.134229 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f7bcf185-6e35-4f4d-b6ee-b440a78802f2 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:51.135619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f7bcf185-6e35-4f4d-b6ee-b440a78802f2 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:51.136070 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f7bcf185-6e35-4f4d-b6ee-b440a78802f2 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:51.180370 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ae9f1ddd-1fc8-4d0b-a06b-09e52295d315 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:51.181852 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ae9f1ddd-1fc8-4d0b-a06b-09e52295d315 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:51.187494 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ae9f1ddd-1fc8-4d0b-a06b-09e52295d315 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:51.187952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ae9f1ddd-1fc8-4d0b-a06b-09e52295d315 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:51.188717 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ae9f1ddd-1fc8-4d0b-a06b-09e52295d315 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:51.189149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ae9f1ddd-1fc8-4d0b-a06b-09e52295d315 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:51.193484 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f7bcf185-6e35-4f4d-b6ee-b440a78802f2 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:51.201124 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f7bcf185-6e35-4f4d-b6ee-b440a78802f2 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077505 Oct 15 03:44:51.201683 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 438/900] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:51 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:51.218171 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ae9f1ddd-1fc8-4d0b-a06b-09e52295d315 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041455 Oct 15 03:44:51.218721 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 463/901] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:51 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:44:51.302867 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-771a9c6a-e9d5-4041-a940-e4de85c58328 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:51.303502 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-771a9c6a-e9d5-4041-a940-e4de85c58328 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:51.309920 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-771a9c6a-e9d5-4041-a940-e4de85c58328 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:51.310357 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-771a9c6a-e9d5-4041-a940-e4de85c58328 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:51.311101 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-771a9c6a-e9d5-4041-a940-e4de85c58328 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:51.311526 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-771a9c6a-e9d5-4041-a940-e4de85c58328 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:51.429257 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-771a9c6a-e9d5-4041-a940-e4de85c58328 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:51.436955 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-771a9c6a-e9d5-4041-a940-e4de85c58328 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.137702 Oct 15 03:44:51.437512 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 439/902] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:51 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:51.597090 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f566a872-ff4a-4fe7-99f0-bc6d6f908645 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:51.597987 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f566a872-ff4a-4fe7-99f0-bc6d6f908645 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:51.604197 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f566a872-ff4a-4fe7-99f0-bc6d6f908645 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:51.604639 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f566a872-ff4a-4fe7-99f0-bc6d6f908645 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:51.605398 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f566a872-ff4a-4fe7-99f0-bc6d6f908645 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:51.605830 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f566a872-ff4a-4fe7-99f0-bc6d6f908645 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:51.633684 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f566a872-ff4a-4fe7-99f0-bc6d6f908645 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040308 Oct 15 03:44:51.634208 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 464/903] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:51 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:52.218362 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a65be39a-6222-4768-960e-1b3b4a78d82c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:52.218972 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a65be39a-6222-4768-960e-1b3b4a78d82c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:52.225083 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a65be39a-6222-4768-960e-1b3b4a78d82c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:52.225539 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a65be39a-6222-4768-960e-1b3b4a78d82c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:52.226298 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a65be39a-6222-4768-960e-1b3b4a78d82c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:52.226736 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a65be39a-6222-4768-960e-1b3b4a78d82c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:52.229122 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fba5c56d-b27b-43e5-8e56-829985a5184b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:52.230036 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fba5c56d-b27b-43e5-8e56-829985a5184b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:52.235823 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fba5c56d-b27b-43e5-8e56-829985a5184b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:52.236278 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fba5c56d-b27b-43e5-8e56-829985a5184b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:52.237051 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fba5c56d-b27b-43e5-8e56-829985a5184b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:52.237486 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fba5c56d-b27b-43e5-8e56-829985a5184b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:52.266694 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fba5c56d-b27b-43e5-8e56-829985a5184b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041284 Oct 15 03:44:52.267246 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 465/904] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:52 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:44:52.287099 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-a65be39a-6222-4768-960e-1b3b4a78d82c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:52.294349 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a65be39a-6222-4768-960e-1b3b4a78d82c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.079919 Oct 15 03:44:52.294897 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 440/905] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:52 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:52.453842 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7074e1f6-f4d6-4a5d-9a4d-ab83098e013a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:52.454370 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7074e1f6-f4d6-4a5d-9a4d-ab83098e013a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:52.460469 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7074e1f6-f4d6-4a5d-9a4d-ab83098e013a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:52.460911 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7074e1f6-f4d6-4a5d-9a4d-ab83098e013a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:52.461669 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7074e1f6-f4d6-4a5d-9a4d-ab83098e013a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:52.462099 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7074e1f6-f4d6-4a5d-9a4d-ab83098e013a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:52.576251 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7074e1f6-f4d6-4a5d-9a4d-ab83098e013a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:52.583455 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7074e1f6-f4d6-4a5d-9a4d-ab83098e013a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.133317 Oct 15 03:44:52.584039 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 466/906] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:52 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:52.644953 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ed7411a9-f756-408d-916e-83c1123bf92d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:52.645916 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ed7411a9-f756-408d-916e-83c1123bf92d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:52.651541 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ed7411a9-f756-408d-916e-83c1123bf92d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:52.652020 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ed7411a9-f756-408d-916e-83c1123bf92d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:52.652785 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ed7411a9-f756-408d-916e-83c1123bf92d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:52.653225 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ed7411a9-f756-408d-916e-83c1123bf92d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:52.680828 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ed7411a9-f756-408d-916e-83c1123bf92d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039768 Oct 15 03:44:52.681864 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 441/907] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:52 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:53.278602 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-79219fc0-a068-41c1-b5d0-0f64162f9e76 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:53.279535 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-79219fc0-a068-41c1-b5d0-0f64162f9e76 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:53.285376 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-79219fc0-a068-41c1-b5d0-0f64162f9e76 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:53.285814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-79219fc0-a068-41c1-b5d0-0f64162f9e76 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:53.286560 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-79219fc0-a068-41c1-b5d0-0f64162f9e76 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:53.286986 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-79219fc0-a068-41c1-b5d0-0f64162f9e76 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:53.310029 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2e60a804-bed7-4e03-aa7b-3c692e1ac762 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:53.311215 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2e60a804-bed7-4e03-aa7b-3c692e1ac762 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:53.315305 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-79219fc0-a068-41c1-b5d0-0f64162f9e76 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040934 Oct 15 03:44:53.315869 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 467/908] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:53 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:53.316967 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2e60a804-bed7-4e03-aa7b-3c692e1ac762 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:53.317416 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2e60a804-bed7-4e03-aa7b-3c692e1ac762 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:53.318175 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2e60a804-bed7-4e03-aa7b-3c692e1ac762 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:53.318601 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2e60a804-bed7-4e03-aa7b-3c692e1ac762 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:53.380079 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2e60a804-bed7-4e03-aa7b-3c692e1ac762 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:53.387180 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2e60a804-bed7-4e03-aa7b-3c692e1ac762 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.080842 Oct 15 03:44:53.387759 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 442/909] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:53 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:44:53.600325 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e3cd8e91-8a09-4571-9656-d71e184e4b68 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:53.600929 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e3cd8e91-8a09-4571-9656-d71e184e4b68 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:53.606642 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3cd8e91-8a09-4571-9656-d71e184e4b68 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:53.607123 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3cd8e91-8a09-4571-9656-d71e184e4b68 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:53.607908 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3cd8e91-8a09-4571-9656-d71e184e4b68 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:53.608341 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3cd8e91-8a09-4571-9656-d71e184e4b68 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:53.692753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6f2c59df-0142-4ac4-94c3-fb5ebf89779a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:53.693651 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6f2c59df-0142-4ac4-94c3-fb5ebf89779a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:53.699958 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f2c59df-0142-4ac4-94c3-fb5ebf89779a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:53.700402 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f2c59df-0142-4ac4-94c3-fb5ebf89779a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:53.701162 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f2c59df-0142-4ac4-94c3-fb5ebf89779a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:53.701585 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f2c59df-0142-4ac4-94c3-fb5ebf89779a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:53.725717 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e3cd8e91-8a09-4571-9656-d71e184e4b68 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:53.730541 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6f2c59df-0142-4ac4-94c3-fb5ebf89779a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041552 Oct 15 03:44:53.731341 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 443/910] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:53 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:44:53.733480 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e3cd8e91-8a09-4571-9656-d71e184e4b68 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.136836 Oct 15 03:44:53.734181 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 468/911] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:53 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:54.326788 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-62e9c4f4-df17-4f56-a112-3eeb8a2a2c7b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:54.327720 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-62e9c4f4-df17-4f56-a112-3eeb8a2a2c7b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:54.333452 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-62e9c4f4-df17-4f56-a112-3eeb8a2a2c7b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:54.333895 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-62e9c4f4-df17-4f56-a112-3eeb8a2a2c7b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:54.334643 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-62e9c4f4-df17-4f56-a112-3eeb8a2a2c7b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:54.335102 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-62e9c4f4-df17-4f56-a112-3eeb8a2a2c7b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:54.364146 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-62e9c4f4-df17-4f56-a112-3eeb8a2a2c7b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041011 Oct 15 03:44:54.364692 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 444/912] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:54 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:54.404029 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bafef341-89a0-438e-a8e5-6b622de157ff tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:54.404568 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bafef341-89a0-438e-a8e5-6b622de157ff tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:54.410246 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bafef341-89a0-438e-a8e5-6b622de157ff tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:54.410688 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bafef341-89a0-438e-a8e5-6b622de157ff tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:54.411461 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bafef341-89a0-438e-a8e5-6b622de157ff tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:54.411921 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bafef341-89a0-438e-a8e5-6b622de157ff tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:54.472002 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bafef341-89a0-438e-a8e5-6b622de157ff tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:54.479110 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bafef341-89a0-438e-a8e5-6b622de157ff tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.078786 Oct 15 03:44:54.479652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 469/913] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:54 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:54.741917 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d00125b9-833e-4e0d-a5b2-43ca0c6b0c9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:54.742827 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d00125b9-833e-4e0d-a5b2-43ca0c6b0c9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:54.748998 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d00125b9-833e-4e0d-a5b2-43ca0c6b0c9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:54.749445 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d00125b9-833e-4e0d-a5b2-43ca0c6b0c9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:54.750207 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d00125b9-833e-4e0d-a5b2-43ca0c6b0c9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:54.750635 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d00125b9-833e-4e0d-a5b2-43ca0c6b0c9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:54.750744 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-598424e4-872f-4fa2-94f9-7c2bd52daab6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:54.751359 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-598424e4-872f-4fa2-94f9-7c2bd52daab6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:54.756938 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-598424e4-872f-4fa2-94f9-7c2bd52daab6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:54.757379 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-598424e4-872f-4fa2-94f9-7c2bd52daab6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:54.758122 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-598424e4-872f-4fa2-94f9-7c2bd52daab6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:54.758547 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-598424e4-872f-4fa2-94f9-7c2bd52daab6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:54.779142 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d00125b9-833e-4e0d-a5b2-43ca0c6b0c9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040983 Oct 15 03:44:54.779712 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 445/914] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:54 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:54.875740 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-598424e4-872f-4fa2-94f9-7c2bd52daab6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:54.882751 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-598424e4-872f-4fa2-94f9-7c2bd52daab6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.136118 Oct 15 03:44:54.883303 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 470/915] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:54 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:44:55.375876 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7018221f-0a7c-4dbc-b974-f0174a30d303 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:55.376786 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7018221f-0a7c-4dbc-b974-f0174a30d303 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:55.382566 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7018221f-0a7c-4dbc-b974-f0174a30d303 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:55.383011 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7018221f-0a7c-4dbc-b974-f0174a30d303 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:55.383794 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7018221f-0a7c-4dbc-b974-f0174a30d303 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:55.384230 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7018221f-0a7c-4dbc-b974-f0174a30d303 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:55.411991 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7018221f-0a7c-4dbc-b974-f0174a30d303 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039912 Oct 15 03:44:55.412522 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 446/916] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:55 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:55.497316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5c2c8132-8ee9-40f3-876d-c9df7ba984c7 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:55.498240 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5c2c8132-8ee9-40f3-876d-c9df7ba984c7 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:55.504287 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c2c8132-8ee9-40f3-876d-c9df7ba984c7 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:55.504733 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c2c8132-8ee9-40f3-876d-c9df7ba984c7 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:55.505490 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c2c8132-8ee9-40f3-876d-c9df7ba984c7 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:55.505921 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c2c8132-8ee9-40f3-876d-c9df7ba984c7 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:55.566304 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5c2c8132-8ee9-40f3-876d-c9df7ba984c7 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:55.573456 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5c2c8132-8ee9-40f3-876d-c9df7ba984c7 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.081725 Oct 15 03:44:55.574002 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 471/917] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:55 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:55.790606 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d3f8d152-6e3c-4d4b-b403-6d88f3a1077d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:55.791423 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d3f8d152-6e3c-4d4b-b403-6d88f3a1077d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:55.797092 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3f8d152-6e3c-4d4b-b403-6d88f3a1077d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:55.797530 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3f8d152-6e3c-4d4b-b403-6d88f3a1077d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:55.798277 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3f8d152-6e3c-4d4b-b403-6d88f3a1077d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:55.798701 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3f8d152-6e3c-4d4b-b403-6d88f3a1077d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:55.827324 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d3f8d152-6e3c-4d4b-b403-6d88f3a1077d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040470 Oct 15 03:44:55.827881 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 447/918] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:55 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:55.900870 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-84ab6553-8998-4fa3-a6fe-3527e5649ce2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:55.901527 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-84ab6553-8998-4fa3-a6fe-3527e5649ce2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:55.907339 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84ab6553-8998-4fa3-a6fe-3527e5649ce2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:55.907814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84ab6553-8998-4fa3-a6fe-3527e5649ce2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:55.908571 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84ab6553-8998-4fa3-a6fe-3527e5649ce2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:55.908998 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84ab6553-8998-4fa3-a6fe-3527e5649ce2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:56.024810 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-84ab6553-8998-4fa3-a6fe-3527e5649ce2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:56.032472 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-84ab6553-8998-4fa3-a6fe-3527e5649ce2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.135777 Oct 15 03:44:56.033025 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 472/919] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:55 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:56.424184 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-13cb712e-f635-48f8-8893-9b2f04e9335d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:56.425024 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-13cb712e-f635-48f8-8893-9b2f04e9335d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:56.430699 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13cb712e-f635-48f8-8893-9b2f04e9335d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:56.431659 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13cb712e-f635-48f8-8893-9b2f04e9335d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:56.432445 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13cb712e-f635-48f8-8893-9b2f04e9335d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:56.432878 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13cb712e-f635-48f8-8893-9b2f04e9335d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:56.462146 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-13cb712e-f635-48f8-8893-9b2f04e9335d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041915 Oct 15 03:44:56.462674 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 448/920] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:56 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:56.589925 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f7fa7c82-48f5-4a57-a024-67bd8cd1bf79 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:56.590529 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f7fa7c82-48f5-4a57-a024-67bd8cd1bf79 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:56.596168 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f7fa7c82-48f5-4a57-a024-67bd8cd1bf79 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:56.596610 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f7fa7c82-48f5-4a57-a024-67bd8cd1bf79 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:56.597349 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f7fa7c82-48f5-4a57-a024-67bd8cd1bf79 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:56.597773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f7fa7c82-48f5-4a57-a024-67bd8cd1bf79 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:56.655344 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f7fa7c82-48f5-4a57-a024-67bd8cd1bf79 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:56.662345 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f7fa7c82-48f5-4a57-a024-67bd8cd1bf79 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.076046 Oct 15 03:44:56.662893 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 473/921] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:56 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:56.838790 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c50cc824-5de5-460e-9795-8f5e06d3719a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:56.839707 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c50cc824-5de5-460e-9795-8f5e06d3719a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:56.845492 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c50cc824-5de5-460e-9795-8f5e06d3719a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:56.845941 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c50cc824-5de5-460e-9795-8f5e06d3719a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:56.846700 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c50cc824-5de5-460e-9795-8f5e06d3719a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:56.847144 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c50cc824-5de5-460e-9795-8f5e06d3719a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:56.875852 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c50cc824-5de5-460e-9795-8f5e06d3719a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041063 Oct 15 03:44:56.876387 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 449/922] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:56 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:57.048811 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c9c5c23f-e056-41a1-a4b5-caeb5ce14f51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:57.049411 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c9c5c23f-e056-41a1-a4b5-caeb5ce14f51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:57.055006 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c9c5c23f-e056-41a1-a4b5-caeb5ce14f51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:57.055448 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c9c5c23f-e056-41a1-a4b5-caeb5ce14f51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:57.056272 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c9c5c23f-e056-41a1-a4b5-caeb5ce14f51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:57.056699 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c9c5c23f-e056-41a1-a4b5-caeb5ce14f51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:57.175194 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c9c5c23f-e056-41a1-a4b5-caeb5ce14f51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:57.182782 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c9c5c23f-e056-41a1-a4b5-caeb5ce14f51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.137523 Oct 15 03:44:57.183357 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 474/923] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:57 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:57.473390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-37080329-dbab-48ea-b5aa-75f724c96301 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:57.474306 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-37080329-dbab-48ea-b5aa-75f724c96301 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:57.481910 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-37080329-dbab-48ea-b5aa-75f724c96301 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:57.482368 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-37080329-dbab-48ea-b5aa-75f724c96301 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:57.483136 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-37080329-dbab-48ea-b5aa-75f724c96301 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:57.483564 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-37080329-dbab-48ea-b5aa-75f724c96301 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:57.511610 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-37080329-dbab-48ea-b5aa-75f724c96301 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042037 Oct 15 03:44:57.512177 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 450/924] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:57 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:57.678970 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-23b52675-7c78-48f4-b2ad-541ca0a0cccb tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:57.679573 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-23b52675-7c78-48f4-b2ad-541ca0a0cccb tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:57.685744 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-23b52675-7c78-48f4-b2ad-541ca0a0cccb tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:57.686192 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-23b52675-7c78-48f4-b2ad-541ca0a0cccb tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:57.686935 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-23b52675-7c78-48f4-b2ad-541ca0a0cccb tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:57.687360 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-23b52675-7c78-48f4-b2ad-541ca0a0cccb tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:57.745440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-23b52675-7c78-48f4-b2ad-541ca0a0cccb tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:57.752442 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-23b52675-7c78-48f4-b2ad-541ca0a0cccb tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077073 Oct 15 03:44:57.753210 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 475/925] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:57 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:57.887088 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-bcc24926-4e2e-41ee-9f26-17afb4dcc912 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:57.888005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-bcc24926-4e2e-41ee-9f26-17afb4dcc912 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:57.893882 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bcc24926-4e2e-41ee-9f26-17afb4dcc912 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:57.894329 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bcc24926-4e2e-41ee-9f26-17afb4dcc912 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:57.895085 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bcc24926-4e2e-41ee-9f26-17afb4dcc912 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:57.895518 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bcc24926-4e2e-41ee-9f26-17afb4dcc912 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:57.926149 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-bcc24926-4e2e-41ee-9f26-17afb4dcc912 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043444 Oct 15 03:44:57.926703 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 451/926] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:57 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:58.199274 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b88ccbaf-6097-4430-b061-317fe9fee22c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:58.199904 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b88ccbaf-6097-4430-b061-317fe9fee22c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:58.205629 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b88ccbaf-6097-4430-b061-317fe9fee22c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:58.206070 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b88ccbaf-6097-4430-b061-317fe9fee22c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:58.206818 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b88ccbaf-6097-4430-b061-317fe9fee22c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:58.207241 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b88ccbaf-6097-4430-b061-317fe9fee22c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:58.323430 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b88ccbaf-6097-4430-b061-317fe9fee22c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:58.330782 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b88ccbaf-6097-4430-b061-317fe9fee22c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.135121 Oct 15 03:44:58.331330 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 476/927] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:58 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:58.522598 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-18ff2875-a863-457b-a7c8-f0f76d8d3d8c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:58.523499 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-18ff2875-a863-457b-a7c8-f0f76d8d3d8c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:58.529749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18ff2875-a863-457b-a7c8-f0f76d8d3d8c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:58.530190 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18ff2875-a863-457b-a7c8-f0f76d8d3d8c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:58.530939 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18ff2875-a863-457b-a7c8-f0f76d8d3d8c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:58.531369 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18ff2875-a863-457b-a7c8-f0f76d8d3d8c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:58.559228 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-18ff2875-a863-457b-a7c8-f0f76d8d3d8c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040312 Oct 15 03:44:58.559774 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 452/928] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:58 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:58.769583 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ae42815d-fb39-47af-abf4-2b89bbb3d2cc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:58.770189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ae42815d-fb39-47af-abf4-2b89bbb3d2cc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:58.776614 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ae42815d-fb39-47af-abf4-2b89bbb3d2cc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:58.777005 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ae42815d-fb39-47af-abf4-2b89bbb3d2cc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:58.777760 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ae42815d-fb39-47af-abf4-2b89bbb3d2cc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:58.778190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ae42815d-fb39-47af-abf4-2b89bbb3d2cc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:58.835393 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ae42815d-fb39-47af-abf4-2b89bbb3d2cc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:58.843423 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ae42815d-fb39-47af-abf4-2b89bbb3d2cc tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077455 Oct 15 03:44:58.844041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 477/929] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:58 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:44:58.937363 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-64ea2739-b6e6-46c0-ba2d-b4f809b3ea75 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:58.938258 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-64ea2739-b6e6-46c0-ba2d-b4f809b3ea75 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:58.944073 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-64ea2739-b6e6-46c0-ba2d-b4f809b3ea75 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:58.944520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-64ea2739-b6e6-46c0-ba2d-b4f809b3ea75 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:58.945279 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-64ea2739-b6e6-46c0-ba2d-b4f809b3ea75 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:58.945710 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-64ea2739-b6e6-46c0-ba2d-b4f809b3ea75 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:58.974480 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-64ea2739-b6e6-46c0-ba2d-b4f809b3ea75 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040820 Oct 15 03:44:58.975015 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 453/930] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:58 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:44:58.979261 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:44:58.979406 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 03:44:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:44:59.347192 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0193272c-3b7d-4ff5-a4aa-199ccf421df0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:59.347951 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0193272c-3b7d-4ff5-a4aa-199ccf421df0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:59.353767 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0193272c-3b7d-4ff5-a4aa-199ccf421df0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:59.354217 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0193272c-3b7d-4ff5-a4aa-199ccf421df0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:59.354975 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0193272c-3b7d-4ff5-a4aa-199ccf421df0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:59.355412 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0193272c-3b7d-4ff5-a4aa-199ccf421df0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:59.474212 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0193272c-3b7d-4ff5-a4aa-199ccf421df0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:59.481982 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0193272c-3b7d-4ff5-a4aa-199ccf421df0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.138474 Oct 15 03:44:59.482530 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 478/931] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:59 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:59.570254 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b29c9c5d-f86c-40f1-a633-b63dde40d108 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:59.571079 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b29c9c5d-f86c-40f1-a633-b63dde40d108 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:59.576830 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b29c9c5d-f86c-40f1-a633-b63dde40d108 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:59.577270 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b29c9c5d-f86c-40f1-a633-b63dde40d108 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:59.578015 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b29c9c5d-f86c-40f1-a633-b63dde40d108 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:59.578440 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b29c9c5d-f86c-40f1-a633-b63dde40d108 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:59.606344 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b29c9c5d-f86c-40f1-a633-b63dde40d108 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039939 Oct 15 03:44:59.606873 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 454/932] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:44:59 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:44:59.860218 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-509557fa-ff87-49ab-8756-075c200dacae tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:59.860759 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-509557fa-ff87-49ab-8756-075c200dacae tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:59.866517 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-509557fa-ff87-49ab-8756-075c200dacae tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:59.866968 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-509557fa-ff87-49ab-8756-075c200dacae tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:59.867750 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-509557fa-ff87-49ab-8756-075c200dacae tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:59.868193 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-509557fa-ff87-49ab-8756-075c200dacae tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:59.926653 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-509557fa-ff87-49ab-8756-075c200dacae tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:44:59.933813 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-509557fa-ff87-49ab-8756-075c200dacae tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077273 Oct 15 03:44:59.934365 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 479/933] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:44:59 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:44:59.985836 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-11207a7e-9b72-45d2-83e1-9aba5413deed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:44:59.986729 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-11207a7e-9b72-45d2-83e1-9aba5413deed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:44:59.992349 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-11207a7e-9b72-45d2-83e1-9aba5413deed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:59.992798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-11207a7e-9b72-45d2-83e1-9aba5413deed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:44:59.993549 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-11207a7e-9b72-45d2-83e1-9aba5413deed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:44:59.993980 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-11207a7e-9b72-45d2-83e1-9aba5413deed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:00.021298 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-11207a7e-9b72-45d2-83e1-9aba5413deed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039175 Oct 15 03:45:00.021825 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 455/934] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:44:59 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:00.498595 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-015aad50-77c1-4fa0-b446-e7ae993fe790 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:00.499234 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-015aad50-77c1-4fa0-b446-e7ae993fe790 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:00.505119 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-015aad50-77c1-4fa0-b446-e7ae993fe790 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:00.505572 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-015aad50-77c1-4fa0-b446-e7ae993fe790 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:00.506333 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-015aad50-77c1-4fa0-b446-e7ae993fe790 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:00.506770 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-015aad50-77c1-4fa0-b446-e7ae993fe790 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:00.617499 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a1d79b6a-c53f-460d-b564-a16ce4c7b03d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:00.618413 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a1d79b6a-c53f-460d-b564-a16ce4c7b03d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:00.624320 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-015aad50-77c1-4fa0-b446-e7ae993fe790 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:00.624849 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a1d79b6a-c53f-460d-b564-a16ce4c7b03d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:00.625302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a1d79b6a-c53f-460d-b564-a16ce4c7b03d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:00.626071 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a1d79b6a-c53f-460d-b564-a16ce4c7b03d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:00.626507 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a1d79b6a-c53f-460d-b564-a16ce4c7b03d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:00.631604 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-015aad50-77c1-4fa0-b446-e7ae993fe790 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.136623 Oct 15 03:45:00.632386 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 480/935] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:00 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:00.655054 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a1d79b6a-c53f-460d-b564-a16ce4c7b03d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041248 Oct 15 03:45:00.655597 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 456/936] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:00 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:45:00.949785 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f10f37d1-9706-4f83-b415-c0d29057e2e3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:00.950387 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f10f37d1-9706-4f83-b415-c0d29057e2e3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:00.955999 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f10f37d1-9706-4f83-b415-c0d29057e2e3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:00.956443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f10f37d1-9706-4f83-b415-c0d29057e2e3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:00.957195 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f10f37d1-9706-4f83-b415-c0d29057e2e3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:00.957622 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f10f37d1-9706-4f83-b415-c0d29057e2e3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:01.019477 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f10f37d1-9706-4f83-b415-c0d29057e2e3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:01.027346 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f10f37d1-9706-4f83-b415-c0d29057e2e3 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.081228 Oct 15 03:45:01.028090 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 481/937] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:00 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:01.032650 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-932b0ecf-c9b2-43b1-b4e9-916696d9bce9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:01.033576 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-932b0ecf-c9b2-43b1-b4e9-916696d9bce9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:01.039386 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-932b0ecf-c9b2-43b1-b4e9-916696d9bce9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:01.039874 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-932b0ecf-c9b2-43b1-b4e9-916696d9bce9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:01.040640 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-932b0ecf-c9b2-43b1-b4e9-916696d9bce9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:01.041072 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-932b0ecf-c9b2-43b1-b4e9-916696d9bce9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:01.068875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-932b0ecf-c9b2-43b1-b4e9-916696d9bce9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039914 Oct 15 03:45:01.069417 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 457/938] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:01 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:45:01.648646 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9a656e01-0422-4b06-b944-6650b72920da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:01.649211 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9a656e01-0422-4b06-b944-6650b72920da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:01.654949 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9a656e01-0422-4b06-b944-6650b72920da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:01.655395 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9a656e01-0422-4b06-b944-6650b72920da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:01.656183 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9a656e01-0422-4b06-b944-6650b72920da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:01.656615 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9a656e01-0422-4b06-b944-6650b72920da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:01.665542 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-113f0acb-61a6-4175-9e43-3a0e47c83ca9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:01.666641 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-113f0acb-61a6-4175-9e43-3a0e47c83ca9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:01.672275 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-113f0acb-61a6-4175-9e43-3a0e47c83ca9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:01.672717 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-113f0acb-61a6-4175-9e43-3a0e47c83ca9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:01.673473 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-113f0acb-61a6-4175-9e43-3a0e47c83ca9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:01.674105 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-113f0acb-61a6-4175-9e43-3a0e47c83ca9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:01.703187 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-113f0acb-61a6-4175-9e43-3a0e47c83ca9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041230 Oct 15 03:45:01.703759 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 458/939] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:01 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:45:01.773308 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9a656e01-0422-4b06-b944-6650b72920da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:01.780385 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9a656e01-0422-4b06-b944-6650b72920da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.135482 Oct 15 03:45:01.780942 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 482/940] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:01 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:02.044561 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a068ea27-1cc5-416a-ba68-c0b1b2b52f92 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:02.045180 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a068ea27-1cc5-416a-ba68-c0b1b2b52f92 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:02.050839 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a068ea27-1cc5-416a-ba68-c0b1b2b52f92 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:02.051284 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a068ea27-1cc5-416a-ba68-c0b1b2b52f92 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:02.052065 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a068ea27-1cc5-416a-ba68-c0b1b2b52f92 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:02.052495 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a068ea27-1cc5-416a-ba68-c0b1b2b52f92 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:02.080616 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7b3ff420-8e04-4a65-9741-3ddeca7c4fda tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:02.081522 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7b3ff420-8e04-4a65-9741-3ddeca7c4fda tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:02.087515 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7b3ff420-8e04-4a65-9741-3ddeca7c4fda tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:02.087999 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7b3ff420-8e04-4a65-9741-3ddeca7c4fda tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:02.088762 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7b3ff420-8e04-4a65-9741-3ddeca7c4fda tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:02.089190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7b3ff420-8e04-4a65-9741-3ddeca7c4fda tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:02.110608 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-a068ea27-1cc5-416a-ba68-c0b1b2b52f92 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:02.117722 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a068ea27-1cc5-416a-ba68-c0b1b2b52f92 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077293 Oct 15 03:45:02.117954 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7b3ff420-8e04-4a65-9741-3ddeca7c4fda tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041012 Oct 15 03:45:02.118281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 459/941] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:02 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:02.118493 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 483/942] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:02 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:45:02.715186 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-672e42c6-c00a-49ed-81fc-35790f797676 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:02.716113 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-672e42c6-c00a-49ed-81fc-35790f797676 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:02.721895 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-672e42c6-c00a-49ed-81fc-35790f797676 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:02.722336 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-672e42c6-c00a-49ed-81fc-35790f797676 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:02.723116 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-672e42c6-c00a-49ed-81fc-35790f797676 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:02.723542 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-672e42c6-c00a-49ed-81fc-35790f797676 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:02.751625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-672e42c6-c00a-49ed-81fc-35790f797676 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040810 Oct 15 03:45:02.752182 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 460/943] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:02 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:02.797208 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-024e1004-d2ac-4e74-9350-914bd0ed0075 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:02.797837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-024e1004-d2ac-4e74-9350-914bd0ed0075 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:02.803438 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-024e1004-d2ac-4e74-9350-914bd0ed0075 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:02.803926 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-024e1004-d2ac-4e74-9350-914bd0ed0075 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:02.804673 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-024e1004-d2ac-4e74-9350-914bd0ed0075 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:02.805101 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-024e1004-d2ac-4e74-9350-914bd0ed0075 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:02.919877 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-024e1004-d2ac-4e74-9350-914bd0ed0075 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:02.926896 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-024e1004-d2ac-4e74-9350-914bd0ed0075 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.133227 Oct 15 03:45:02.927442 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 484/944] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:02 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:03.129871 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c24bd223-3665-4987-a429-21715dd201cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:03.130810 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c24bd223-3665-4987-a429-21715dd201cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:03.133744 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b68bfec6-f03d-42b3-9589-8896faf904da tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:03.134340 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b68bfec6-f03d-42b3-9589-8896faf904da tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:03.137171 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c24bd223-3665-4987-a429-21715dd201cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:03.137616 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c24bd223-3665-4987-a429-21715dd201cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:03.138374 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c24bd223-3665-4987-a429-21715dd201cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:03.138808 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c24bd223-3665-4987-a429-21715dd201cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:03.140498 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b68bfec6-f03d-42b3-9589-8896faf904da tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:03.140944 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b68bfec6-f03d-42b3-9589-8896faf904da tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:03.141721 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b68bfec6-f03d-42b3-9589-8896faf904da tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:03.142152 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b68bfec6-f03d-42b3-9589-8896faf904da tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:03.166711 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c24bd223-3665-4987-a429-21715dd201cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040559 Oct 15 03:45:03.167266 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 461/945] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:03 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:03.202953 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b68bfec6-f03d-42b3-9589-8896faf904da tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:03.210606 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b68bfec6-f03d-42b3-9589-8896faf904da tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.080214 Oct 15 03:45:03.211214 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 485/946] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:03 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:03.762822 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4957d7b5-8fe7-4d9d-b7e2-39720c14ea3f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:03.763745 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4957d7b5-8fe7-4d9d-b7e2-39720c14ea3f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:03.769552 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4957d7b5-8fe7-4d9d-b7e2-39720c14ea3f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:03.769999 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4957d7b5-8fe7-4d9d-b7e2-39720c14ea3f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:03.770747 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4957d7b5-8fe7-4d9d-b7e2-39720c14ea3f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:03.771179 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4957d7b5-8fe7-4d9d-b7e2-39720c14ea3f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:03.799749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4957d7b5-8fe7-4d9d-b7e2-39720c14ea3f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040683 Oct 15 03:45:03.800287 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 462/947] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:03 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:03.944120 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5a41f829-20c0-4d7a-a49d-f92941972c5e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:03.944717 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5a41f829-20c0-4d7a-a49d-f92941972c5e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:03.950515 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a41f829-20c0-4d7a-a49d-f92941972c5e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:03.950955 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a41f829-20c0-4d7a-a49d-f92941972c5e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:03.951715 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a41f829-20c0-4d7a-a49d-f92941972c5e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:03.952145 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a41f829-20c0-4d7a-a49d-f92941972c5e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:04.069987 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5a41f829-20c0-4d7a-a49d-f92941972c5e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:04.077613 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5a41f829-20c0-4d7a-a49d-f92941972c5e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.137180 Oct 15 03:45:04.078163 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 486/948] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:03 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:04.178019 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a09609ed-2091-46c4-b647-c5e6bf0136eb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:04.178922 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a09609ed-2091-46c4-b647-c5e6bf0136eb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:04.184643 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a09609ed-2091-46c4-b647-c5e6bf0136eb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:04.185085 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a09609ed-2091-46c4-b647-c5e6bf0136eb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:04.185840 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a09609ed-2091-46c4-b647-c5e6bf0136eb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:04.186270 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a09609ed-2091-46c4-b647-c5e6bf0136eb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:04.214924 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a09609ed-2091-46c4-b647-c5e6bf0136eb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040715 Oct 15 03:45:04.215454 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 463/949] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:04 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:04.225785 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3ea211e8-8e3a-42d8-90b2-e2a36eb26cb9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:04.226387 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3ea211e8-8e3a-42d8-90b2-e2a36eb26cb9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:04.232093 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3ea211e8-8e3a-42d8-90b2-e2a36eb26cb9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:04.232538 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3ea211e8-8e3a-42d8-90b2-e2a36eb26cb9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:04.233288 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3ea211e8-8e3a-42d8-90b2-e2a36eb26cb9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:04.233716 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3ea211e8-8e3a-42d8-90b2-e2a36eb26cb9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:04.292525 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3ea211e8-8e3a-42d8-90b2-e2a36eb26cb9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:04.299556 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3ea211e8-8e3a-42d8-90b2-e2a36eb26cb9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077323 Oct 15 03:45:04.300138 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 487/950] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:04 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:04.810931 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9c47e3e8-865a-4c87-b151-c537ff7d229d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:04.811865 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9c47e3e8-865a-4c87-b151-c537ff7d229d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:04.817549 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9c47e3e8-865a-4c87-b151-c537ff7d229d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:04.817990 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9c47e3e8-865a-4c87-b151-c537ff7d229d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:04.818737 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9c47e3e8-865a-4c87-b151-c537ff7d229d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:04.819164 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9c47e3e8-865a-4c87-b151-c537ff7d229d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:04.848632 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9c47e3e8-865a-4c87-b151-c537ff7d229d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042113 Oct 15 03:45:04.849197 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 464/951] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:04 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:05.094646 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e9e3b381-87a1-423e-953b-87dd9a52237b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:05.095295 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e9e3b381-87a1-423e-953b-87dd9a52237b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:05.101278 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e9e3b381-87a1-423e-953b-87dd9a52237b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:05.101727 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e9e3b381-87a1-423e-953b-87dd9a52237b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:05.102473 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e9e3b381-87a1-423e-953b-87dd9a52237b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:05.102906 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e9e3b381-87a1-423e-953b-87dd9a52237b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:05.223885 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e9e3b381-87a1-423e-953b-87dd9a52237b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:05.226406 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-459a9f8d-8ce3-48de-9c22-623a3d39ff69 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:05.227382 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-459a9f8d-8ce3-48de-9c22-623a3d39ff69 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:05.231847 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e9e3b381-87a1-423e-953b-87dd9a52237b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.140892 Oct 15 03:45:05.232759 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 488/952] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:05 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:05.237902 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-459a9f8d-8ce3-48de-9c22-623a3d39ff69 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:05.238360 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-459a9f8d-8ce3-48de-9c22-623a3d39ff69 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:05.239144 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-459a9f8d-8ce3-48de-9c22-623a3d39ff69 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:05.239578 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-459a9f8d-8ce3-48de-9c22-623a3d39ff69 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:05.267890 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-459a9f8d-8ce3-48de-9c22-623a3d39ff69 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045349 Oct 15 03:45:05.268438 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 465/953] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:05 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:05.315765 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-51bb9216-d4b3-4c62-806f-946047a5206e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:05.316363 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-51bb9216-d4b3-4c62-806f-946047a5206e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:05.322236 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-51bb9216-d4b3-4c62-806f-946047a5206e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:05.322711 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-51bb9216-d4b3-4c62-806f-946047a5206e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:05.323704 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-51bb9216-d4b3-4c62-806f-946047a5206e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:05.324026 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-51bb9216-d4b3-4c62-806f-946047a5206e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:05.381506 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-51bb9216-d4b3-4c62-806f-946047a5206e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:05.388697 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-51bb9216-d4b3-4c62-806f-946047a5206e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.076511 Oct 15 03:45:05.389249 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 489/954] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:05 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:05.859839 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2d9aaee3-7fb9-4578-b0de-9855a591e23e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:05.860743 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2d9aaee3-7fb9-4578-b0de-9855a591e23e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:05.866941 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2d9aaee3-7fb9-4578-b0de-9855a591e23e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:05.867420 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2d9aaee3-7fb9-4578-b0de-9855a591e23e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:05.868376 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2d9aaee3-7fb9-4578-b0de-9855a591e23e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:05.868909 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2d9aaee3-7fb9-4578-b0de-9855a591e23e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:05.897844 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2d9aaee3-7fb9-4578-b0de-9855a591e23e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041756 Oct 15 03:45:05.898386 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 466/955] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:05 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:06.249223 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-650abf1e-2030-446c-a8b2-4bd3232c5932 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:06.249832 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-650abf1e-2030-446c-a8b2-4bd3232c5932 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:06.255650 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-650abf1e-2030-446c-a8b2-4bd3232c5932 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:06.256128 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-650abf1e-2030-446c-a8b2-4bd3232c5932 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:06.256883 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-650abf1e-2030-446c-a8b2-4bd3232c5932 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:06.257318 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-650abf1e-2030-446c-a8b2-4bd3232c5932 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:06.279149 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6440c9e0-73d8-4f7f-98b1-a7d83f5ffbb6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:06.280174 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6440c9e0-73d8-4f7f-98b1-a7d83f5ffbb6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:06.285885 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6440c9e0-73d8-4f7f-98b1-a7d83f5ffbb6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:06.286331 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6440c9e0-73d8-4f7f-98b1-a7d83f5ffbb6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:06.287097 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6440c9e0-73d8-4f7f-98b1-a7d83f5ffbb6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:06.287560 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6440c9e0-73d8-4f7f-98b1-a7d83f5ffbb6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:06.317410 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6440c9e0-73d8-4f7f-98b1-a7d83f5ffbb6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041890 Oct 15 03:45:06.317984 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 467/956] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:06 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:45:06.374705 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-650abf1e-2030-446c-a8b2-4bd3232c5932 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:06.382015 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-650abf1e-2030-446c-a8b2-4bd3232c5932 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.137084 Oct 15 03:45:06.382567 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 490/957] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:06 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:06.404917 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-488da783-0d0f-457f-b392-8441981b3f37 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:06.405490 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-488da783-0d0f-457f-b392-8441981b3f37 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:06.411136 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-488da783-0d0f-457f-b392-8441981b3f37 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:06.411592 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-488da783-0d0f-457f-b392-8441981b3f37 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:06.412392 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-488da783-0d0f-457f-b392-8441981b3f37 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:06.412829 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-488da783-0d0f-457f-b392-8441981b3f37 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:06.470531 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-488da783-0d0f-457f-b392-8441981b3f37 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:06.477599 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-488da783-0d0f-457f-b392-8441981b3f37 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.076421 Oct 15 03:45:06.478159 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 468/958] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:06 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:06.908925 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-eb11be50-11a9-4471-b180-712fcdc56c21 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:06.909845 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-eb11be50-11a9-4471-b180-712fcdc56c21 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:06.915642 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eb11be50-11a9-4471-b180-712fcdc56c21 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:06.916180 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eb11be50-11a9-4471-b180-712fcdc56c21 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:06.917550 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eb11be50-11a9-4471-b180-712fcdc56c21 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:06.917980 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eb11be50-11a9-4471-b180-712fcdc56c21 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:06.945388 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-eb11be50-11a9-4471-b180-712fcdc56c21 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040174 Oct 15 03:45:06.945916 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 491/959] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:06 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:07.330000 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d1f88cfd-d2f9-47b2-b2c5-58f5498a5f82 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:07.330887 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d1f88cfd-d2f9-47b2-b2c5-58f5498a5f82 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:07.336892 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d1f88cfd-d2f9-47b2-b2c5-58f5498a5f82 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:07.337334 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d1f88cfd-d2f9-47b2-b2c5-58f5498a5f82 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:07.338083 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d1f88cfd-d2f9-47b2-b2c5-58f5498a5f82 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:07.339162 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d1f88cfd-d2f9-47b2-b2c5-58f5498a5f82 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:07.366414 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d1f88cfd-d2f9-47b2-b2c5-58f5498a5f82 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040223 Oct 15 03:45:07.366938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 469/960] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:07 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:07.398530 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c14ad585-d9f7-4d35-9bd2-501567a9e67f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:07.399137 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c14ad585-d9f7-4d35-9bd2-501567a9e67f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:07.404765 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c14ad585-d9f7-4d35-9bd2-501567a9e67f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:07.405284 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c14ad585-d9f7-4d35-9bd2-501567a9e67f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:07.406040 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c14ad585-d9f7-4d35-9bd2-501567a9e67f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:07.406474 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c14ad585-d9f7-4d35-9bd2-501567a9e67f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:07.494031 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b691171d-64f7-4712-a670-fee32412464e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:07.494565 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b691171d-64f7-4712-a670-fee32412464e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:07.500894 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b691171d-64f7-4712-a670-fee32412464e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:07.501331 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b691171d-64f7-4712-a670-fee32412464e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:07.502083 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b691171d-64f7-4712-a670-fee32412464e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:07.502512 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b691171d-64f7-4712-a670-fee32412464e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:07.529053 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c14ad585-d9f7-4d35-9bd2-501567a9e67f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:07.536528 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c14ad585-d9f7-4d35-9bd2-501567a9e67f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.141619 Oct 15 03:45:07.537082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 492/961] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:07 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:07.562394 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b691171d-64f7-4712-a670-fee32412464e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:07.569448 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b691171d-64f7-4712-a670-fee32412464e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.079063 Oct 15 03:45:07.570006 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 470/962] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:07 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:07.956560 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cdaa71e1-0f52-49da-ad0e-7a10966668c9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:07.957413 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cdaa71e1-0f52-49da-ad0e-7a10966668c9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:07.963729 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cdaa71e1-0f52-49da-ad0e-7a10966668c9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:07.964177 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cdaa71e1-0f52-49da-ad0e-7a10966668c9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:07.964941 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cdaa71e1-0f52-49da-ad0e-7a10966668c9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:07.965351 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cdaa71e1-0f52-49da-ad0e-7a10966668c9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:07.993868 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cdaa71e1-0f52-49da-ad0e-7a10966668c9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041108 Oct 15 03:45:07.994393 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 493/963] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:07 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:08.378168 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9c8a7705-6a9d-4ffa-ac7d-28c047da3edd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:08.379061 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9c8a7705-6a9d-4ffa-ac7d-28c047da3edd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:08.384800 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9c8a7705-6a9d-4ffa-ac7d-28c047da3edd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:08.385251 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9c8a7705-6a9d-4ffa-ac7d-28c047da3edd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:08.385988 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9c8a7705-6a9d-4ffa-ac7d-28c047da3edd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:08.386424 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9c8a7705-6a9d-4ffa-ac7d-28c047da3edd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:08.414138 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9c8a7705-6a9d-4ffa-ac7d-28c047da3edd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039725 Oct 15 03:45:08.414661 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 471/964] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:08 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:08.553409 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cb124116-de39-48fd-92fe-84ecd6ce1289 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:08.553926 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cb124116-de39-48fd-92fe-84ecd6ce1289 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:08.559762 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cb124116-de39-48fd-92fe-84ecd6ce1289 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:08.560215 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cb124116-de39-48fd-92fe-84ecd6ce1289 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:08.560982 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cb124116-de39-48fd-92fe-84ecd6ce1289 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:08.561416 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cb124116-de39-48fd-92fe-84ecd6ce1289 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:08.586124 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0b7262db-4dea-45c3-b494-9b44198ef496 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:08.586739 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0b7262db-4dea-45c3-b494-9b44198ef496 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:08.593100 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0b7262db-4dea-45c3-b494-9b44198ef496 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:08.593550 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0b7262db-4dea-45c3-b494-9b44198ef496 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:08.594315 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0b7262db-4dea-45c3-b494-9b44198ef496 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:08.594751 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0b7262db-4dea-45c3-b494-9b44198ef496 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:08.666689 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0b7262db-4dea-45c3-b494-9b44198ef496 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:08.674010 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0b7262db-4dea-45c3-b494-9b44198ef496 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.091733 Oct 15 03:45:08.674579 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 472/965] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:08 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:08.701433 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-cb124116-de39-48fd-92fe-84ecd6ce1289 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:08.708571 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cb124116-de39-48fd-92fe-84ecd6ce1289 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.158850 Oct 15 03:45:08.709133 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 494/966] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:08 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:09.005547 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3603206f-2b1a-42d7-a847-9a88f0f3a5a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:09.006455 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3603206f-2b1a-42d7-a847-9a88f0f3a5a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:09.012817 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3603206f-2b1a-42d7-a847-9a88f0f3a5a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:09.013266 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3603206f-2b1a-42d7-a847-9a88f0f3a5a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:09.014032 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3603206f-2b1a-42d7-a847-9a88f0f3a5a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:09.014461 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3603206f-2b1a-42d7-a847-9a88f0f3a5a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:09.041959 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3603206f-2b1a-42d7-a847-9a88f0f3a5a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040159 Oct 15 03:45:09.042499 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 473/967] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:09 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:09.426144 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-595e4964-5611-4c3a-a9bf-5fafed223d1d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:09.426944 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-595e4964-5611-4c3a-a9bf-5fafed223d1d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:09.433481 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-595e4964-5611-4c3a-a9bf-5fafed223d1d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:09.433923 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-595e4964-5611-4c3a-a9bf-5fafed223d1d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:09.434704 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-595e4964-5611-4c3a-a9bf-5fafed223d1d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:09.435127 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-595e4964-5611-4c3a-a9bf-5fafed223d1d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:09.463240 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-595e4964-5611-4c3a-a9bf-5fafed223d1d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040963 Oct 15 03:45:09.463873 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 495/968] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:09 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:09.725820 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2d815a18-3528-4d0c-9af5-5cecc5f4b4af tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:09.726423 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2d815a18-3528-4d0c-9af5-5cecc5f4b4af tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:09.732588 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2d815a18-3528-4d0c-9af5-5cecc5f4b4af tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:09.733037 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2d815a18-3528-4d0c-9af5-5cecc5f4b4af tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:09.733790 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2d815a18-3528-4d0c-9af5-5cecc5f4b4af tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:09.734214 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2d815a18-3528-4d0c-9af5-5cecc5f4b4af tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:09.783779 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fe8fc1ee-e0a0-48de-8a66-7b0e24eeb70b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:09.784463 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fe8fc1ee-e0a0-48de-8a66-7b0e24eeb70b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:09.790249 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe8fc1ee-e0a0-48de-8a66-7b0e24eeb70b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:09.790783 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe8fc1ee-e0a0-48de-8a66-7b0e24eeb70b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:09.792224 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe8fc1ee-e0a0-48de-8a66-7b0e24eeb70b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:09.792656 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe8fc1ee-e0a0-48de-8a66-7b0e24eeb70b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:09.862241 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fe8fc1ee-e0a0-48de-8a66-7b0e24eeb70b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:09.869309 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fe8fc1ee-e0a0-48de-8a66-7b0e24eeb70b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.182693 Oct 15 03:45:09.869893 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 474/969] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:09 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:09.875933 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2d815a18-3528-4d0c-9af5-5cecc5f4b4af tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:09.883295 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2d815a18-3528-4d0c-9af5-5cecc5f4b4af tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.161062 Oct 15 03:45:09.883869 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 496/970] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:09 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:10.053033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5ba45dc2-f567-4d8e-882b-1c647fce8778 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:10.053986 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5ba45dc2-f567-4d8e-882b-1c647fce8778 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:10.059946 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ba45dc2-f567-4d8e-882b-1c647fce8778 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:10.060395 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ba45dc2-f567-4d8e-882b-1c647fce8778 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:10.061141 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ba45dc2-f567-4d8e-882b-1c647fce8778 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:10.061566 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ba45dc2-f567-4d8e-882b-1c647fce8778 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:10.090318 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5ba45dc2-f567-4d8e-882b-1c647fce8778 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041045 Oct 15 03:45:10.090881 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 475/971] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:10 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:10.474692 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fce955e9-4655-4a3b-aaee-1f634a195b1b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:10.475729 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fce955e9-4655-4a3b-aaee-1f634a195b1b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:10.481482 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fce955e9-4655-4a3b-aaee-1f634a195b1b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:10.481923 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fce955e9-4655-4a3b-aaee-1f634a195b1b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:10.482682 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fce955e9-4655-4a3b-aaee-1f634a195b1b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:10.483113 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fce955e9-4655-4a3b-aaee-1f634a195b1b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:10.512533 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fce955e9-4655-4a3b-aaee-1f634a195b1b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041712 Oct 15 03:45:10.513086 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 497/972] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:10 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:10.885684 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-78b9a516-ab2d-4934-8ee9-9c833e9fd11c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:10.886311 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-78b9a516-ab2d-4934-8ee9-9c833e9fd11c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:10.891997 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-78b9a516-ab2d-4934-8ee9-9c833e9fd11c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:10.892453 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-78b9a516-ab2d-4934-8ee9-9c833e9fd11c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:10.893185 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-78b9a516-ab2d-4934-8ee9-9c833e9fd11c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:10.893616 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-78b9a516-ab2d-4934-8ee9-9c833e9fd11c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:10.899637 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-804573ea-191e-49b5-b325-ee7d0fb923b2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:10.900263 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-804573ea-191e-49b5-b325-ee7d0fb923b2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:10.905781 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-804573ea-191e-49b5-b325-ee7d0fb923b2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:10.906290 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-804573ea-191e-49b5-b325-ee7d0fb923b2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:10.907049 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-804573ea-191e-49b5-b325-ee7d0fb923b2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:10.907476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-804573ea-191e-49b5-b325-ee7d0fb923b2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:10.953562 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-78b9a516-ab2d-4934-8ee9-9c833e9fd11c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:10.961183 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-78b9a516-ab2d-4934-8ee9-9c833e9fd11c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.079164 Oct 15 03:45:10.961749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 476/973] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:10 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:11.039718 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-804573ea-191e-49b5-b325-ee7d0fb923b2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:11.047271 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-804573ea-191e-49b5-b325-ee7d0fb923b2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.151176 Oct 15 03:45:11.047833 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 498/974] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:10 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:11.101235 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1e3b298a-fbfb-49a1-8812-8ee5792d1a5c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:11.102132 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1e3b298a-fbfb-49a1-8812-8ee5792d1a5c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:11.108295 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1e3b298a-fbfb-49a1-8812-8ee5792d1a5c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:11.108715 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1e3b298a-fbfb-49a1-8812-8ee5792d1a5c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:11.109473 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1e3b298a-fbfb-49a1-8812-8ee5792d1a5c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:11.110010 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1e3b298a-fbfb-49a1-8812-8ee5792d1a5c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:11.138447 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1e3b298a-fbfb-49a1-8812-8ee5792d1a5c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040734 Oct 15 03:45:11.138910 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 477/975] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:11 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:11.523691 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6f342a59-e0d0-40d7-8dd9-1c272c4f88aa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:11.524682 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6f342a59-e0d0-40d7-8dd9-1c272c4f88aa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:11.531087 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6f342a59-e0d0-40d7-8dd9-1c272c4f88aa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:11.531533 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6f342a59-e0d0-40d7-8dd9-1c272c4f88aa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:11.532327 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6f342a59-e0d0-40d7-8dd9-1c272c4f88aa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:11.532761 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6f342a59-e0d0-40d7-8dd9-1c272c4f88aa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:11.560343 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6f342a59-e0d0-40d7-8dd9-1c272c4f88aa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040428 Oct 15 03:45:11.560873 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 499/976] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:11 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:11.977527 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-49fb3c31-b6e3-447f-af3f-b2c66a0ee433 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:11.978054 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-49fb3c31-b6e3-447f-af3f-b2c66a0ee433 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:11.983854 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-49fb3c31-b6e3-447f-af3f-b2c66a0ee433 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:11.984308 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-49fb3c31-b6e3-447f-af3f-b2c66a0ee433 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:11.985067 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-49fb3c31-b6e3-447f-af3f-b2c66a0ee433 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:11.985500 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-49fb3c31-b6e3-447f-af3f-b2c66a0ee433 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:12.048789 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-49fb3c31-b6e3-447f-af3f-b2c66a0ee433 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:12.055897 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-49fb3c31-b6e3-447f-af3f-b2c66a0ee433 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.082144 Oct 15 03:45:12.056460 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 478/977] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:11 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:12.063822 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2fc7f5dd-b417-418f-b3ff-1ece74560fb6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:12.064435 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2fc7f5dd-b417-418f-b3ff-1ece74560fb6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:12.070466 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2fc7f5dd-b417-418f-b3ff-1ece74560fb6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:12.070920 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2fc7f5dd-b417-418f-b3ff-1ece74560fb6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:12.071705 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2fc7f5dd-b417-418f-b3ff-1ece74560fb6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:12.072151 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2fc7f5dd-b417-418f-b3ff-1ece74560fb6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:12.149580 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-241533d2-a437-4fe7-9f93-a886375be85d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:12.150487 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-241533d2-a437-4fe7-9f93-a886375be85d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:12.156298 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-241533d2-a437-4fe7-9f93-a886375be85d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:12.156749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-241533d2-a437-4fe7-9f93-a886375be85d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:12.157514 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-241533d2-a437-4fe7-9f93-a886375be85d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:12.158042 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-241533d2-a437-4fe7-9f93-a886375be85d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:12.186478 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-241533d2-a437-4fe7-9f93-a886375be85d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040622 Oct 15 03:45:12.187046 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 479/978] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:12 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:45:12.187622 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2fc7f5dd-b417-418f-b3ff-1ece74560fb6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:12.195248 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2fc7f5dd-b417-418f-b3ff-1ece74560fb6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.134551 Oct 15 03:45:12.195826 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 500/979] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:12 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:12.572156 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a3f794a1-eeff-4fd4-8454-68116491bb26 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:12.572971 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a3f794a1-eeff-4fd4-8454-68116491bb26 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:12.578692 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a3f794a1-eeff-4fd4-8454-68116491bb26 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:12.579128 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a3f794a1-eeff-4fd4-8454-68116491bb26 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:12.579918 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a3f794a1-eeff-4fd4-8454-68116491bb26 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:12.580348 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a3f794a1-eeff-4fd4-8454-68116491bb26 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:12.608192 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a3f794a1-eeff-4fd4-8454-68116491bb26 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039897 Oct 15 03:45:12.608714 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 480/980] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:12 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:13.074615 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a0aa2603-ee27-46cc-a21a-0a9735f0e6c0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:13.075605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a0aa2603-ee27-46cc-a21a-0a9735f0e6c0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:13.084212 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0aa2603-ee27-46cc-a21a-0a9735f0e6c0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:13.085256 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0aa2603-ee27-46cc-a21a-0a9735f0e6c0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:13.086513 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0aa2603-ee27-46cc-a21a-0a9735f0e6c0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:13.087207 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0aa2603-ee27-46cc-a21a-0a9735f0e6c0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:13.149707 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a0aa2603-ee27-46cc-a21a-0a9735f0e6c0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:13.157607 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a0aa2603-ee27-46cc-a21a-0a9735f0e6c0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.088130 Oct 15 03:45:13.158158 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 501/981] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:13 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:13.196667 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-830fe528-ba08-4336-be36-2d7cb013adb6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:13.198099 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-830fe528-ba08-4336-be36-2d7cb013adb6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:13.203777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-830fe528-ba08-4336-be36-2d7cb013adb6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:13.204229 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-830fe528-ba08-4336-be36-2d7cb013adb6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:13.204989 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-830fe528-ba08-4336-be36-2d7cb013adb6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:13.205419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-830fe528-ba08-4336-be36-2d7cb013adb6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:13.212710 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0b2791a3-e3e0-4176-8c75-639e2385555a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:13.213378 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0b2791a3-e3e0-4176-8c75-639e2385555a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:13.219424 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0b2791a3-e3e0-4176-8c75-639e2385555a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:13.219966 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0b2791a3-e3e0-4176-8c75-639e2385555a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:13.220717 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0b2791a3-e3e0-4176-8c75-639e2385555a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:13.221142 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0b2791a3-e3e0-4176-8c75-639e2385555a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:13.234407 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-830fe528-ba08-4336-be36-2d7cb013adb6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041495 Oct 15 03:45:13.235170 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 481/982] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:13 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:45:13.340722 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0b2791a3-e3e0-4176-8c75-639e2385555a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:13.347900 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0b2791a3-e3e0-4176-8c75-639e2385555a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.138863 Oct 15 03:45:13.348454 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 502/983] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:13 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:13.620066 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b917785a-f6e2-41d6-947e-9f7987036663 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:13.621005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b917785a-f6e2-41d6-947e-9f7987036663 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:13.626722 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b917785a-f6e2-41d6-947e-9f7987036663 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:13.627167 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b917785a-f6e2-41d6-947e-9f7987036663 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:13.627953 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b917785a-f6e2-41d6-947e-9f7987036663 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:13.628385 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b917785a-f6e2-41d6-947e-9f7987036663 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:13.656355 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b917785a-f6e2-41d6-947e-9f7987036663 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040595 Oct 15 03:45:13.656895 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 482/984] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:13 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:14.173865 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-094f48cd-c817-4393-b34b-ce8c783f3f82 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:14.174512 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-094f48cd-c817-4393-b34b-ce8c783f3f82 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:14.180326 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-094f48cd-c817-4393-b34b-ce8c783f3f82 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:14.180801 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-094f48cd-c817-4393-b34b-ce8c783f3f82 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:14.181566 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-094f48cd-c817-4393-b34b-ce8c783f3f82 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:14.182005 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-094f48cd-c817-4393-b34b-ce8c783f3f82 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:14.239988 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-094f48cd-c817-4393-b34b-ce8c783f3f82 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:14.245478 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-08951ff6-6f3b-4a9a-9c7f-09f765912047 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:14.246556 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-08951ff6-6f3b-4a9a-9c7f-09f765912047 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:14.247521 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-094f48cd-c817-4393-b34b-ce8c783f3f82 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077249 Oct 15 03:45:14.248127 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 503/985] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:14 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:14.252179 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08951ff6-6f3b-4a9a-9c7f-09f765912047 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:14.252619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08951ff6-6f3b-4a9a-9c7f-09f765912047 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:14.253373 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08951ff6-6f3b-4a9a-9c7f-09f765912047 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:14.253800 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08951ff6-6f3b-4a9a-9c7f-09f765912047 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:14.281829 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-08951ff6-6f3b-4a9a-9c7f-09f765912047 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039987 Oct 15 03:45:14.282365 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 483/986] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:14 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:45:14.364086 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7a2a3587-5990-4bb2-b877-984acf131663 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:14.364706 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7a2a3587-5990-4bb2-b877-984acf131663 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:14.370512 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7a2a3587-5990-4bb2-b877-984acf131663 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:14.370957 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7a2a3587-5990-4bb2-b877-984acf131663 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:14.371749 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7a2a3587-5990-4bb2-b877-984acf131663 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:14.372187 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7a2a3587-5990-4bb2-b877-984acf131663 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:14.487315 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7a2a3587-5990-4bb2-b877-984acf131663 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:14.494457 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7a2a3587-5990-4bb2-b877-984acf131663 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.133972 Oct 15 03:45:14.495010 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 504/987] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:14 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:14.667660 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-15067fc2-3c25-47c3-b0c8-83ff06f4d9ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:14.668588 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-15067fc2-3c25-47c3-b0c8-83ff06f4d9ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:14.674359 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-15067fc2-3c25-47c3-b0c8-83ff06f4d9ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:14.674808 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-15067fc2-3c25-47c3-b0c8-83ff06f4d9ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:14.675569 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-15067fc2-3c25-47c3-b0c8-83ff06f4d9ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:14.676037 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-15067fc2-3c25-47c3-b0c8-83ff06f4d9ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:14.704742 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-15067fc2-3c25-47c3-b0c8-83ff06f4d9ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040741 Oct 15 03:45:14.705250 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 484/988] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:14 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:15.263303 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ecbb3cc5-d145-4eef-86f2-211258543110 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:15.263934 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ecbb3cc5-d145-4eef-86f2-211258543110 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:15.269654 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ecbb3cc5-d145-4eef-86f2-211258543110 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:15.270126 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ecbb3cc5-d145-4eef-86f2-211258543110 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:15.270896 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ecbb3cc5-d145-4eef-86f2-211258543110 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:15.271323 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ecbb3cc5-d145-4eef-86f2-211258543110 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:15.292798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8e69ed0f-2742-4dcb-8a48-09a5eaaf8ec0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:15.293631 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8e69ed0f-2742-4dcb-8a48-09a5eaaf8ec0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:15.299331 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8e69ed0f-2742-4dcb-8a48-09a5eaaf8ec0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:15.299819 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8e69ed0f-2742-4dcb-8a48-09a5eaaf8ec0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:15.300578 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8e69ed0f-2742-4dcb-8a48-09a5eaaf8ec0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:15.301302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8e69ed0f-2742-4dcb-8a48-09a5eaaf8ec0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:15.332775 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ecbb3cc5-d145-4eef-86f2-211258543110 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:15.333706 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8e69ed0f-2742-4dcb-8a48-09a5eaaf8ec0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045117 Oct 15 03:45:15.334270 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 485/989] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:15 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:45:15.340316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ecbb3cc5-d145-4eef-86f2-211258543110 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.080642 Oct 15 03:45:15.340870 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 505/990] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:15 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:15.511167 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e7ccde55-84ed-4027-86d5-a6b769b516ec tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:15.511803 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e7ccde55-84ed-4027-86d5-a6b769b516ec tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:15.517527 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7ccde55-84ed-4027-86d5-a6b769b516ec tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:15.517975 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7ccde55-84ed-4027-86d5-a6b769b516ec tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:15.518729 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7ccde55-84ed-4027-86d5-a6b769b516ec tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:15.519161 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7ccde55-84ed-4027-86d5-a6b769b516ec tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:15.632858 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e7ccde55-84ed-4027-86d5-a6b769b516ec tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:15.639928 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e7ccde55-84ed-4027-86d5-a6b769b516ec tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.132359 Oct 15 03:45:15.640490 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 486/991] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:15 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:15.716554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-430c9c26-4ca5-4ff3-bc76-2f3f57d287e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:15.717456 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-430c9c26-4ca5-4ff3-bc76-2f3f57d287e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:15.723098 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-430c9c26-4ca5-4ff3-bc76-2f3f57d287e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:15.723543 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-430c9c26-4ca5-4ff3-bc76-2f3f57d287e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:15.724331 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-430c9c26-4ca5-4ff3-bc76-2f3f57d287e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:15.724764 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-430c9c26-4ca5-4ff3-bc76-2f3f57d287e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:15.757444 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-430c9c26-4ca5-4ff3-bc76-2f3f57d287e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045038 Oct 15 03:45:15.758003 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 506/992] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:15 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:16.345553 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-bea5509b-f3c8-428d-bcae-deb7231b932e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:16.346454 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-bea5509b-f3c8-428d-bcae-deb7231b932e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:16.352210 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bea5509b-f3c8-428d-bcae-deb7231b932e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:16.352651 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bea5509b-f3c8-428d-bcae-deb7231b932e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:16.353399 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bea5509b-f3c8-428d-bcae-deb7231b932e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:16.353828 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bea5509b-f3c8-428d-bcae-deb7231b932e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:16.355578 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d60b0a6e-c466-4cd8-8549-aae2524f93f6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:16.356217 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d60b0a6e-c466-4cd8-8549-aae2524f93f6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:16.362255 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d60b0a6e-c466-4cd8-8549-aae2524f93f6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:16.362702 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d60b0a6e-c466-4cd8-8549-aae2524f93f6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:16.363461 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d60b0a6e-c466-4cd8-8549-aae2524f93f6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:16.363923 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d60b0a6e-c466-4cd8-8549-aae2524f93f6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:16.382110 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-bea5509b-f3c8-428d-bcae-deb7231b932e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040224 Oct 15 03:45:16.382656 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 487/993] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:16 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:16.425712 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d60b0a6e-c466-4cd8-8549-aae2524f93f6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:16.433416 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d60b0a6e-c466-4cd8-8549-aae2524f93f6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.081384 Oct 15 03:45:16.433968 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 507/994] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:16 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:16.656655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ab52046f-e9f4-4786-a902-37114d691aa7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:16.657255 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ab52046f-e9f4-4786-a902-37114d691aa7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:16.662798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ab52046f-e9f4-4786-a902-37114d691aa7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:16.663235 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ab52046f-e9f4-4786-a902-37114d691aa7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:16.664012 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ab52046f-e9f4-4786-a902-37114d691aa7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:16.664437 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ab52046f-e9f4-4786-a902-37114d691aa7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:16.768843 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-292f292d-1245-455c-a725-dd02fa0b6567 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:16.769738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-292f292d-1245-455c-a725-dd02fa0b6567 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:16.775420 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-292f292d-1245-455c-a725-dd02fa0b6567 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:16.775916 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-292f292d-1245-455c-a725-dd02fa0b6567 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:16.776674 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-292f292d-1245-455c-a725-dd02fa0b6567 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:16.777098 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-292f292d-1245-455c-a725-dd02fa0b6567 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:16.782753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ab52046f-e9f4-4786-a902-37114d691aa7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:16.790015 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ab52046f-e9f4-4786-a902-37114d691aa7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.137000 Oct 15 03:45:16.790578 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 488/995] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:16 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:16.805486 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-292f292d-1245-455c-a725-dd02fa0b6567 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040358 Oct 15 03:45:16.806018 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 508/996] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:16 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:45:17.393968 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-92eab8ff-b97c-4e8e-ac97-ad9c2b4f91e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:17.394872 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-92eab8ff-b97c-4e8e-ac97-ad9c2b4f91e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:17.401210 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-92eab8ff-b97c-4e8e-ac97-ad9c2b4f91e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:17.401683 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-92eab8ff-b97c-4e8e-ac97-ad9c2b4f91e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:17.402705 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-92eab8ff-b97c-4e8e-ac97-ad9c2b4f91e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:17.403171 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-92eab8ff-b97c-4e8e-ac97-ad9c2b4f91e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:17.431201 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-92eab8ff-b97c-4e8e-ac97-ad9c2b4f91e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041012 Oct 15 03:45:17.431759 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 489/997] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:17 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:17.449622 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-53e37169-cbdc-4873-81b6-7be7a9b757f6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:17.450225 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-53e37169-cbdc-4873-81b6-7be7a9b757f6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:17.455883 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53e37169-cbdc-4873-81b6-7be7a9b757f6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:17.456330 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53e37169-cbdc-4873-81b6-7be7a9b757f6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:17.457083 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53e37169-cbdc-4873-81b6-7be7a9b757f6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:17.457513 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53e37169-cbdc-4873-81b6-7be7a9b757f6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:17.516355 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-53e37169-cbdc-4873-81b6-7be7a9b757f6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:17.523445 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-53e37169-cbdc-4873-81b6-7be7a9b757f6 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077417 Oct 15 03:45:17.524033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 509/998] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:17 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:17.808065 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f07509da-4e49-4a69-8df4-4d2746153f17 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:17.808576 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f07509da-4e49-4a69-8df4-4d2746153f17 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:17.814296 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f07509da-4e49-4a69-8df4-4d2746153f17 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:17.814779 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f07509da-4e49-4a69-8df4-4d2746153f17 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:17.815534 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f07509da-4e49-4a69-8df4-4d2746153f17 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:17.815990 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f07509da-4e49-4a69-8df4-4d2746153f17 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:17.817123 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b468ae53-5516-4382-8993-4e78a1e5e447 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:17.818221 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b468ae53-5516-4382-8993-4e78a1e5e447 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:17.824372 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b468ae53-5516-4382-8993-4e78a1e5e447 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:17.824903 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b468ae53-5516-4382-8993-4e78a1e5e447 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:17.825750 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b468ae53-5516-4382-8993-4e78a1e5e447 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:17.826264 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b468ae53-5516-4382-8993-4e78a1e5e447 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:17.855150 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b468ae53-5516-4382-8993-4e78a1e5e447 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042003 Oct 15 03:45:17.855714 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 510/999] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:17 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:45:17.931197 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f07509da-4e49-4a69-8df4-4d2746153f17 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:17.938338 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f07509da-4e49-4a69-8df4-4d2746153f17 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.134799 Oct 15 03:45:17.938887 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 490/1000] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:17 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:18.442133 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6a02a553-8d8e-46b1-9fdc-237ead33e510 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:18.442971 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6a02a553-8d8e-46b1-9fdc-237ead33e510 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:18.449360 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6a02a553-8d8e-46b1-9fdc-237ead33e510 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:18.449808 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6a02a553-8d8e-46b1-9fdc-237ead33e510 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:18.450567 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6a02a553-8d8e-46b1-9fdc-237ead33e510 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:18.450998 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6a02a553-8d8e-46b1-9fdc-237ead33e510 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:18.479182 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6a02a553-8d8e-46b1-9fdc-237ead33e510 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040923 Oct 15 03:45:18.479734 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 511/1001] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:18 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:18.540294 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-02e9ef73-3391-4876-9d04-79e3eaadb7ef tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:18.540907 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-02e9ef73-3391-4876-9d04-79e3eaadb7ef tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:18.546797 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-02e9ef73-3391-4876-9d04-79e3eaadb7ef tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:18.547248 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-02e9ef73-3391-4876-9d04-79e3eaadb7ef tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:18.548049 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-02e9ef73-3391-4876-9d04-79e3eaadb7ef tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:18.548486 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-02e9ef73-3391-4876-9d04-79e3eaadb7ef tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:18.606145 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-02e9ef73-3391-4876-9d04-79e3eaadb7ef tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:18.613231 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-02e9ef73-3391-4876-9d04-79e3eaadb7ef tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.076565 Oct 15 03:45:18.613791 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 491/1002] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:18 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:18.866212 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cbe395ec-9c2a-482d-9e6b-9e38bb36524a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:18.867150 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cbe395ec-9c2a-482d-9e6b-9e38bb36524a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:18.872932 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cbe395ec-9c2a-482d-9e6b-9e38bb36524a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:18.873375 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cbe395ec-9c2a-482d-9e6b-9e38bb36524a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:18.874128 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cbe395ec-9c2a-482d-9e6b-9e38bb36524a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:18.874560 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cbe395ec-9c2a-482d-9e6b-9e38bb36524a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:18.902148 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cbe395ec-9c2a-482d-9e6b-9e38bb36524a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039702 Oct 15 03:45:18.902675 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 512/1003] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:18 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:18.954850 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-feb95675-7801-4e4e-b5d3-5ec10f73cf33 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:18.955452 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-feb95675-7801-4e4e-b5d3-5ec10f73cf33 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:18.961598 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-feb95675-7801-4e4e-b5d3-5ec10f73cf33 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:18.962045 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-feb95675-7801-4e4e-b5d3-5ec10f73cf33 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:18.962800 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-feb95675-7801-4e4e-b5d3-5ec10f73cf33 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:18.963230 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-feb95675-7801-4e4e-b5d3-5ec10f73cf33 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:19.085550 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-feb95675-7801-4e4e-b5d3-5ec10f73cf33 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:19.093268 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-feb95675-7801-4e4e-b5d3-5ec10f73cf33 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.141974 Oct 15 03:45:19.093824 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 492/1004] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:18 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:19.490296 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-96a4173a-76e1-4d14-af20-50dbaa84cf9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:19.491194 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-96a4173a-76e1-4d14-af20-50dbaa84cf9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:19.497826 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96a4173a-76e1-4d14-af20-50dbaa84cf9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:19.498208 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96a4173a-76e1-4d14-af20-50dbaa84cf9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:19.499006 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96a4173a-76e1-4d14-af20-50dbaa84cf9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:19.499455 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96a4173a-76e1-4d14-af20-50dbaa84cf9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:19.527585 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-96a4173a-76e1-4d14-af20-50dbaa84cf9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041014 Oct 15 03:45:19.528153 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 513/1005] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:19 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:19.629924 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7841c65a-b7a5-4000-944b-a30774265be5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:19.630532 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7841c65a-b7a5-4000-944b-a30774265be5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:19.636277 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7841c65a-b7a5-4000-944b-a30774265be5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:19.636729 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7841c65a-b7a5-4000-944b-a30774265be5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:19.637483 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7841c65a-b7a5-4000-944b-a30774265be5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:19.637914 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7841c65a-b7a5-4000-944b-a30774265be5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:19.695031 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7841c65a-b7a5-4000-944b-a30774265be5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:19.702151 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7841c65a-b7a5-4000-944b-a30774265be5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.075850 Oct 15 03:45:19.702706 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 493/1006] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:19 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:19.913406 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6daf70b6-2e5c-4035-9c73-96d4cf1ea8cd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:19.914225 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6daf70b6-2e5c-4035-9c73-96d4cf1ea8cd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:19.920483 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6daf70b6-2e5c-4035-9c73-96d4cf1ea8cd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:19.920924 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6daf70b6-2e5c-4035-9c73-96d4cf1ea8cd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:19.921672 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6daf70b6-2e5c-4035-9c73-96d4cf1ea8cd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:19.922105 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6daf70b6-2e5c-4035-9c73-96d4cf1ea8cd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:19.949933 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6daf70b6-2e5c-4035-9c73-96d4cf1ea8cd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040355 Oct 15 03:45:19.950464 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 514/1007] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:19 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:20.110623 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-835ad119-309a-4c5b-9b82-120580059260 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:20.111227 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-835ad119-309a-4c5b-9b82-120580059260 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:20.117037 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-835ad119-309a-4c5b-9b82-120580059260 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:20.117485 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-835ad119-309a-4c5b-9b82-120580059260 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:20.118264 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-835ad119-309a-4c5b-9b82-120580059260 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:20.118697 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-835ad119-309a-4c5b-9b82-120580059260 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:20.323848 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-835ad119-309a-4c5b-9b82-120580059260 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:20.331265 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-835ad119-309a-4c5b-9b82-120580059260 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.224308 Oct 15 03:45:20.331854 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 494/1008] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:20 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:20.538178 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-45226416-d8ae-4a6f-9ed2-fc8d7df2b604 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:20.539092 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-45226416-d8ae-4a6f-9ed2-fc8d7df2b604 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:20.545120 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45226416-d8ae-4a6f-9ed2-fc8d7df2b604 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:20.545564 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45226416-d8ae-4a6f-9ed2-fc8d7df2b604 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:20.546316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45226416-d8ae-4a6f-9ed2-fc8d7df2b604 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:20.546758 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45226416-d8ae-4a6f-9ed2-fc8d7df2b604 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:20.574691 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-45226416-d8ae-4a6f-9ed2-fc8d7df2b604 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040252 Oct 15 03:45:20.575214 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 515/1009] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:20 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:20.721944 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3c537660-38e0-4100-9630-344bdd7cf5cd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:20.722543 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3c537660-38e0-4100-9630-344bdd7cf5cd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:20.728162 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3c537660-38e0-4100-9630-344bdd7cf5cd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:20.728604 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3c537660-38e0-4100-9630-344bdd7cf5cd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:20.729354 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3c537660-38e0-4100-9630-344bdd7cf5cd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:20.729783 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3c537660-38e0-4100-9630-344bdd7cf5cd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:20.789982 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3c537660-38e0-4100-9630-344bdd7cf5cd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:20.797027 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3c537660-38e0-4100-9630-344bdd7cf5cd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.078674 Oct 15 03:45:20.797582 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 495/1010] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:20 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:20.961476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c6f34fb8-f555-40ab-b005-6cdfbe710d95 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:20.962397 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c6f34fb8-f555-40ab-b005-6cdfbe710d95 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:20.968088 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c6f34fb8-f555-40ab-b005-6cdfbe710d95 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:20.968526 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c6f34fb8-f555-40ab-b005-6cdfbe710d95 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:20.969275 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c6f34fb8-f555-40ab-b005-6cdfbe710d95 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:20.969702 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c6f34fb8-f555-40ab-b005-6cdfbe710d95 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:20.999425 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c6f34fb8-f555-40ab-b005-6cdfbe710d95 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041950 Oct 15 03:45:21.000002 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 516/1011] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:20 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:21.353573 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-82fae52f-fcd9-4dc0-aa8a-1d7ebb99bbf5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:21.354676 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-82fae52f-fcd9-4dc0-aa8a-1d7ebb99bbf5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:21.360471 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-82fae52f-fcd9-4dc0-aa8a-1d7ebb99bbf5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:21.361261 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-82fae52f-fcd9-4dc0-aa8a-1d7ebb99bbf5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:21.362263 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-82fae52f-fcd9-4dc0-aa8a-1d7ebb99bbf5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:21.362697 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-82fae52f-fcd9-4dc0-aa8a-1d7ebb99bbf5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:21.483089 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-82fae52f-fcd9-4dc0-aa8a-1d7ebb99bbf5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:21.490287 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-82fae52f-fcd9-4dc0-aa8a-1d7ebb99bbf5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.140361 Oct 15 03:45:21.490849 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 496/1012] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:21 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:21.586023 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4bac20f0-61cd-4d77-9a25-6a91b6e15414 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:21.586848 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4bac20f0-61cd-4d77-9a25-6a91b6e15414 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:21.593454 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4bac20f0-61cd-4d77-9a25-6a91b6e15414 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:21.593906 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4bac20f0-61cd-4d77-9a25-6a91b6e15414 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:21.594665 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4bac20f0-61cd-4d77-9a25-6a91b6e15414 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:21.595103 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4bac20f0-61cd-4d77-9a25-6a91b6e15414 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:21.624280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4bac20f0-61cd-4d77-9a25-6a91b6e15414 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042296 Oct 15 03:45:21.624807 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 517/1013] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:21 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:21.812999 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8869667a-7ef6-4c23-bb2a-947eb19e381c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:21.813605 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8869667a-7ef6-4c23-bb2a-947eb19e381c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:21.819296 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8869667a-7ef6-4c23-bb2a-947eb19e381c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:21.819782 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8869667a-7ef6-4c23-bb2a-947eb19e381c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:21.820547 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8869667a-7ef6-4c23-bb2a-947eb19e381c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:21.820981 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8869667a-7ef6-4c23-bb2a-947eb19e381c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:21.878262 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8869667a-7ef6-4c23-bb2a-947eb19e381c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:21.885872 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8869667a-7ef6-4c23-bb2a-947eb19e381c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.075840 Oct 15 03:45:21.886440 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 497/1014] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:21 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:22.010615 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5d807106-32dc-48e0-8f94-34611e0db487 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:22.011503 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5d807106-32dc-48e0-8f94-34611e0db487 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:22.017229 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5d807106-32dc-48e0-8f94-34611e0db487 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:22.017671 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5d807106-32dc-48e0-8f94-34611e0db487 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:22.018419 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5d807106-32dc-48e0-8f94-34611e0db487 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:22.018843 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5d807106-32dc-48e0-8f94-34611e0db487 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:22.046589 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5d807106-32dc-48e0-8f94-34611e0db487 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039771 Oct 15 03:45:22.047117 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 518/1015] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:22 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:22.506791 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a8507669-ccab-43fe-baf1-3355aeb5251c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:22.507390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a8507669-ccab-43fe-baf1-3355aeb5251c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:22.513096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a8507669-ccab-43fe-baf1-3355aeb5251c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:22.513537 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a8507669-ccab-43fe-baf1-3355aeb5251c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:22.514287 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a8507669-ccab-43fe-baf1-3355aeb5251c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:22.514714 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a8507669-ccab-43fe-baf1-3355aeb5251c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:22.629250 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-a8507669-ccab-43fe-baf1-3355aeb5251c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:22.635278 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-65d846b7-d19f-45f7-820d-ef85d12c08a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:22.636218 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-65d846b7-d19f-45f7-820d-ef85d12c08a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:22.636783 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a8507669-ccab-43fe-baf1-3355aeb5251c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.133531 Oct 15 03:45:22.637352 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 498/1016] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:22 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:22.641868 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-65d846b7-d19f-45f7-820d-ef85d12c08a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:22.642312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-65d846b7-d19f-45f7-820d-ef85d12c08a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:22.643067 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-65d846b7-d19f-45f7-820d-ef85d12c08a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:22.643496 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-65d846b7-d19f-45f7-820d-ef85d12c08a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:22.672023 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-65d846b7-d19f-45f7-820d-ef85d12c08a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040408 Oct 15 03:45:22.672554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 519/1017] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:22 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:45:22.902619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4236100d-79e1-44cd-a5bb-9fce4aeaa280 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:22.903183 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4236100d-79e1-44cd-a5bb-9fce4aeaa280 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:22.908823 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4236100d-79e1-44cd-a5bb-9fce4aeaa280 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:22.909270 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4236100d-79e1-44cd-a5bb-9fce4aeaa280 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:22.910032 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4236100d-79e1-44cd-a5bb-9fce4aeaa280 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:22.910461 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4236100d-79e1-44cd-a5bb-9fce4aeaa280 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:22.971122 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4236100d-79e1-44cd-a5bb-9fce4aeaa280 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:22.978217 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4236100d-79e1-44cd-a5bb-9fce4aeaa280 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.079808 Oct 15 03:45:22.978780 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 499/1018] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:22 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:23.057833 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-58c7713b-3367-4a40-9d41-3027a64eaffa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:23.058779 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-58c7713b-3367-4a40-9d41-3027a64eaffa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:23.064482 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-58c7713b-3367-4a40-9d41-3027a64eaffa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:23.064928 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-58c7713b-3367-4a40-9d41-3027a64eaffa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:23.065683 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-58c7713b-3367-4a40-9d41-3027a64eaffa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:23.066116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-58c7713b-3367-4a40-9d41-3027a64eaffa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:23.094844 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-58c7713b-3367-4a40-9d41-3027a64eaffa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040935 Oct 15 03:45:23.095370 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 520/1019] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:23 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:23.653730 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-09a9d78f-8300-4d37-939f-5aba0c115be4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:23.654261 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-09a9d78f-8300-4d37-939f-5aba0c115be4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:23.660043 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09a9d78f-8300-4d37-939f-5aba0c115be4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:23.660490 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09a9d78f-8300-4d37-939f-5aba0c115be4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:23.661241 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09a9d78f-8300-4d37-939f-5aba0c115be4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:23.661672 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09a9d78f-8300-4d37-939f-5aba0c115be4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:23.683764 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-95f8ccb0-3259-44d6-9e0c-b6f082680db8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:23.684663 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-95f8ccb0-3259-44d6-9e0c-b6f082680db8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:23.690482 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-95f8ccb0-3259-44d6-9e0c-b6f082680db8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:23.690945 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-95f8ccb0-3259-44d6-9e0c-b6f082680db8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:23.691704 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-95f8ccb0-3259-44d6-9e0c-b6f082680db8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:23.692169 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-95f8ccb0-3259-44d6-9e0c-b6f082680db8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:23.720333 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-95f8ccb0-3259-44d6-9e0c-b6f082680db8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040956 Oct 15 03:45:23.720954 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 521/1020] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:23 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:45:23.785192 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-09a9d78f-8300-4d37-939f-5aba0c115be4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:23.792887 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-09a9d78f-8300-4d37-939f-5aba0c115be4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.142980 Oct 15 03:45:23.793461 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 500/1021] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:23 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:23.993886 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e7650bbd-f09e-47e6-a54d-275f99b1bc0f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:23.994521 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e7650bbd-f09e-47e6-a54d-275f99b1bc0f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:24.001838 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e7650bbd-f09e-47e6-a54d-275f99b1bc0f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:24.002619 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e7650bbd-f09e-47e6-a54d-275f99b1bc0f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:24.003760 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e7650bbd-f09e-47e6-a54d-275f99b1bc0f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:24.004149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e7650bbd-f09e-47e6-a54d-275f99b1bc0f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:24.061330 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e7650bbd-f09e-47e6-a54d-275f99b1bc0f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:24.068518 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e7650bbd-f09e-47e6-a54d-275f99b1bc0f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.078268 Oct 15 03:45:24.069065 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 522/1022] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:23 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:24.105734 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-93d33736-ae06-42f9-a326-b96aa206f32b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:24.106698 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-93d33736-ae06-42f9-a326-b96aa206f32b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:24.112327 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-93d33736-ae06-42f9-a326-b96aa206f32b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:24.112779 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-93d33736-ae06-42f9-a326-b96aa206f32b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:24.113536 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-93d33736-ae06-42f9-a326-b96aa206f32b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:24.113976 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-93d33736-ae06-42f9-a326-b96aa206f32b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:24.141230 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-93d33736-ae06-42f9-a326-b96aa206f32b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039916 Oct 15 03:45:24.141762 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 501/1023] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:24 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:24.731443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bbf38bf9-5d85-484a-a8a8-9625d579fd6f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:24.732416 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bbf38bf9-5d85-484a-a8a8-9625d579fd6f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:24.738077 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bbf38bf9-5d85-484a-a8a8-9625d579fd6f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:24.738525 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bbf38bf9-5d85-484a-a8a8-9625d579fd6f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:24.739312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bbf38bf9-5d85-484a-a8a8-9625d579fd6f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:24.739848 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bbf38bf9-5d85-484a-a8a8-9625d579fd6f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:24.768548 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bbf38bf9-5d85-484a-a8a8-9625d579fd6f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040808 Oct 15 03:45:24.769086 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 523/1024] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:24 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:24.809977 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-92c1cbea-d841-4d28-a9ad-12a66eb29259 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:24.810587 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-92c1cbea-d841-4d28-a9ad-12a66eb29259 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:24.816284 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-92c1cbea-d841-4d28-a9ad-12a66eb29259 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:24.816739 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-92c1cbea-d841-4d28-a9ad-12a66eb29259 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:24.817500 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-92c1cbea-d841-4d28-a9ad-12a66eb29259 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:24.817934 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-92c1cbea-d841-4d28-a9ad-12a66eb29259 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:24.934777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-92c1cbea-d841-4d28-a9ad-12a66eb29259 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:24.941902 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-92c1cbea-d841-4d28-a9ad-12a66eb29259 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.136098 Oct 15 03:45:24.942465 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 502/1025] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:24 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:25.085084 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-54205b06-8cea-4458-94fd-4170af92c300 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:25.085696 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-54205b06-8cea-4458-94fd-4170af92c300 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:25.091326 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-54205b06-8cea-4458-94fd-4170af92c300 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:25.091861 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-54205b06-8cea-4458-94fd-4170af92c300 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:25.092610 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-54205b06-8cea-4458-94fd-4170af92c300 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:25.093036 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-54205b06-8cea-4458-94fd-4170af92c300 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:25.149811 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-54205b06-8cea-4458-94fd-4170af92c300 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:25.152770 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-df529d35-3a60-4672-985e-f31478db89c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:25.153814 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-df529d35-3a60-4672-985e-f31478db89c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:25.157281 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-54205b06-8cea-4458-94fd-4170af92c300 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.076020 Oct 15 03:45:25.157842 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 524/1026] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:25 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:25.159606 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-df529d35-3a60-4672-985e-f31478db89c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:25.160108 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-df529d35-3a60-4672-985e-f31478db89c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:25.160881 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-df529d35-3a60-4672-985e-f31478db89c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:25.161327 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-df529d35-3a60-4672-985e-f31478db89c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:25.190245 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-df529d35-3a60-4672-985e-f31478db89c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041331 Oct 15 03:45:25.190793 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 503/1027] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:25 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:45:25.779761 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5f6bbc98-28b1-49cd-8f49-71af36324402 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:25.780674 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5f6bbc98-28b1-49cd-8f49-71af36324402 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:25.786462 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5f6bbc98-28b1-49cd-8f49-71af36324402 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:25.786907 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5f6bbc98-28b1-49cd-8f49-71af36324402 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:25.787665 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5f6bbc98-28b1-49cd-8f49-71af36324402 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:25.788122 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5f6bbc98-28b1-49cd-8f49-71af36324402 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:25.820368 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5f6bbc98-28b1-49cd-8f49-71af36324402 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 Oct 15 03:45:25.820925 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 525/1028] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:25 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:25.959165 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b50ac5f7-a1f1-4e25-82d8-b2c76e37f8a2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:25.960146 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b50ac5f7-a1f1-4e25-82d8-b2c76e37f8a2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:25.966194 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b50ac5f7-a1f1-4e25-82d8-b2c76e37f8a2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:25.966645 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b50ac5f7-a1f1-4e25-82d8-b2c76e37f8a2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:25.967404 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b50ac5f7-a1f1-4e25-82d8-b2c76e37f8a2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:25.967875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b50ac5f7-a1f1-4e25-82d8-b2c76e37f8a2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:26.082836 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b50ac5f7-a1f1-4e25-82d8-b2c76e37f8a2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:26.090737 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b50ac5f7-a1f1-4e25-82d8-b2c76e37f8a2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.135187 Oct 15 03:45:26.091302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 504/1029] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:25 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:26.175206 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d6ce2472-e291-4ff1-86e0-fb9781367999 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:26.175206 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d6ce2472-e291-4ff1-86e0-fb9781367999 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:26.179852 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6ce2472-e291-4ff1-86e0-fb9781367999 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:26.180318 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6ce2472-e291-4ff1-86e0-fb9781367999 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:26.181066 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6ce2472-e291-4ff1-86e0-fb9781367999 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:26.181491 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6ce2472-e291-4ff1-86e0-fb9781367999 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:26.201368 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c5a32418-5830-427c-9260-b8c87bcb4c49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:26.202360 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c5a32418-5830-427c-9260-b8c87bcb4c49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:26.208047 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c5a32418-5830-427c-9260-b8c87bcb4c49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:26.208499 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c5a32418-5830-427c-9260-b8c87bcb4c49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:26.209266 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c5a32418-5830-427c-9260-b8c87bcb4c49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:26.209704 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c5a32418-5830-427c-9260-b8c87bcb4c49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:26.240200 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c5a32418-5830-427c-9260-b8c87bcb4c49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042487 Oct 15 03:45:26.240997 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d6ce2472-e291-4ff1-86e0-fb9781367999 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:26.241159 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 505/1030] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:26 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:45:26.248260 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d6ce2472-e291-4ff1-86e0-fb9781367999 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.078334 Oct 15 03:45:26.248804 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 526/1031] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:26 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:26.831368 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-48a52ec0-43cd-455c-b224-6f3e2c4d16a8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:26.832304 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-48a52ec0-43cd-455c-b224-6f3e2c4d16a8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:26.838840 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-48a52ec0-43cd-455c-b224-6f3e2c4d16a8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:26.839274 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-48a52ec0-43cd-455c-b224-6f3e2c4d16a8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:26.840064 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-48a52ec0-43cd-455c-b224-6f3e2c4d16a8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:26.840534 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-48a52ec0-43cd-455c-b224-6f3e2c4d16a8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:26.868011 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-48a52ec0-43cd-455c-b224-6f3e2c4d16a8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040411 Oct 15 03:45:26.868551 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 506/1032] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:26 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:27.107428 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cba91c8f-58a0-4ab3-8cfd-0ce753fe8674 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:27.108022 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cba91c8f-58a0-4ab3-8cfd-0ce753fe8674 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:27.113664 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cba91c8f-58a0-4ab3-8cfd-0ce753fe8674 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:27.114111 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cba91c8f-58a0-4ab3-8cfd-0ce753fe8674 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:27.114864 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cba91c8f-58a0-4ab3-8cfd-0ce753fe8674 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:27.115296 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cba91c8f-58a0-4ab3-8cfd-0ce753fe8674 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:27.232473 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-cba91c8f-58a0-4ab3-8cfd-0ce753fe8674 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:27.239673 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cba91c8f-58a0-4ab3-8cfd-0ce753fe8674 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.135909 Oct 15 03:45:27.240252 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 527/1033] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:27 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:27.251659 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ca762e94-7273-4ab1-b873-9d760d8b90b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:27.252579 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ca762e94-7273-4ab1-b873-9d760d8b90b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:27.258381 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca762e94-7273-4ab1-b873-9d760d8b90b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:27.258827 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca762e94-7273-4ab1-b873-9d760d8b90b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:27.259589 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca762e94-7273-4ab1-b873-9d760d8b90b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:27.260036 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca762e94-7273-4ab1-b873-9d760d8b90b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:27.264341 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-18fd0589-2ffe-4773-9ec7-5453c2c5871a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:27.264942 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-18fd0589-2ffe-4773-9ec7-5453c2c5871a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:27.270604 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18fd0589-2ffe-4773-9ec7-5453c2c5871a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:27.271047 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18fd0589-2ffe-4773-9ec7-5453c2c5871a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:27.271898 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18fd0589-2ffe-4773-9ec7-5453c2c5871a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:27.272324 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18fd0589-2ffe-4773-9ec7-5453c2c5871a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:27.288204 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ca762e94-7273-4ab1-b873-9d760d8b90b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040169 Oct 15 03:45:27.288758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 507/1034] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:27 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:27.329802 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-18fd0589-2ffe-4773-9ec7-5453c2c5871a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:27.337095 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-18fd0589-2ffe-4773-9ec7-5453c2c5871a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.076225 Oct 15 03:45:27.337623 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 528/1035] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:27 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:27.879789 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-70696b34-5d0f-4a4a-897f-a5badf112f16 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:27.880746 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-70696b34-5d0f-4a4a-897f-a5badf112f16 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:27.886675 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70696b34-5d0f-4a4a-897f-a5badf112f16 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:27.887123 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70696b34-5d0f-4a4a-897f-a5badf112f16 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:27.887924 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70696b34-5d0f-4a4a-897f-a5badf112f16 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:27.888356 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70696b34-5d0f-4a4a-897f-a5badf112f16 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:27.917993 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-70696b34-5d0f-4a4a-897f-a5badf112f16 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042078 Oct 15 03:45:27.918524 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 508/1036] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:27 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:28.256216 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d7d397b8-c0cc-41dd-9bc7-101136cd7182 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:28.256825 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d7d397b8-c0cc-41dd-9bc7-101136cd7182 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:28.263087 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7d397b8-c0cc-41dd-9bc7-101136cd7182 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:28.263524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7d397b8-c0cc-41dd-9bc7-101136cd7182 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:28.264303 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7d397b8-c0cc-41dd-9bc7-101136cd7182 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:28.264729 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7d397b8-c0cc-41dd-9bc7-101136cd7182 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:28.299756 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c2aa99dd-e999-4d12-b49b-e231d4b69616 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:28.300672 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c2aa99dd-e999-4d12-b49b-e231d4b69616 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:28.306390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c2aa99dd-e999-4d12-b49b-e231d4b69616 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:28.306835 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c2aa99dd-e999-4d12-b49b-e231d4b69616 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:28.307624 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c2aa99dd-e999-4d12-b49b-e231d4b69616 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:28.308076 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c2aa99dd-e999-4d12-b49b-e231d4b69616 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:28.337141 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c2aa99dd-e999-4d12-b49b-e231d4b69616 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041038 Oct 15 03:45:28.337700 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 509/1037] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:28 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:45:28.352928 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-429d4687-da9b-4c11-98d1-6cb50f96965c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:28.353518 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-429d4687-da9b-4c11-98d1-6cb50f96965c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:28.358945 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-429d4687-da9b-4c11-98d1-6cb50f96965c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:28.359392 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-429d4687-da9b-4c11-98d1-6cb50f96965c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:28.360487 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-429d4687-da9b-4c11-98d1-6cb50f96965c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:28.361268 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-429d4687-da9b-4c11-98d1-6cb50f96965c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:28.382887 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d7d397b8-c0cc-41dd-9bc7-101136cd7182 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:28.390638 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d7d397b8-c0cc-41dd-9bc7-101136cd7182 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.138032 Oct 15 03:45:28.391201 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 529/1038] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:28 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:28.422301 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-429d4687-da9b-4c11-98d1-6cb50f96965c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:28.429528 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-429d4687-da9b-4c11-98d1-6cb50f96965c tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.080081 Oct 15 03:45:28.430088 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 510/1039] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:28 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:28.929156 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f756258a-28bc-41f5-8a14-a9288d2c3d71 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:28.930087 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f756258a-28bc-41f5-8a14-a9288d2c3d71 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:28.936569 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f756258a-28bc-41f5-8a14-a9288d2c3d71 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:28.937007 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f756258a-28bc-41f5-8a14-a9288d2c3d71 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:28.937750 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f756258a-28bc-41f5-8a14-a9288d2c3d71 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:28.938174 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f756258a-28bc-41f5-8a14-a9288d2c3d71 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:28.965733 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f756258a-28bc-41f5-8a14-a9288d2c3d71 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040326 Oct 15 03:45:28.966265 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 530/1040] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:28 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:29.349421 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3ec12d29-ae1e-44a9-8558-2eaac7563bb0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:29.350318 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3ec12d29-ae1e-44a9-8558-2eaac7563bb0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:29.356004 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3ec12d29-ae1e-44a9-8558-2eaac7563bb0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:29.356447 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3ec12d29-ae1e-44a9-8558-2eaac7563bb0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:29.357196 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3ec12d29-ae1e-44a9-8558-2eaac7563bb0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:29.357623 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3ec12d29-ae1e-44a9-8558-2eaac7563bb0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:29.387215 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3ec12d29-ae1e-44a9-8558-2eaac7563bb0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041789 Oct 15 03:45:29.387792 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 511/1041] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:29 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:29.407082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4d94223d-75c5-4cec-b4fb-57035513ac3b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:29.407705 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4d94223d-75c5-4cec-b4fb-57035513ac3b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:29.413422 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4d94223d-75c5-4cec-b4fb-57035513ac3b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:29.413866 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4d94223d-75c5-4cec-b4fb-57035513ac3b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:29.414612 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4d94223d-75c5-4cec-b4fb-57035513ac3b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:29.415042 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4d94223d-75c5-4cec-b4fb-57035513ac3b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:29.446107 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-eb193f06-2102-4854-9788-84b14d307d6a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:29.446717 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-eb193f06-2102-4854-9788-84b14d307d6a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:29.453027 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eb193f06-2102-4854-9788-84b14d307d6a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:29.453477 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eb193f06-2102-4854-9788-84b14d307d6a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:29.454239 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eb193f06-2102-4854-9788-84b14d307d6a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:29.454675 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eb193f06-2102-4854-9788-84b14d307d6a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:29.528586 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-eb193f06-2102-4854-9788-84b14d307d6a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:29.535868 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-eb193f06-2102-4854-9788-84b14d307d6a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.093348 Oct 15 03:45:29.536433 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 512/1042] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:29 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:29.547593 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4d94223d-75c5-4cec-b4fb-57035513ac3b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:29.554726 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4d94223d-75c5-4cec-b4fb-57035513ac3b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.151235 Oct 15 03:45:29.555268 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 531/1043] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:29 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:29.976848 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b13a98ec-d196-4f41-ab10-80982b91d004 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:29.977664 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b13a98ec-d196-4f41-ab10-80982b91d004 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:29.984122 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b13a98ec-d196-4f41-ab10-80982b91d004 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:29.984563 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b13a98ec-d196-4f41-ab10-80982b91d004 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:29.985308 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b13a98ec-d196-4f41-ab10-80982b91d004 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:29.985732 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b13a98ec-d196-4f41-ab10-80982b91d004 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:30.013020 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b13a98ec-d196-4f41-ab10-80982b91d004 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039949 Oct 15 03:45:30.013544 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 513/1044] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:29 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:30.397588 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5d0e2d2c-f64a-4912-82b4-0e9dbf6334f1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:30.398486 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5d0e2d2c-f64a-4912-82b4-0e9dbf6334f1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:30.404876 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5d0e2d2c-f64a-4912-82b4-0e9dbf6334f1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:30.405320 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5d0e2d2c-f64a-4912-82b4-0e9dbf6334f1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:30.406070 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5d0e2d2c-f64a-4912-82b4-0e9dbf6334f1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:30.406499 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5d0e2d2c-f64a-4912-82b4-0e9dbf6334f1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:30.433901 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5d0e2d2c-f64a-4912-82b4-0e9dbf6334f1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040079 Oct 15 03:45:30.434462 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 532/1045] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:30 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:30.552759 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-75034e27-f9c5-4caa-9abb-ec22dcdb4b5f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:30.553335 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-75034e27-f9c5-4caa-9abb-ec22dcdb4b5f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:30.559093 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-75034e27-f9c5-4caa-9abb-ec22dcdb4b5f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:30.559543 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-75034e27-f9c5-4caa-9abb-ec22dcdb4b5f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:30.560590 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-75034e27-f9c5-4caa-9abb-ec22dcdb4b5f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:30.561027 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-75034e27-f9c5-4caa-9abb-ec22dcdb4b5f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:30.572150 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7daedc2e-5605-46fd-bc5a-5c97d772e676 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:30.573277 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7daedc2e-5605-46fd-bc5a-5c97d772e676 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:30.578843 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7daedc2e-5605-46fd-bc5a-5c97d772e676 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:30.579280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7daedc2e-5605-46fd-bc5a-5c97d772e676 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:30.580072 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7daedc2e-5605-46fd-bc5a-5c97d772e676 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:30.580527 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7daedc2e-5605-46fd-bc5a-5c97d772e676 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:30.620588 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-75034e27-f9c5-4caa-9abb-ec22dcdb4b5f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:30.627842 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-75034e27-f9c5-4caa-9abb-ec22dcdb4b5f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.078648 Oct 15 03:45:30.628400 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 514/1046] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:30 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:30.706601 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7daedc2e-5605-46fd-bc5a-5c97d772e676 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:30.714051 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7daedc2e-5605-46fd-bc5a-5c97d772e676 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.145456 Oct 15 03:45:30.714610 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 533/1047] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:30 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:31.024560 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ea77f007-fac4-48b1-b0d4-a960c4129971 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:31.025462 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ea77f007-fac4-48b1-b0d4-a960c4129971 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:31.031112 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea77f007-fac4-48b1-b0d4-a960c4129971 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:31.031553 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea77f007-fac4-48b1-b0d4-a960c4129971 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:31.032342 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea77f007-fac4-48b1-b0d4-a960c4129971 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:31.032770 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea77f007-fac4-48b1-b0d4-a960c4129971 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:31.061775 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ea77f007-fac4-48b1-b0d4-a960c4129971 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041286 Oct 15 03:45:31.062326 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 515/1048] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:31 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:31.445350 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-854be3b4-3687-4160-810f-70b8625c86ac tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:31.446202 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-854be3b4-3687-4160-810f-70b8625c86ac tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:31.452212 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-854be3b4-3687-4160-810f-70b8625c86ac tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:31.452657 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-854be3b4-3687-4160-810f-70b8625c86ac tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:31.453412 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-854be3b4-3687-4160-810f-70b8625c86ac tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:31.453871 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-854be3b4-3687-4160-810f-70b8625c86ac tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:31.483026 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-854be3b4-3687-4160-810f-70b8625c86ac tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041553 Oct 15 03:45:31.483570 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 534/1049] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:31 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:31.644919 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-72461f53-b8b2-45e7-90be-6895be4632ad tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:31.645520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-72461f53-b8b2-45e7-90be-6895be4632ad tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:31.651651 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-72461f53-b8b2-45e7-90be-6895be4632ad tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:31.652121 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-72461f53-b8b2-45e7-90be-6895be4632ad tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:31.652868 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-72461f53-b8b2-45e7-90be-6895be4632ad tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:31.653292 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-72461f53-b8b2-45e7-90be-6895be4632ad tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:31.711289 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-72461f53-b8b2-45e7-90be-6895be4632ad tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:31.719179 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-72461f53-b8b2-45e7-90be-6895be4632ad tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077869 Oct 15 03:45:31.719743 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 516/1050] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:31 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:31.732678 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-08797c2d-e65b-4e13-b6f2-37873ca0ed21 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:31.733293 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-08797c2d-e65b-4e13-b6f2-37873ca0ed21 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:31.739418 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-08797c2d-e65b-4e13-b6f2-37873ca0ed21 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:31.739918 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-08797c2d-e65b-4e13-b6f2-37873ca0ed21 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:31.740666 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-08797c2d-e65b-4e13-b6f2-37873ca0ed21 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:31.741116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-08797c2d-e65b-4e13-b6f2-37873ca0ed21 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:31.858652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-08797c2d-e65b-4e13-b6f2-37873ca0ed21 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:31.865999 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-08797c2d-e65b-4e13-b6f2-37873ca0ed21 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.138166 Oct 15 03:45:31.866551 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 535/1051] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:31 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:32.073434 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6517974c-520b-473e-8639-cf76d1ea0fcf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:32.074339 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6517974c-520b-473e-8639-cf76d1ea0fcf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:32.080033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6517974c-520b-473e-8639-cf76d1ea0fcf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:32.080481 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6517974c-520b-473e-8639-cf76d1ea0fcf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:32.081236 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6517974c-520b-473e-8639-cf76d1ea0fcf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:32.081669 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6517974c-520b-473e-8639-cf76d1ea0fcf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:32.110030 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6517974c-520b-473e-8639-cf76d1ea0fcf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040859 Oct 15 03:45:32.110557 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 517/1052] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:32 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:32.493994 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-48c88ed8-67ff-404a-9364-465226e118b8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:32.495503 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-48c88ed8-67ff-404a-9364-465226e118b8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:32.501236 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-48c88ed8-67ff-404a-9364-465226e118b8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:32.501675 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-48c88ed8-67ff-404a-9364-465226e118b8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:32.502420 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-48c88ed8-67ff-404a-9364-465226e118b8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:32.502850 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-48c88ed8-67ff-404a-9364-465226e118b8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:32.530055 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-48c88ed8-67ff-404a-9364-465226e118b8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039882 Oct 15 03:45:32.530579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 536/1053] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:32 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:45:32.735526 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3f2f4f9b-5637-4e5f-9a22-d452b4014c54 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:32.736139 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3f2f4f9b-5637-4e5f-9a22-d452b4014c54 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:32.741907 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f2f4f9b-5637-4e5f-9a22-d452b4014c54 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:32.743154 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f2f4f9b-5637-4e5f-9a22-d452b4014c54 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:32.744128 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f2f4f9b-5637-4e5f-9a22-d452b4014c54 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:32.745179 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f2f4f9b-5637-4e5f-9a22-d452b4014c54 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:32.803257 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3f2f4f9b-5637-4e5f-9a22-d452b4014c54 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:32.811114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3f2f4f9b-5637-4e5f-9a22-d452b4014c54 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.079178 Oct 15 03:45:32.811674 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 518/1054] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:32 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:32.883102 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5ee51402-5178-4784-a861-deb58214e4b4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:32.884021 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5ee51402-5178-4784-a861-deb58214e4b4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:32.889638 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5ee51402-5178-4784-a861-deb58214e4b4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:32.890082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5ee51402-5178-4784-a861-deb58214e4b4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:32.890829 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5ee51402-5178-4784-a861-deb58214e4b4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:32.891253 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5ee51402-5178-4784-a861-deb58214e4b4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:33.009374 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5ee51402-5178-4784-a861-deb58214e4b4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:33.016538 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5ee51402-5178-4784-a861-deb58214e4b4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.137531 Oct 15 03:45:33.017098 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 537/1055] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:32 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:33.121036 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c69f4f19-0927-4e10-a9dd-07ad40e27431 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:33.121939 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c69f4f19-0927-4e10-a9dd-07ad40e27431 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:33.127532 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c69f4f19-0927-4e10-a9dd-07ad40e27431 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:33.128015 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c69f4f19-0927-4e10-a9dd-07ad40e27431 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:33.128767 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c69f4f19-0927-4e10-a9dd-07ad40e27431 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:33.129192 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c69f4f19-0927-4e10-a9dd-07ad40e27431 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:33.156868 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c69f4f19-0927-4e10-a9dd-07ad40e27431 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039601 Oct 15 03:45:33.157399 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 519/1056] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:33 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:33.541887 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d2ca2145-e38c-470c-a6b7-35229751e6a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:33.542817 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d2ca2145-e38c-470c-a6b7-35229751e6a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:33.548532 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2ca2145-e38c-470c-a6b7-35229751e6a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:33.549010 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2ca2145-e38c-470c-a6b7-35229751e6a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:33.549756 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2ca2145-e38c-470c-a6b7-35229751e6a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:33.550177 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2ca2145-e38c-470c-a6b7-35229751e6a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:33.578135 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d2ca2145-e38c-470c-a6b7-35229751e6a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040548 Oct 15 03:45:33.578662 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 538/1057] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:33 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:33.827582 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e459e9f6-aadc-484c-8370-ac3a281e790f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:33.828157 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e459e9f6-aadc-484c-8370-ac3a281e790f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:33.833787 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e459e9f6-aadc-484c-8370-ac3a281e790f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:33.834235 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e459e9f6-aadc-484c-8370-ac3a281e790f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:33.835253 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e459e9f6-aadc-484c-8370-ac3a281e790f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:33.835696 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e459e9f6-aadc-484c-8370-ac3a281e790f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:33.893529 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e459e9f6-aadc-484c-8370-ac3a281e790f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:33.901060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e459e9f6-aadc-484c-8370-ac3a281e790f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.076777 Oct 15 03:45:33.901655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 520/1058] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:33 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:34.034246 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2f217618-822c-4306-8389-7047f2efb2a4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:34.034848 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2f217618-822c-4306-8389-7047f2efb2a4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:34.040579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2f217618-822c-4306-8389-7047f2efb2a4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:34.041033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2f217618-822c-4306-8389-7047f2efb2a4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:34.041789 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2f217618-822c-4306-8389-7047f2efb2a4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:34.042221 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2f217618-822c-4306-8389-7047f2efb2a4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:34.164035 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2f217618-822c-4306-8389-7047f2efb2a4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:34.168049 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e9351996-1154-42ce-b1e4-abeb29fc3a12 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:34.168952 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e9351996-1154-42ce-b1e4-abeb29fc3a12 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:34.171746 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2f217618-822c-4306-8389-7047f2efb2a4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.141113 Oct 15 03:45:34.172308 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 539/1059] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:34 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:34.174569 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e9351996-1154-42ce-b1e4-abeb29fc3a12 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:34.175014 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e9351996-1154-42ce-b1e4-abeb29fc3a12 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:34.175796 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e9351996-1154-42ce-b1e4-abeb29fc3a12 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:34.176228 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e9351996-1154-42ce-b1e4-abeb29fc3a12 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:34.204824 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e9351996-1154-42ce-b1e4-abeb29fc3a12 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040431 Oct 15 03:45:34.205352 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 521/1060] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:34 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:45:34.590939 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e31bd914-dec0-49bc-a45d-951ad310fb32 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:34.591937 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e31bd914-dec0-49bc-a45d-951ad310fb32 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:34.597626 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e31bd914-dec0-49bc-a45d-951ad310fb32 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:34.598072 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e31bd914-dec0-49bc-a45d-951ad310fb32 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:34.598831 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e31bd914-dec0-49bc-a45d-951ad310fb32 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:34.599265 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e31bd914-dec0-49bc-a45d-951ad310fb32 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:34.627173 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e31bd914-dec0-49bc-a45d-951ad310fb32 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040519 Oct 15 03:45:34.627725 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 540/1061] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:34 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:34.917427 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-11da7e41-9ef8-4815-8b0f-1d083cbc6990 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:34.918026 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-11da7e41-9ef8-4815-8b0f-1d083cbc6990 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:34.924030 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-11da7e41-9ef8-4815-8b0f-1d083cbc6990 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:34.924480 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-11da7e41-9ef8-4815-8b0f-1d083cbc6990 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:34.925234 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-11da7e41-9ef8-4815-8b0f-1d083cbc6990 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:34.925658 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-11da7e41-9ef8-4815-8b0f-1d083cbc6990 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:34.985899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-11da7e41-9ef8-4815-8b0f-1d083cbc6990 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:34.992842 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-11da7e41-9ef8-4815-8b0f-1d083cbc6990 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.079049 Oct 15 03:45:34.993385 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 522/1062] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:34 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:35.188627 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7a5c18e1-52ea-417f-9f4c-9c7faa2a30e3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:35.189148 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7a5c18e1-52ea-417f-9f4c-9c7faa2a30e3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:35.194967 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7a5c18e1-52ea-417f-9f4c-9c7faa2a30e3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:35.195414 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7a5c18e1-52ea-417f-9f4c-9c7faa2a30e3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:35.196210 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7a5c18e1-52ea-417f-9f4c-9c7faa2a30e3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:35.196644 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7a5c18e1-52ea-417f-9f4c-9c7faa2a30e3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:35.216126 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7e429127-8d3b-4667-8644-c423f71a8d79 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:35.217065 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7e429127-8d3b-4667-8644-c423f71a8d79 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:35.222714 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7e429127-8d3b-4667-8644-c423f71a8d79 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:35.223159 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7e429127-8d3b-4667-8644-c423f71a8d79 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:35.223946 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7e429127-8d3b-4667-8644-c423f71a8d79 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:35.224380 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7e429127-8d3b-4667-8644-c423f71a8d79 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:35.254356 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7e429127-8d3b-4667-8644-c423f71a8d79 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041817 Oct 15 03:45:35.254923 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 523/1063] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:35 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:45:35.314044 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7a5c18e1-52ea-417f-9f4c-9c7faa2a30e3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:35.321169 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7a5c18e1-52ea-417f-9f4c-9c7faa2a30e3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.136274 Oct 15 03:45:35.321719 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 541/1064] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:35 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:35.638426 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5cf30859-b147-4868-aa59-08b2f74d8df0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:35.639330 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5cf30859-b147-4868-aa59-08b2f74d8df0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:35.645139 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5cf30859-b147-4868-aa59-08b2f74d8df0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:35.645580 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5cf30859-b147-4868-aa59-08b2f74d8df0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:35.646335 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5cf30859-b147-4868-aa59-08b2f74d8df0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:35.646766 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5cf30859-b147-4868-aa59-08b2f74d8df0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:35.674798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5cf30859-b147-4868-aa59-08b2f74d8df0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040103 Oct 15 03:45:35.675355 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 524/1065] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:35 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:36.009145 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cf468bca-6e6a-47f4-9be2-ca5f1040d080 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:36.009759 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cf468bca-6e6a-47f4-9be2-ca5f1040d080 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:36.015753 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cf468bca-6e6a-47f4-9be2-ca5f1040d080 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:36.016330 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cf468bca-6e6a-47f4-9be2-ca5f1040d080 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:36.017103 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cf468bca-6e6a-47f4-9be2-ca5f1040d080 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:36.017540 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cf468bca-6e6a-47f4-9be2-ca5f1040d080 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:36.076592 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-cf468bca-6e6a-47f4-9be2-ca5f1040d080 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:36.083796 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cf468bca-6e6a-47f4-9be2-ca5f1040d080 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.078291 Oct 15 03:45:36.084346 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 542/1066] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:36 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:36.265364 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-28ddf52c-0443-42ca-916b-f4040cc5bc46 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:36.266267 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-28ddf52c-0443-42ca-916b-f4040cc5bc46 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:36.272083 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-28ddf52c-0443-42ca-916b-f4040cc5bc46 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:36.272527 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-28ddf52c-0443-42ca-916b-f4040cc5bc46 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:36.273272 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-28ddf52c-0443-42ca-916b-f4040cc5bc46 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:36.273695 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-28ddf52c-0443-42ca-916b-f4040cc5bc46 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:36.302085 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-28ddf52c-0443-42ca-916b-f4040cc5bc46 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040422 Oct 15 03:45:36.302613 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 525/1067] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:36 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:36.338981 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-06026cd5-8d7f-4abb-b6c3-7e40ff17fec6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:36.339591 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-06026cd5-8d7f-4abb-b6c3-7e40ff17fec6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:36.345321 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-06026cd5-8d7f-4abb-b6c3-7e40ff17fec6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:36.345767 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-06026cd5-8d7f-4abb-b6c3-7e40ff17fec6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:36.346521 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-06026cd5-8d7f-4abb-b6c3-7e40ff17fec6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:36.346952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-06026cd5-8d7f-4abb-b6c3-7e40ff17fec6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:36.460906 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-06026cd5-8d7f-4abb-b6c3-7e40ff17fec6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:36.468629 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-06026cd5-8d7f-4abb-b6c3-7e40ff17fec6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.134174 Oct 15 03:45:36.469182 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 543/1068] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:36 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:36.686699 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1f2f7b36-0044-4d61-98f9-d75502a10b69 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:36.687514 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1f2f7b36-0044-4d61-98f9-d75502a10b69 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:36.693173 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1f2f7b36-0044-4d61-98f9-d75502a10b69 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:36.693616 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1f2f7b36-0044-4d61-98f9-d75502a10b69 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:36.694362 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1f2f7b36-0044-4d61-98f9-d75502a10b69 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:36.694789 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1f2f7b36-0044-4d61-98f9-d75502a10b69 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:36.728251 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1f2f7b36-0044-4d61-98f9-d75502a10b69 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045380 Oct 15 03:45:36.728814 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 526/1069] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:36 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:37.100946 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-99b1f419-4109-46d9-ad74-284f61903f9b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:37.101559 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-99b1f419-4109-46d9-ad74-284f61903f9b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:37.107883 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-99b1f419-4109-46d9-ad74-284f61903f9b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:37.108336 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-99b1f419-4109-46d9-ad74-284f61903f9b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:37.109097 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-99b1f419-4109-46d9-ad74-284f61903f9b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:37.109529 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-99b1f419-4109-46d9-ad74-284f61903f9b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:37.171217 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-99b1f419-4109-46d9-ad74-284f61903f9b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:37.178351 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-99b1f419-4109-46d9-ad74-284f61903f9b tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.081003 Oct 15 03:45:37.178905 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 544/1070] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:37 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:37.313862 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8cb53957-1dfe-4074-b920-f9b6d5568ba2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:37.314761 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8cb53957-1dfe-4074-b920-f9b6d5568ba2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:37.320512 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8cb53957-1dfe-4074-b920-f9b6d5568ba2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:37.320981 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8cb53957-1dfe-4074-b920-f9b6d5568ba2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:37.321725 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8cb53957-1dfe-4074-b920-f9b6d5568ba2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:37.322154 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8cb53957-1dfe-4074-b920-f9b6d5568ba2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:37.350032 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8cb53957-1dfe-4074-b920-f9b6d5568ba2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040022 Oct 15 03:45:37.350555 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 527/1071] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:37 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:37.485604 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-df72e4fa-ec95-4774-b7ec-1b15e763e9f3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:37.486135 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-df72e4fa-ec95-4774-b7ec-1b15e763e9f3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:37.491810 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df72e4fa-ec95-4774-b7ec-1b15e763e9f3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:37.492254 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df72e4fa-ec95-4774-b7ec-1b15e763e9f3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:37.493031 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df72e4fa-ec95-4774-b7ec-1b15e763e9f3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:37.493465 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df72e4fa-ec95-4774-b7ec-1b15e763e9f3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:37.610624 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-df72e4fa-ec95-4774-b7ec-1b15e763e9f3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:37.617777 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-df72e4fa-ec95-4774-b7ec-1b15e763e9f3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.135936 Oct 15 03:45:37.618320 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 545/1072] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:37 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:37.738611 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e0417fd5-9500-4fdb-927a-6a3e7261164e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:37.739434 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e0417fd5-9500-4fdb-927a-6a3e7261164e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:37.745120 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e0417fd5-9500-4fdb-927a-6a3e7261164e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:37.745558 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e0417fd5-9500-4fdb-927a-6a3e7261164e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:37.746308 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e0417fd5-9500-4fdb-927a-6a3e7261164e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:37.746731 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e0417fd5-9500-4fdb-927a-6a3e7261164e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:37.774654 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e0417fd5-9500-4fdb-927a-6a3e7261164e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039791 Oct 15 03:45:37.775176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 528/1073] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:37 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:38.195139 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a4b03db5-9459-4d2f-aa4d-5f2c4687a671 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:38.195777 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a4b03db5-9459-4d2f-aa4d-5f2c4687a671 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:38.202070 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4b03db5-9459-4d2f-aa4d-5f2c4687a671 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:38.202516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4b03db5-9459-4d2f-aa4d-5f2c4687a671 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:38.203273 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4b03db5-9459-4d2f-aa4d-5f2c4687a671 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:38.203729 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4b03db5-9459-4d2f-aa4d-5f2c4687a671 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:38.261636 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a4b03db5-9459-4d2f-aa4d-5f2c4687a671 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:38.268913 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a4b03db5-9459-4d2f-aa4d-5f2c4687a671 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077394 Oct 15 03:45:38.269487 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 546/1074] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:38 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:38.362127 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3af00777-43c9-4176-be6b-b9a2f578aad9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:38.363032 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3af00777-43c9-4176-be6b-b9a2f578aad9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:38.368695 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3af00777-43c9-4176-be6b-b9a2f578aad9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:38.369134 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3af00777-43c9-4176-be6b-b9a2f578aad9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:38.370394 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3af00777-43c9-4176-be6b-b9a2f578aad9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:38.370820 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3af00777-43c9-4176-be6b-b9a2f578aad9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:38.398689 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3af00777-43c9-4176-be6b-b9a2f578aad9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040257 Oct 15 03:45:38.399214 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 529/1075] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:38 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:38.634467 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-edbc2ad0-cab2-4fc9-b146-f2a1a62d9009 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:38.635072 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-edbc2ad0-cab2-4fc9-b146-f2a1a62d9009 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:38.640804 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edbc2ad0-cab2-4fc9-b146-f2a1a62d9009 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:38.641251 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edbc2ad0-cab2-4fc9-b146-f2a1a62d9009 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:38.642005 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edbc2ad0-cab2-4fc9-b146-f2a1a62d9009 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:38.642436 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edbc2ad0-cab2-4fc9-b146-f2a1a62d9009 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:38.760302 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-edbc2ad0-cab2-4fc9-b146-f2a1a62d9009 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:38.767338 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-edbc2ad0-cab2-4fc9-b146-f2a1a62d9009 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.136500 Oct 15 03:45:38.767953 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 547/1076] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:38 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:38.786262 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a8b5d159-b7ca-4833-befc-073c6a8350ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:38.787158 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a8b5d159-b7ca-4833-befc-073c6a8350ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:38.793355 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a8b5d159-b7ca-4833-befc-073c6a8350ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:38.793803 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a8b5d159-b7ca-4833-befc-073c6a8350ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:38.794549 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a8b5d159-b7ca-4833-befc-073c6a8350ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:38.794976 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a8b5d159-b7ca-4833-befc-073c6a8350ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:38.823103 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a8b5d159-b7ca-4833-befc-073c6a8350ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040574 Oct 15 03:45:38.823640 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 530/1077] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:38 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:39.285477 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2c80316e-b888-4434-a936-10b7e6c61bcd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:39.286080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2c80316e-b888-4434-a936-10b7e6c61bcd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:39.291839 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2c80316e-b888-4434-a936-10b7e6c61bcd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:39.292289 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2c80316e-b888-4434-a936-10b7e6c61bcd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:39.293102 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2c80316e-b888-4434-a936-10b7e6c61bcd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:39.293514 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2c80316e-b888-4434-a936-10b7e6c61bcd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:39.353651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2c80316e-b888-4434-a936-10b7e6c61bcd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:39.360728 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2c80316e-b888-4434-a936-10b7e6c61bcd tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.078913 Oct 15 03:45:39.361276 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 548/1078] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:39 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:39.409867 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0d3ed87b-595c-47ae-af97-56b9a4885116 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:39.410766 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0d3ed87b-595c-47ae-af97-56b9a4885116 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:39.416591 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0d3ed87b-595c-47ae-af97-56b9a4885116 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:39.417035 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0d3ed87b-595c-47ae-af97-56b9a4885116 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:39.417783 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0d3ed87b-595c-47ae-af97-56b9a4885116 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:39.418211 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0d3ed87b-595c-47ae-af97-56b9a4885116 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:39.445570 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0d3ed87b-595c-47ae-af97-56b9a4885116 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039459 Oct 15 03:45:39.446096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 531/1079] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:39 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:39.783940 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0a13ff9a-6916-400e-b510-925b3a10b3cb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:39.784542 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0a13ff9a-6916-400e-b510-925b3a10b3cb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:39.790145 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0a13ff9a-6916-400e-b510-925b3a10b3cb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:39.790585 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0a13ff9a-6916-400e-b510-925b3a10b3cb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:39.791354 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0a13ff9a-6916-400e-b510-925b3a10b3cb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:39.791809 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0a13ff9a-6916-400e-b510-925b3a10b3cb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:39.834229 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f7b78809-d776-41d8-bd4b-aa6538402826 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:39.835400 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f7b78809-d776-41d8-bd4b-aa6538402826 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:39.841101 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f7b78809-d776-41d8-bd4b-aa6538402826 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:39.841549 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f7b78809-d776-41d8-bd4b-aa6538402826 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:39.842311 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f7b78809-d776-41d8-bd4b-aa6538402826 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:39.842746 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f7b78809-d776-41d8-bd4b-aa6538402826 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:39.872513 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f7b78809-d776-41d8-bd4b-aa6538402826 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042038 Oct 15 03:45:39.873076 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 532/1080] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:39 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:45:39.907742 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0a13ff9a-6916-400e-b510-925b3a10b3cb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:39.914885 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0a13ff9a-6916-400e-b510-925b3a10b3cb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.134489 Oct 15 03:45:39.915438 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 549/1081] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:39 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:40.377078 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-cbf33d76-f966-46c5-a06a-613a1c7a62be tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:40.377688 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-cbf33d76-f966-46c5-a06a-613a1c7a62be tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:40.383826 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cbf33d76-f966-46c5-a06a-613a1c7a62be tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:40.384273 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cbf33d76-f966-46c5-a06a-613a1c7a62be tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:40.385048 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cbf33d76-f966-46c5-a06a-613a1c7a62be tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:40.385480 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cbf33d76-f966-46c5-a06a-613a1c7a62be tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:40.445232 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-cbf33d76-f966-46c5-a06a-613a1c7a62be tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:40.452349 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-cbf33d76-f966-46c5-a06a-613a1c7a62be tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.078981 Oct 15 03:45:40.452901 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 533/1082] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:40 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:40.457520 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-06bfc132-4cde-4837-9ff4-e4ba0eb5ea33 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:40.458434 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-06bfc132-4cde-4837-9ff4-e4ba0eb5ea33 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:40.464878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-06bfc132-4cde-4837-9ff4-e4ba0eb5ea33 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:40.465328 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-06bfc132-4cde-4837-9ff4-e4ba0eb5ea33 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:40.466087 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-06bfc132-4cde-4837-9ff4-e4ba0eb5ea33 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:40.466517 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-06bfc132-4cde-4837-9ff4-e4ba0eb5ea33 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:40.495051 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-06bfc132-4cde-4837-9ff4-e4ba0eb5ea33 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041407 Oct 15 03:45:40.502180 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 550/1083] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:40 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:40.884022 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-07d5b21f-682f-45c7-943e-c1b2da6834dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:40.885472 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-07d5b21f-682f-45c7-943e-c1b2da6834dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:40.891222 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-07d5b21f-682f-45c7-943e-c1b2da6834dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:40.891662 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-07d5b21f-682f-45c7-943e-c1b2da6834dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:40.892440 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-07d5b21f-682f-45c7-943e-c1b2da6834dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:40.892868 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-07d5b21f-682f-45c7-943e-c1b2da6834dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:40.921828 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-07d5b21f-682f-45c7-943e-c1b2da6834dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041517 Oct 15 03:45:40.922378 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 534/1084] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:40 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:40.931376 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3bf8f9b5-0d59-4030-98cb-f466e2a75d66 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:40.932714 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3bf8f9b5-0d59-4030-98cb-f466e2a75d66 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:40.938488 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3bf8f9b5-0d59-4030-98cb-f466e2a75d66 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:40.938933 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3bf8f9b5-0d59-4030-98cb-f466e2a75d66 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:40.939715 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3bf8f9b5-0d59-4030-98cb-f466e2a75d66 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:40.940141 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3bf8f9b5-0d59-4030-98cb-f466e2a75d66 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:41.059634 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3bf8f9b5-0d59-4030-98cb-f466e2a75d66 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:41.066805 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3bf8f9b5-0d59-4030-98cb-f466e2a75d66 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.139012 Oct 15 03:45:41.067356 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 551/1085] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:40 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:41.469001 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-684ceacb-7fb7-4302-b086-f4f239d0e62e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:41.469614 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-684ceacb-7fb7-4302-b086-f4f239d0e62e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:41.475435 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-684ceacb-7fb7-4302-b086-f4f239d0e62e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:41.475992 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-684ceacb-7fb7-4302-b086-f4f239d0e62e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:41.476758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-684ceacb-7fb7-4302-b086-f4f239d0e62e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:41.477195 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-684ceacb-7fb7-4302-b086-f4f239d0e62e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:41.513297 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-50aabf31-a40f-46c6-a0be-754e6c7b7ae9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:41.514649 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-50aabf31-a40f-46c6-a0be-754e6c7b7ae9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:41.520473 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50aabf31-a40f-46c6-a0be-754e6c7b7ae9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:41.521082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50aabf31-a40f-46c6-a0be-754e6c7b7ae9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:41.521844 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50aabf31-a40f-46c6-a0be-754e6c7b7ae9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:41.522276 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50aabf31-a40f-46c6-a0be-754e6c7b7ae9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:41.539418 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-684ceacb-7fb7-4302-b086-f4f239d0e62e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:41.547243 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-684ceacb-7fb7-4302-b086-f4f239d0e62e tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.081937 Oct 15 03:45:41.547830 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 535/1086] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:41 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:41.551065 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-50aabf31-a40f-46c6-a0be-754e6c7b7ae9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042538 Oct 15 03:45:41.551598 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 552/1087] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:41 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:45:41.933346 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a0f8385f-9bcd-4d61-a698-08a9ff50d123 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:41.934152 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a0f8385f-9bcd-4d61-a698-08a9ff50d123 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:41.939892 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a0f8385f-9bcd-4d61-a698-08a9ff50d123 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:41.940340 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a0f8385f-9bcd-4d61-a698-08a9ff50d123 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:41.941097 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a0f8385f-9bcd-4d61-a698-08a9ff50d123 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:41.941528 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a0f8385f-9bcd-4d61-a698-08a9ff50d123 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:41.969732 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a0f8385f-9bcd-4d61-a698-08a9ff50d123 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040280 Oct 15 03:45:41.970259 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 536/1088] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:41 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:42.084057 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-abc93871-9eed-45ba-8a96-be6ca84de176 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:42.084912 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-abc93871-9eed-45ba-8a96-be6ca84de176 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:42.091100 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-abc93871-9eed-45ba-8a96-be6ca84de176 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:42.091543 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-abc93871-9eed-45ba-8a96-be6ca84de176 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:42.092332 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-abc93871-9eed-45ba-8a96-be6ca84de176 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:42.092781 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-abc93871-9eed-45ba-8a96-be6ca84de176 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:42.207505 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-abc93871-9eed-45ba-8a96-be6ca84de176 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:42.215343 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-abc93871-9eed-45ba-8a96-be6ca84de176 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.134922 Oct 15 03:45:42.215919 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 553/1089] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:42 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:42.562110 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-76a15e4a-f39f-4929-b425-b19692f3c2b3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:42.563015 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-76a15e4a-f39f-4929-b425-b19692f3c2b3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:42.563633 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-671d3c8d-3d77-4e8b-92bb-4f6488cb080d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:42.564273 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-671d3c8d-3d77-4e8b-92bb-4f6488cb080d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:42.568903 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-76a15e4a-f39f-4929-b425-b19692f3c2b3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:42.569347 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-76a15e4a-f39f-4929-b425-b19692f3c2b3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:42.569865 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-671d3c8d-3d77-4e8b-92bb-4f6488cb080d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:42.570112 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-76a15e4a-f39f-4929-b425-b19692f3c2b3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:42.570312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-671d3c8d-3d77-4e8b-92bb-4f6488cb080d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:42.570544 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-76a15e4a-f39f-4929-b425-b19692f3c2b3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:42.571069 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-671d3c8d-3d77-4e8b-92bb-4f6488cb080d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:42.571497 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-671d3c8d-3d77-4e8b-92bb-4f6488cb080d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:42.599622 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-76a15e4a-f39f-4929-b425-b19692f3c2b3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041203 Oct 15 03:45:42.600203 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 537/1090] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:42 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:42.632247 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-671d3c8d-3d77-4e8b-92bb-4f6488cb080d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:42.640059 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-671d3c8d-3d77-4e8b-92bb-4f6488cb080d tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.079947 Oct 15 03:45:42.640612 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 554/1091] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:42 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:42.981695 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2aea0952-46aa-4885-93f9-5e702fca3f40 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:42.982509 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2aea0952-46aa-4885-93f9-5e702fca3f40 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:42.988345 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2aea0952-46aa-4885-93f9-5e702fca3f40 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:42.988791 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2aea0952-46aa-4885-93f9-5e702fca3f40 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:42.989548 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2aea0952-46aa-4885-93f9-5e702fca3f40 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:42.989979 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2aea0952-46aa-4885-93f9-5e702fca3f40 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:43.018005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2aea0952-46aa-4885-93f9-5e702fca3f40 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040764 Oct 15 03:45:43.018539 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 538/1092] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:42 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:43.232524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bbf8402b-9fba-4b14-9a93-4baea3d227c1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:43.233080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bbf8402b-9fba-4b14-9a93-4baea3d227c1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:43.238811 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bbf8402b-9fba-4b14-9a93-4baea3d227c1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:43.239251 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bbf8402b-9fba-4b14-9a93-4baea3d227c1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:43.240023 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bbf8402b-9fba-4b14-9a93-4baea3d227c1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:43.240450 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bbf8402b-9fba-4b14-9a93-4baea3d227c1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:43.560204 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bbf8402b-9fba-4b14-9a93-4baea3d227c1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:43.567288 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bbf8402b-9fba-4b14-9a93-4baea3d227c1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.338938 Oct 15 03:45:43.567869 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 555/1093] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:43 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:43.610743 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-73282b8f-a199-4408-9eb3-dabcd79fcdd9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:43.611664 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-73282b8f-a199-4408-9eb3-dabcd79fcdd9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:43.617352 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-73282b8f-a199-4408-9eb3-dabcd79fcdd9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:43.617794 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-73282b8f-a199-4408-9eb3-dabcd79fcdd9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:43.618548 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-73282b8f-a199-4408-9eb3-dabcd79fcdd9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:43.619012 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-73282b8f-a199-4408-9eb3-dabcd79fcdd9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:43.646401 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-73282b8f-a199-4408-9eb3-dabcd79fcdd9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039316 Oct 15 03:45:43.646936 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 539/1094] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:43 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:43.656551 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fa969fc5-0450-4c2e-b7f9-6d449c4761ab tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:43.657150 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fa969fc5-0450-4c2e-b7f9-6d449c4761ab tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:43.662804 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fa969fc5-0450-4c2e-b7f9-6d449c4761ab tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:43.663245 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fa969fc5-0450-4c2e-b7f9-6d449c4761ab tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:43.664015 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fa969fc5-0450-4c2e-b7f9-6d449c4761ab tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:43.664443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fa969fc5-0450-4c2e-b7f9-6d449c4761ab tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:43.723124 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fa969fc5-0450-4c2e-b7f9-6d449c4761ab tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:43.730835 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fa969fc5-0450-4c2e-b7f9-6d449c4761ab tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077887 Oct 15 03:45:43.731385 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 556/1095] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:43 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:44.029956 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ab75bebf-da46-4439-9a09-51869b74e374 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:44.030863 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ab75bebf-da46-4439-9a09-51869b74e374 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:44.036847 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ab75bebf-da46-4439-9a09-51869b74e374 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:44.037295 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ab75bebf-da46-4439-9a09-51869b74e374 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:44.038057 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ab75bebf-da46-4439-9a09-51869b74e374 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:44.038490 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ab75bebf-da46-4439-9a09-51869b74e374 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:44.066115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ab75bebf-da46-4439-9a09-51869b74e374 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040555 Oct 15 03:45:44.066651 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 540/1096] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:44 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:44.584011 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-62cc9e0c-a80b-4259-8b4e-547f9c120892 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:44.584869 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-62cc9e0c-a80b-4259-8b4e-547f9c120892 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:44.590599 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-62cc9e0c-a80b-4259-8b4e-547f9c120892 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:44.591046 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-62cc9e0c-a80b-4259-8b4e-547f9c120892 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:44.591826 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-62cc9e0c-a80b-4259-8b4e-547f9c120892 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:44.592257 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-62cc9e0c-a80b-4259-8b4e-547f9c120892 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:44.657652 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-58723867-04e6-4859-ab9f-687a328c8a3b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:44.658603 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-58723867-04e6-4859-ab9f-687a328c8a3b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:44.664310 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-58723867-04e6-4859-ab9f-687a328c8a3b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:44.664753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-58723867-04e6-4859-ab9f-687a328c8a3b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:44.665515 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-58723867-04e6-4859-ab9f-687a328c8a3b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:44.666452 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-58723867-04e6-4859-ab9f-687a328c8a3b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:44.695419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-58723867-04e6-4859-ab9f-687a328c8a3b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041515 Oct 15 03:45:44.696007 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 541/1097] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:44 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:45:44.707565 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-62cc9e0c-a80b-4259-8b4e-547f9c120892 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:44.715101 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-62cc9e0c-a80b-4259-8b4e-547f9c120892 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.134690 Oct 15 03:45:44.715644 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 557/1098] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:44 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:44.747856 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-756e7394-90a5-4c0d-bb4f-8cd7bbd477c9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:44.748492 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-756e7394-90a5-4c0d-bb4f-8cd7bbd477c9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:44.754183 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-756e7394-90a5-4c0d-bb4f-8cd7bbd477c9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:44.754633 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-756e7394-90a5-4c0d-bb4f-8cd7bbd477c9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:44.755388 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-756e7394-90a5-4c0d-bb4f-8cd7bbd477c9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:44.755858 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-756e7394-90a5-4c0d-bb4f-8cd7bbd477c9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:44.815500 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-756e7394-90a5-4c0d-bb4f-8cd7bbd477c9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:44.822593 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-756e7394-90a5-4c0d-bb4f-8cd7bbd477c9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.079028 Oct 15 03:45:44.823151 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 542/1099] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:44 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:45.077542 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-261adb46-aaf5-4b85-ba21-fe77371e8aa8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:45.078445 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-261adb46-aaf5-4b85-ba21-fe77371e8aa8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:45.084216 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-261adb46-aaf5-4b85-ba21-fe77371e8aa8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:45.084930 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-261adb46-aaf5-4b85-ba21-fe77371e8aa8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:45.085681 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-261adb46-aaf5-4b85-ba21-fe77371e8aa8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:45.086140 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-261adb46-aaf5-4b85-ba21-fe77371e8aa8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:45.115009 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-261adb46-aaf5-4b85-ba21-fe77371e8aa8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041226 Oct 15 03:45:45.115562 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 558/1100] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:45 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:45.706590 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-478b2ae9-5b0c-4412-bf40-d1ee300f5819 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:45.707493 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-478b2ae9-5b0c-4412-bf40-d1ee300f5819 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:45.713497 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-478b2ae9-5b0c-4412-bf40-d1ee300f5819 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:45.713938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-478b2ae9-5b0c-4412-bf40-d1ee300f5819 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:45.714690 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-478b2ae9-5b0c-4412-bf40-d1ee300f5819 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:45.715115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-478b2ae9-5b0c-4412-bf40-d1ee300f5819 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:45.731764 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5b24ea32-96a3-400c-9a09-828ff1262447 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:45.732369 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5b24ea32-96a3-400c-9a09-828ff1262447 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:45.737919 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5b24ea32-96a3-400c-9a09-828ff1262447 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:45.738363 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5b24ea32-96a3-400c-9a09-828ff1262447 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:45.739114 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5b24ea32-96a3-400c-9a09-828ff1262447 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:45.739544 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5b24ea32-96a3-400c-9a09-828ff1262447 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:45.742756 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-478b2ae9-5b0c-4412-bf40-d1ee300f5819 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039850 Oct 15 03:45:45.743305 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 543/1101] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:45 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:45.839276 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6744f092-d56e-4785-abaf-a03f78b8e000 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:45.839908 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6744f092-d56e-4785-abaf-a03f78b8e000 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:45.845554 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6744f092-d56e-4785-abaf-a03f78b8e000 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:45.845996 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6744f092-d56e-4785-abaf-a03f78b8e000 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:45.846749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6744f092-d56e-4785-abaf-a03f78b8e000 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:45.847176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6744f092-d56e-4785-abaf-a03f78b8e000 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:45.854878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5b24ea32-96a3-400c-9a09-828ff1262447 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:45.862042 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5b24ea32-96a3-400c-9a09-828ff1262447 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.133826 Oct 15 03:45:45.862606 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 559/1102] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:45 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:45.905492 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6744f092-d56e-4785-abaf-a03f78b8e000 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:45.912744 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6744f092-d56e-4785-abaf-a03f78b8e000 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077021 Oct 15 03:45:45.913307 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 544/1103] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:45 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:46.126450 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6c308776-caab-445f-bc46-1df3e9718b61 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:46.127383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6c308776-caab-445f-bc46-1df3e9718b61 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:46.133165 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6c308776-caab-445f-bc46-1df3e9718b61 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:46.133613 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6c308776-caab-445f-bc46-1df3e9718b61 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:46.134368 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6c308776-caab-445f-bc46-1df3e9718b61 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:46.134802 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6c308776-caab-445f-bc46-1df3e9718b61 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:46.163635 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6c308776-caab-445f-bc46-1df3e9718b61 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040885 Oct 15 03:45:46.164209 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 560/1104] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:46 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:46.754060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d9c4f81e-663e-4db9-9a3e-983194c8fa1f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:46.755010 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d9c4f81e-663e-4db9-9a3e-983194c8fa1f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:46.761136 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d9c4f81e-663e-4db9-9a3e-983194c8fa1f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:46.761583 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d9c4f81e-663e-4db9-9a3e-983194c8fa1f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:46.762326 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d9c4f81e-663e-4db9-9a3e-983194c8fa1f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:46.762751 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d9c4f81e-663e-4db9-9a3e-983194c8fa1f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:46.790942 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d9c4f81e-663e-4db9-9a3e-983194c8fa1f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040541 Oct 15 03:45:46.791555 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 545/1105] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:46 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:46.879279 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-dadced15-95ef-42d6-bf8d-c34978fc8da3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:46.879910 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-dadced15-95ef-42d6-bf8d-c34978fc8da3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:46.886220 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dadced15-95ef-42d6-bf8d-c34978fc8da3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:46.886658 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dadced15-95ef-42d6-bf8d-c34978fc8da3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:46.887398 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dadced15-95ef-42d6-bf8d-c34978fc8da3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:46.887867 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dadced15-95ef-42d6-bf8d-c34978fc8da3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:46.930084 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7a89d0ed-a6ed-4215-b6f5-547bdcad273f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:46.930777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7a89d0ed-a6ed-4215-b6f5-547bdcad273f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:46.936653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7a89d0ed-a6ed-4215-b6f5-547bdcad273f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:46.937094 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7a89d0ed-a6ed-4215-b6f5-547bdcad273f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:46.937858 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7a89d0ed-a6ed-4215-b6f5-547bdcad273f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:46.938284 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7a89d0ed-a6ed-4215-b6f5-547bdcad273f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:47.004464 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7a89d0ed-a6ed-4215-b6f5-547bdcad273f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:47.012015 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7a89d0ed-a6ed-4215-b6f5-547bdcad273f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.085544 Oct 15 03:45:47.012583 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 546/1106] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:46 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:47.023661 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-dadced15-95ef-42d6-bf8d-c34978fc8da3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:47.031503 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-dadced15-95ef-42d6-bf8d-c34978fc8da3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.155796 Oct 15 03:45:47.032088 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 561/1107] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:46 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:47.175391 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-16ecf725-afa6-4364-930a-9dc9bea3a4d5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:47.176319 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-16ecf725-afa6-4364-930a-9dc9bea3a4d5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:47.182611 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-16ecf725-afa6-4364-930a-9dc9bea3a4d5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:47.183053 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-16ecf725-afa6-4364-930a-9dc9bea3a4d5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:47.183834 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-16ecf725-afa6-4364-930a-9dc9bea3a4d5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:47.184266 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-16ecf725-afa6-4364-930a-9dc9bea3a4d5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:47.212589 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-16ecf725-afa6-4364-930a-9dc9bea3a4d5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040936 Oct 15 03:45:47.213140 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 547/1108] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:47 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:47.803454 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-42772dce-471a-41cf-a417-4c502de8a6c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:47.804786 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-42772dce-471a-41cf-a417-4c502de8a6c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:47.811329 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-42772dce-471a-41cf-a417-4c502de8a6c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:47.811803 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-42772dce-471a-41cf-a417-4c502de8a6c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:47.812557 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-42772dce-471a-41cf-a417-4c502de8a6c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:47.812982 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-42772dce-471a-41cf-a417-4c502de8a6c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:47.841105 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-42772dce-471a-41cf-a417-4c502de8a6c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043172 Oct 15 03:45:47.841635 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 562/1109] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:47 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:48.028713 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-81ef0f47-c0fd-4180-b4e7-f241b4c1934a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:48.029326 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-81ef0f47-c0fd-4180-b4e7-f241b4c1934a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:48.035118 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-81ef0f47-c0fd-4180-b4e7-f241b4c1934a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:48.035565 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-81ef0f47-c0fd-4180-b4e7-f241b4c1934a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:48.036361 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-81ef0f47-c0fd-4180-b4e7-f241b4c1934a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:48.036879 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-81ef0f47-c0fd-4180-b4e7-f241b4c1934a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:48.048511 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-746129a2-fc67-46aa-843b-b242aad13816 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:48.049178 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-746129a2-fc67-46aa-843b-b242aad13816 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:48.054794 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-746129a2-fc67-46aa-843b-b242aad13816 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:48.055443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-746129a2-fc67-46aa-843b-b242aad13816 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:48.055966 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-746129a2-fc67-46aa-843b-b242aad13816 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:48.056419 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-746129a2-fc67-46aa-843b-b242aad13816 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:48.096538 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-81ef0f47-c0fd-4180-b4e7-f241b4c1934a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:48.103800 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-81ef0f47-c0fd-4180-b4e7-f241b4c1934a tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.079199 Oct 15 03:45:48.105162 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 548/1110] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:48 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:48.182261 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-746129a2-fc67-46aa-843b-b242aad13816 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:48.189458 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-746129a2-fc67-46aa-843b-b242aad13816 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.144477 Oct 15 03:45:48.190009 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 563/1111] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:48 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:48.223921 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c6620591-e9d5-4f3b-b2be-8eb0ebdf5f8d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:48.224822 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c6620591-e9d5-4f3b-b2be-8eb0ebdf5f8d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:48.230471 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6620591-e9d5-4f3b-b2be-8eb0ebdf5f8d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:48.231118 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6620591-e9d5-4f3b-b2be-8eb0ebdf5f8d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:48.231702 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6620591-e9d5-4f3b-b2be-8eb0ebdf5f8d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:48.232141 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6620591-e9d5-4f3b-b2be-8eb0ebdf5f8d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:48.259916 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c6620591-e9d5-4f3b-b2be-8eb0ebdf5f8d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039716 Oct 15 03:45:48.261008 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 549/1112] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:48 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:48.852139 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-de1030c8-7823-4754-a74d-6a2e08d7be0b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:48.853053 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-de1030c8-7823-4754-a74d-6a2e08d7be0b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:48.859422 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-de1030c8-7823-4754-a74d-6a2e08d7be0b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:48.859902 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-de1030c8-7823-4754-a74d-6a2e08d7be0b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:48.860654 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-de1030c8-7823-4754-a74d-6a2e08d7be0b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:48.861084 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-de1030c8-7823-4754-a74d-6a2e08d7be0b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:48.888583 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-de1030c8-7823-4754-a74d-6a2e08d7be0b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040235 Oct 15 03:45:48.889111 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 564/1113] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:48 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:49.120904 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-70c361b9-79be-4702-8caa-7018c5c9f861 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:49.121507 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-70c361b9-79be-4702-8caa-7018c5c9f861 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:49.123716 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5cc85daf-8c99-49f7-9b26-c6658a21a2b7] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 15 03:45:49.128084 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70c361b9-79be-4702-8caa-7018c5c9f861 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:49.128529 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70c361b9-79be-4702-8caa-7018c5c9f861 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:49.129276 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70c361b9-79be-4702-8caa-7018c5c9f861 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:49.129703 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-70c361b9-79be-4702-8caa-7018c5c9f861 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:49.189142 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-70c361b9-79be-4702-8caa-7018c5c9f861 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:49.196192 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-70c361b9-79be-4702-8caa-7018c5c9f861 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.078998 Oct 15 03:45:49.196738 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 550/1114] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:49 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:49.205895 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a967067d-5f5f-42ec-8f36-be17b2a71d3c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:49.206501 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a967067d-5f5f-42ec-8f36-be17b2a71d3c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:49.212410 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a967067d-5f5f-42ec-8f36-be17b2a71d3c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:49.212851 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a967067d-5f5f-42ec-8f36-be17b2a71d3c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:49.214268 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a967067d-5f5f-42ec-8f36-be17b2a71d3c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:49.214703 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a967067d-5f5f-42ec-8f36-be17b2a71d3c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:49.271882 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-065f4165-a664-406b-8f90-b144df24aaf8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:49.272827 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-065f4165-a664-406b-8f90-b144df24aaf8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:49.279065 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-065f4165-a664-406b-8f90-b144df24aaf8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:49.279517 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-065f4165-a664-406b-8f90-b144df24aaf8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:49.280316 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-065f4165-a664-406b-8f90-b144df24aaf8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:49.280754 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-065f4165-a664-406b-8f90-b144df24aaf8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:49.309154 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-065f4165-a664-406b-8f90-b144df24aaf8 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041031 Oct 15 03:45:49.309719 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 551/1115] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:49 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:45:49.333324 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a967067d-5f5f-42ec-8f36-be17b2a71d3c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:49.341410 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a967067d-5f5f-42ec-8f36-be17b2a71d3c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.139137 Oct 15 03:45:49.341958 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 565/1116] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:49 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:49.899819 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f1c7fc2c-c13a-4f44-b77d-064e05ef3034 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:49.900713 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f1c7fc2c-c13a-4f44-b77d-064e05ef3034 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:49.907009 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f1c7fc2c-c13a-4f44-b77d-064e05ef3034 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:49.907450 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f1c7fc2c-c13a-4f44-b77d-064e05ef3034 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:49.908232 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f1c7fc2c-c13a-4f44-b77d-064e05ef3034 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:49.908661 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f1c7fc2c-c13a-4f44-b77d-064e05ef3034 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:49.935567 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f1c7fc2c-c13a-4f44-b77d-064e05ef3034 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039634 Oct 15 03:45:49.936124 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 552/1117] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:49 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:50.213613 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-527b38aa-cc29-4061-b6d6-748e05cb5319 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:50.214563 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-527b38aa-cc29-4061-b6d6-748e05cb5319 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:50.220301 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-527b38aa-cc29-4061-b6d6-748e05cb5319 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:50.220746 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-527b38aa-cc29-4061-b6d6-748e05cb5319 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:50.221495 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-527b38aa-cc29-4061-b6d6-748e05cb5319 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:50.221924 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-527b38aa-cc29-4061-b6d6-748e05cb5319 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:50.279541 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-527b38aa-cc29-4061-b6d6-748e05cb5319 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:50.286706 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-527b38aa-cc29-4061-b6d6-748e05cb5319 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077012 Oct 15 03:45:50.287254 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 566/1118] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:50 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:50.320324 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fc792629-b894-4de5-8710-b72e7f664483 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:50.321216 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fc792629-b894-4de5-8710-b72e7f664483 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:50.337596 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fc792629-b894-4de5-8710-b72e7f664483 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:50.338033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fc792629-b894-4de5-8710-b72e7f664483 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:50.338794 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fc792629-b894-4de5-8710-b72e7f664483 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:50.339223 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fc792629-b894-4de5-8710-b72e7f664483 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:50.353238 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] [5cc85daf-8c99-49f7-9b26-c6658a21a2b7] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 58276. Oct 15 03:45:50.359374 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-491be18b-b5f3-4dcf-a6aa-6e4b7c11caba tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:50.361253 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-491be18b-b5f3-4dcf-a6aa-6e4b7c11caba tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:50.368216 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-491be18b-b5f3-4dcf-a6aa-6e4b7c11caba tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:50.368901 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-491be18b-b5f3-4dcf-a6aa-6e4b7c11caba tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:50.370169 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-491be18b-b5f3-4dcf-a6aa-6e4b7c11caba tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:50.370606 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-491be18b-b5f3-4dcf-a6aa-6e4b7c11caba tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:50.372680 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fc792629-b894-4de5-8710-b72e7f664483 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055591 Oct 15 03:45:50.373243 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 553/1119] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:50 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:50.488345 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-491be18b-b5f3-4dcf-a6aa-6e4b7c11caba tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:50.496254 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-491be18b-b5f3-4dcf-a6aa-6e4b7c11caba tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.141303 Oct 15 03:45:50.496814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 567/1120] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:50 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:50.946852 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8b1ad373-144c-4745-8496-9772be2096bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:50.947835 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8b1ad373-144c-4745-8496-9772be2096bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:50.953478 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8b1ad373-144c-4745-8496-9772be2096bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:50.953915 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8b1ad373-144c-4745-8496-9772be2096bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:50.954663 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8b1ad373-144c-4745-8496-9772be2096bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:50.955091 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8b1ad373-144c-4745-8496-9772be2096bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:50.984076 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8b1ad373-144c-4745-8496-9772be2096bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040913 Oct 15 03:45:50.984607 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 554/1121] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:50 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:51.302036 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e39b56cf-a1d6-4147-9351-300243fe49ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:51.302640 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e39b56cf-a1d6-4147-9351-300243fe49ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:51.308439 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e39b56cf-a1d6-4147-9351-300243fe49ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:51.308880 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e39b56cf-a1d6-4147-9351-300243fe49ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:51.309622 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e39b56cf-a1d6-4147-9351-300243fe49ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:51.310044 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e39b56cf-a1d6-4147-9351-300243fe49ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:51.367997 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e39b56cf-a1d6-4147-9351-300243fe49ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:51.375348 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e39b56cf-a1d6-4147-9351-300243fe49ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.076977 Oct 15 03:45:51.375921 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 568/1122] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:51 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:51.383776 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f682a34b-4c99-4114-8e91-f6a1c40b8ca2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:51.384751 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f682a34b-4c99-4114-8e91-f6a1c40b8ca2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:51.390876 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f682a34b-4c99-4114-8e91-f6a1c40b8ca2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:51.391319 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f682a34b-4c99-4114-8e91-f6a1c40b8ca2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:51.392101 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f682a34b-4c99-4114-8e91-f6a1c40b8ca2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:51.392524 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f682a34b-4c99-4114-8e91-f6a1c40b8ca2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:51.420505 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f682a34b-4c99-4114-8e91-f6a1c40b8ca2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040478 Oct 15 03:45:51.421046 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 555/1123] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:51 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:51.513409 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4be0e2da-3859-456e-add5-ffd30770df4e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:51.513951 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4be0e2da-3859-456e-add5-ffd30770df4e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:51.519666 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4be0e2da-3859-456e-add5-ffd30770df4e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:51.520142 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4be0e2da-3859-456e-add5-ffd30770df4e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:51.520921 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4be0e2da-3859-456e-add5-ffd30770df4e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:51.521355 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4be0e2da-3859-456e-add5-ffd30770df4e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:51.636581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4be0e2da-3859-456e-add5-ffd30770df4e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:51.643650 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4be0e2da-3859-456e-add5-ffd30770df4e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.134447 Oct 15 03:45:51.644234 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 569/1124] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:51 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:51.995811 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-104c8b66-e624-4ce8-b812-9b608ec6c7ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:51.996749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-104c8b66-e624-4ce8-b812-9b608ec6c7ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:52.002745 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-104c8b66-e624-4ce8-b812-9b608ec6c7ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:52.003186 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-104c8b66-e624-4ce8-b812-9b608ec6c7ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:52.003956 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-104c8b66-e624-4ce8-b812-9b608ec6c7ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:52.004386 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-104c8b66-e624-4ce8-b812-9b608ec6c7ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:52.033161 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-104c8b66-e624-4ce8-b812-9b608ec6c7ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041602 Oct 15 03:45:52.033715 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 556/1125] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:51 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:52.391656 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e0e29137-dad1-4688-aec7-1cb089ec73f0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:52.392237 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e0e29137-dad1-4688-aec7-1cb089ec73f0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:52.398089 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0e29137-dad1-4688-aec7-1cb089ec73f0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:52.398540 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0e29137-dad1-4688-aec7-1cb089ec73f0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:52.399295 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0e29137-dad1-4688-aec7-1cb089ec73f0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:52.399757 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0e29137-dad1-4688-aec7-1cb089ec73f0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:52.431246 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-11e1256e-a390-4f9f-8322-3a804a97b303 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:52.432318 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-11e1256e-a390-4f9f-8322-3a804a97b303 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:52.438128 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-11e1256e-a390-4f9f-8322-3a804a97b303 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:52.438568 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-11e1256e-a390-4f9f-8322-3a804a97b303 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:52.439327 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-11e1256e-a390-4f9f-8322-3a804a97b303 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:52.439780 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-11e1256e-a390-4f9f-8322-3a804a97b303 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:52.457574 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e0e29137-dad1-4688-aec7-1cb089ec73f0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:52.465511 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e0e29137-dad1-4688-aec7-1cb089ec73f0 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077587 Oct 15 03:45:52.466064 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 570/1126] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:52 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:52.471221 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-11e1256e-a390-4f9f-8322-3a804a97b303 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043803 Oct 15 03:45:52.471779 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 557/1127] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:52 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:45:52.660161 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-81ad2731-6bda-4deb-8904-21e5f4660161 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:52.660697 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-81ad2731-6bda-4deb-8904-21e5f4660161 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:52.666935 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81ad2731-6bda-4deb-8904-21e5f4660161 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:52.667385 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81ad2731-6bda-4deb-8904-21e5f4660161 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:52.668171 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81ad2731-6bda-4deb-8904-21e5f4660161 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:52.668605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81ad2731-6bda-4deb-8904-21e5f4660161 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:52.784993 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-81ad2731-6bda-4deb-8904-21e5f4660161 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:52.792146 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-81ad2731-6bda-4deb-8904-21e5f4660161 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.135555 Oct 15 03:45:52.792702 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 571/1128] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:52 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:53.044835 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c19b926f-a2bb-476d-aa47-56c291412e25 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:53.045765 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c19b926f-a2bb-476d-aa47-56c291412e25 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:53.051516 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c19b926f-a2bb-476d-aa47-56c291412e25 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:53.052013 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c19b926f-a2bb-476d-aa47-56c291412e25 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:53.052765 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c19b926f-a2bb-476d-aa47-56c291412e25 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:53.053192 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c19b926f-a2bb-476d-aa47-56c291412e25 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:53.080851 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c19b926f-a2bb-476d-aa47-56c291412e25 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040127 Oct 15 03:45:53.081380 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 558/1129] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:53 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:53.482765 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d158be24-bf80-487d-8e16-a7bde5a3c53f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:53.483290 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-69d3efb9-77c3-48b4-ad94-be7a690cd1d7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:53.483656 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d158be24-bf80-487d-8e16-a7bde5a3c53f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:53.483778 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-69d3efb9-77c3-48b4-ad94-be7a690cd1d7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:53.489322 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d158be24-bf80-487d-8e16-a7bde5a3c53f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:53.489489 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-69d3efb9-77c3-48b4-ad94-be7a690cd1d7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:53.489775 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d158be24-bf80-487d-8e16-a7bde5a3c53f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:53.489892 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-69d3efb9-77c3-48b4-ad94-be7a690cd1d7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:53.490535 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d158be24-bf80-487d-8e16-a7bde5a3c53f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:53.490653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-69d3efb9-77c3-48b4-ad94-be7a690cd1d7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:53.490983 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d158be24-bf80-487d-8e16-a7bde5a3c53f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:53.491093 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-69d3efb9-77c3-48b4-ad94-be7a690cd1d7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:53.519657 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-69d3efb9-77c3-48b4-ad94-be7a690cd1d7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041219 Oct 15 03:45:53.520233 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 559/1130] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:53 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:45:53.548952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d158be24-bf80-487d-8e16-a7bde5a3c53f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:53.556263 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d158be24-bf80-487d-8e16-a7bde5a3c53f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077884 Oct 15 03:45:53.556819 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 572/1131] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:53 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:53.809169 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7b5caa77-5f4f-4ac3-aa37-b9f9e0c7fc5f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:53.809774 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7b5caa77-5f4f-4ac3-aa37-b9f9e0c7fc5f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:53.815356 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7b5caa77-5f4f-4ac3-aa37-b9f9e0c7fc5f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:53.816093 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7b5caa77-5f4f-4ac3-aa37-b9f9e0c7fc5f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:53.816866 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7b5caa77-5f4f-4ac3-aa37-b9f9e0c7fc5f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:53.817289 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7b5caa77-5f4f-4ac3-aa37-b9f9e0c7fc5f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:53.932377 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7b5caa77-5f4f-4ac3-aa37-b9f9e0c7fc5f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:53.939372 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7b5caa77-5f4f-4ac3-aa37-b9f9e0c7fc5f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.134382 Oct 15 03:45:53.939966 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 560/1132] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:53 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:54.093007 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b639ce28-1e56-4027-a988-ea5ef0dd9f43 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:54.093910 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b639ce28-1e56-4027-a988-ea5ef0dd9f43 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:54.099693 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b639ce28-1e56-4027-a988-ea5ef0dd9f43 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:54.100151 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b639ce28-1e56-4027-a988-ea5ef0dd9f43 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:54.100907 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b639ce28-1e56-4027-a988-ea5ef0dd9f43 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:54.101341 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b639ce28-1e56-4027-a988-ea5ef0dd9f43 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:54.129598 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b639ce28-1e56-4027-a988-ea5ef0dd9f43 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040416 Oct 15 03:45:54.130143 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 573/1133] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:54 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:54.530975 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a1f5ed0a-7100-4b32-a96d-018d03e7e600 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:54.531908 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a1f5ed0a-7100-4b32-a96d-018d03e7e600 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:54.537577 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a1f5ed0a-7100-4b32-a96d-018d03e7e600 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:54.538023 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a1f5ed0a-7100-4b32-a96d-018d03e7e600 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:54.538777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a1f5ed0a-7100-4b32-a96d-018d03e7e600 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:54.539211 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a1f5ed0a-7100-4b32-a96d-018d03e7e600 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:54.566711 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a1f5ed0a-7100-4b32-a96d-018d03e7e600 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039506 Oct 15 03:45:54.567250 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 561/1134] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:54 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:54.573624 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d83d3f2e-b84e-4e91-a9b0-75ea9752ae81 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:54.574259 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d83d3f2e-b84e-4e91-a9b0-75ea9752ae81 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:54.579963 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d83d3f2e-b84e-4e91-a9b0-75ea9752ae81 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:54.580412 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d83d3f2e-b84e-4e91-a9b0-75ea9752ae81 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:54.581162 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d83d3f2e-b84e-4e91-a9b0-75ea9752ae81 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:54.581593 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d83d3f2e-b84e-4e91-a9b0-75ea9752ae81 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:54.642554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d83d3f2e-b84e-4e91-a9b0-75ea9752ae81 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:54.649946 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d83d3f2e-b84e-4e91-a9b0-75ea9752ae81 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.080439 Oct 15 03:45:54.650498 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 574/1135] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:54 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:54.956124 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-987f404f-440e-4d4b-aa8f-8436f796b35a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:54.956656 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-987f404f-440e-4d4b-aa8f-8436f796b35a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:54.962616 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-987f404f-440e-4d4b-aa8f-8436f796b35a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:54.963071 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-987f404f-440e-4d4b-aa8f-8436f796b35a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:54.963863 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-987f404f-440e-4d4b-aa8f-8436f796b35a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:54.964299 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-987f404f-440e-4d4b-aa8f-8436f796b35a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:55.080141 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-987f404f-440e-4d4b-aa8f-8436f796b35a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:55.087605 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-987f404f-440e-4d4b-aa8f-8436f796b35a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.135188 Oct 15 03:45:55.088215 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 562/1136] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:54 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:55.140637 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c74b394c-352f-4f84-95cd-d3ea9bd7454b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:55.141538 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c74b394c-352f-4f84-95cd-d3ea9bd7454b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:55.147105 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c74b394c-352f-4f84-95cd-d3ea9bd7454b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:55.147555 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c74b394c-352f-4f84-95cd-d3ea9bd7454b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:55.148339 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c74b394c-352f-4f84-95cd-d3ea9bd7454b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:55.148773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c74b394c-352f-4f84-95cd-d3ea9bd7454b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:55.176497 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c74b394c-352f-4f84-95cd-d3ea9bd7454b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039563 Oct 15 03:45:55.177044 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 575/1137] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:55 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:55.578098 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d3b4be67-e0f8-4976-9f12-1e6e1f19c0fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:55.578946 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d3b4be67-e0f8-4976-9f12-1e6e1f19c0fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:55.584975 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3b4be67-e0f8-4976-9f12-1e6e1f19c0fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:55.585427 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3b4be67-e0f8-4976-9f12-1e6e1f19c0fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:55.586183 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3b4be67-e0f8-4976-9f12-1e6e1f19c0fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:55.586617 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3b4be67-e0f8-4976-9f12-1e6e1f19c0fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:55.615368 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d3b4be67-e0f8-4976-9f12-1e6e1f19c0fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041127 Oct 15 03:45:55.615934 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 563/1138] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:55 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:55.665896 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d4946171-861c-4f02-bbfc-be68ecae024f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:55.667108 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d4946171-861c-4f02-bbfc-be68ecae024f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:55.672795 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4946171-861c-4f02-bbfc-be68ecae024f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:55.673239 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4946171-861c-4f02-bbfc-be68ecae024f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:55.673991 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4946171-861c-4f02-bbfc-be68ecae024f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:55.674422 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4946171-861c-4f02-bbfc-be68ecae024f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:55.731359 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d4946171-861c-4f02-bbfc-be68ecae024f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:55.738432 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d4946171-861c-4f02-bbfc-be68ecae024f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.076169 Oct 15 03:45:55.738974 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 576/1139] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:55 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:56.105130 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7c62311c-a552-4d75-8d45-76ba07191dd2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:56.105771 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7c62311c-a552-4d75-8d45-76ba07191dd2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:56.111499 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7c62311c-a552-4d75-8d45-76ba07191dd2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:56.111985 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7c62311c-a552-4d75-8d45-76ba07191dd2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:56.112744 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7c62311c-a552-4d75-8d45-76ba07191dd2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:56.113177 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7c62311c-a552-4d75-8d45-76ba07191dd2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:56.187541 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2bf3d46e-030e-46e3-a181-dd5fb19b9630 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:56.188466 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2bf3d46e-030e-46e3-a181-dd5fb19b9630 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:56.194164 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2bf3d46e-030e-46e3-a181-dd5fb19b9630 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:56.194605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2bf3d46e-030e-46e3-a181-dd5fb19b9630 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:56.195355 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2bf3d46e-030e-46e3-a181-dd5fb19b9630 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:56.195840 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2bf3d46e-030e-46e3-a181-dd5fb19b9630 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:56.225383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2bf3d46e-030e-46e3-a181-dd5fb19b9630 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041523 Oct 15 03:45:56.225926 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 577/1140] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:56 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:45:56.232544 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7c62311c-a552-4d75-8d45-76ba07191dd2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:56.240349 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7c62311c-a552-4d75-8d45-76ba07191dd2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.139504 Oct 15 03:45:56.240902 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 564/1141] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:56 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:56.627187 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-608f1597-6613-4e5b-acbe-33cbf8d31550 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:56.628137 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-608f1597-6613-4e5b-acbe-33cbf8d31550 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:56.633735 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-608f1597-6613-4e5b-acbe-33cbf8d31550 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:56.634182 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-608f1597-6613-4e5b-acbe-33cbf8d31550 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:56.635440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-608f1597-6613-4e5b-acbe-33cbf8d31550 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:56.635905 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-608f1597-6613-4e5b-acbe-33cbf8d31550 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:56.664102 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-608f1597-6613-4e5b-acbe-33cbf8d31550 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040653 Oct 15 03:45:56.664633 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 578/1142] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:56 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:56.753995 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f77f9c7e-dc62-44a1-84bc-d212d1dcd20f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:56.754598 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f77f9c7e-dc62-44a1-84bc-d212d1dcd20f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:56.760922 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f77f9c7e-dc62-44a1-84bc-d212d1dcd20f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:56.761360 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f77f9c7e-dc62-44a1-84bc-d212d1dcd20f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:56.762104 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f77f9c7e-dc62-44a1-84bc-d212d1dcd20f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:56.762529 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f77f9c7e-dc62-44a1-84bc-d212d1dcd20f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:56.822009 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f77f9c7e-dc62-44a1-84bc-d212d1dcd20f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:56.829846 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f77f9c7e-dc62-44a1-84bc-d212d1dcd20f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.079509 Oct 15 03:45:56.830397 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 565/1143] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:56 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:57.237324 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6dd4a4fb-fd42-465d-b7e9-6b1aa0db582f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:57.238244 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6dd4a4fb-fd42-465d-b7e9-6b1aa0db582f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:57.245192 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6dd4a4fb-fd42-465d-b7e9-6b1aa0db582f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:57.245660 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6dd4a4fb-fd42-465d-b7e9-6b1aa0db582f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:57.246418 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6dd4a4fb-fd42-465d-b7e9-6b1aa0db582f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:57.246871 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6dd4a4fb-fd42-465d-b7e9-6b1aa0db582f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:57.257065 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-888e7da1-ebdb-444f-8496-4a64668b8a1b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:57.257663 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-888e7da1-ebdb-444f-8496-4a64668b8a1b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:57.263270 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-888e7da1-ebdb-444f-8496-4a64668b8a1b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:57.263743 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-888e7da1-ebdb-444f-8496-4a64668b8a1b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:57.264496 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-888e7da1-ebdb-444f-8496-4a64668b8a1b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:57.264923 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-888e7da1-ebdb-444f-8496-4a64668b8a1b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:57.274749 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6dd4a4fb-fd42-465d-b7e9-6b1aa0db582f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041151 Oct 15 03:45:57.275290 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 579/1144] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:57 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:57.380285 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-888e7da1-ebdb-444f-8496-4a64668b8a1b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:57.387401 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-888e7da1-ebdb-444f-8496-4a64668b8a1b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.133932 Oct 15 03:45:57.387987 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 566/1145] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:57 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:45:57.675437 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1b0a12fd-25ed-4510-a84a-3614d5d284f6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:57.676425 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1b0a12fd-25ed-4510-a84a-3614d5d284f6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:57.682559 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b0a12fd-25ed-4510-a84a-3614d5d284f6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:57.682994 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b0a12fd-25ed-4510-a84a-3614d5d284f6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:57.683768 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b0a12fd-25ed-4510-a84a-3614d5d284f6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:57.684195 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b0a12fd-25ed-4510-a84a-3614d5d284f6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:57.714320 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1b0a12fd-25ed-4510-a84a-3614d5d284f6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042666 Oct 15 03:45:57.714850 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 580/1146] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:57 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:57.846938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-eb598399-afeb-4c13-aa35-06e216af45b9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:57.847462 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-eb598399-afeb-4c13-aa35-06e216af45b9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:57.853126 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eb598399-afeb-4c13-aa35-06e216af45b9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:57.853573 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eb598399-afeb-4c13-aa35-06e216af45b9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:57.854330 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eb598399-afeb-4c13-aa35-06e216af45b9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:57.854760 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eb598399-afeb-4c13-aa35-06e216af45b9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:57.912400 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-eb598399-afeb-4c13-aa35-06e216af45b9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:57.919418 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-eb598399-afeb-4c13-aa35-06e216af45b9 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.076165 Oct 15 03:45:57.920005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 567/1147] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:57 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:58.285970 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-badb729b-d3d0-440d-9b9c-02e98d917ce1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:58.286912 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-badb729b-d3d0-440d-9b9c-02e98d917ce1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:58.292681 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-badb729b-d3d0-440d-9b9c-02e98d917ce1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:58.293131 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-badb729b-d3d0-440d-9b9c-02e98d917ce1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:58.293888 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-badb729b-d3d0-440d-9b9c-02e98d917ce1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:58.294321 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-badb729b-d3d0-440d-9b9c-02e98d917ce1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:58.321936 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-badb729b-d3d0-440d-9b9c-02e98d917ce1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039715 Oct 15 03:45:58.322975 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 581/1148] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:58 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:58.404131 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1e6a6289-8211-45dc-b614-784e4e19b10c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:58.404733 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1e6a6289-8211-45dc-b614-784e4e19b10c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:58.410434 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1e6a6289-8211-45dc-b614-784e4e19b10c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:58.410870 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1e6a6289-8211-45dc-b614-784e4e19b10c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:58.411615 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1e6a6289-8211-45dc-b614-784e4e19b10c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:58.412393 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1e6a6289-8211-45dc-b614-784e4e19b10c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:58.532009 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-1e6a6289-8211-45dc-b614-784e4e19b10c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:58.539180 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1e6a6289-8211-45dc-b614-784e4e19b10c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.138717 Oct 15 03:45:58.539753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 568/1149] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:58 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:58.725509 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e803407e-0f3e-4d2c-ae18-484e43a02ebe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:58.726447 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e803407e-0f3e-4d2c-ae18-484e43a02ebe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:58.732757 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e803407e-0f3e-4d2c-ae18-484e43a02ebe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:58.733214 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e803407e-0f3e-4d2c-ae18-484e43a02ebe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:58.733970 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e803407e-0f3e-4d2c-ae18-484e43a02ebe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:58.734406 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e803407e-0f3e-4d2c-ae18-484e43a02ebe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:58.762469 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e803407e-0f3e-4d2c-ae18-484e43a02ebe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040698 Oct 15 03:45:58.762991 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 582/1150] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:58 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:45:58.936374 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d106a1ed-9b97-4f92-9454-798c48de7137 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:58.937329 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d106a1ed-9b97-4f92-9454-798c48de7137 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:58.942999 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d106a1ed-9b97-4f92-9454-798c48de7137 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:58.943444 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d106a1ed-9b97-4f92-9454-798c48de7137 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:58.944226 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d106a1ed-9b97-4f92-9454-798c48de7137 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:58.944910 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d106a1ed-9b97-4f92-9454-798c48de7137 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:59.002562 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d106a1ed-9b97-4f92-9454-798c48de7137 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:59.009567 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d106a1ed-9b97-4f92-9454-798c48de7137 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077310 Oct 15 03:45:59.010158 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 569/1151] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:58 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:59.333784 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5c565832-2499-4d20-854a-4300a4d5264d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:59.334952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5c565832-2499-4d20-854a-4300a4d5264d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:59.340725 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c565832-2499-4d20-854a-4300a4d5264d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:59.341173 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c565832-2499-4d20-854a-4300a4d5264d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:59.341934 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c565832-2499-4d20-854a-4300a4d5264d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:59.342367 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c565832-2499-4d20-854a-4300a4d5264d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:59.370141 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5c565832-2499-4d20-854a-4300a4d5264d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039689 Oct 15 03:45:59.370668 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 583/1152] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:45:59 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:45:59.556136 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-74b34815-fecb-4e73-b325-4094507bb9ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:59.556663 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-74b34815-fecb-4e73-b325-4094507bb9ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:59.563064 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-74b34815-fecb-4e73-b325-4094507bb9ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:59.563507 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-74b34815-fecb-4e73-b325-4094507bb9ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:59.564291 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-74b34815-fecb-4e73-b325-4094507bb9ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:59.564713 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-74b34815-fecb-4e73-b325-4094507bb9ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:59.678500 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-74b34815-fecb-4e73-b325-4094507bb9ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:45:59.686135 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-74b34815-fecb-4e73-b325-4094507bb9ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.133765 Oct 15 03:45:59.686695 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 570/1153] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:45:59 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:45:59.773475 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6401a7eb-0d58-4a51-b330-13183b41ad8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:45:59.774379 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6401a7eb-0d58-4a51-b330-13183b41ad8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:45:59.780151 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6401a7eb-0d58-4a51-b330-13183b41ad8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:59.780596 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6401a7eb-0d58-4a51-b330-13183b41ad8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:59.781349 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6401a7eb-0d58-4a51-b330-13183b41ad8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:45:59.781779 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6401a7eb-0d58-4a51-b330-13183b41ad8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:45:59.810244 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6401a7eb-0d58-4a51-b330-13183b41ad8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040472 Oct 15 03:45:59.810709 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 584/1154] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:45:59 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:00.026174 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f228704a-00f6-400a-800a-909ca1c476a5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:00.026780 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f228704a-00f6-400a-800a-909ca1c476a5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:00.032414 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f228704a-00f6-400a-800a-909ca1c476a5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:00.032857 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f228704a-00f6-400a-800a-909ca1c476a5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:00.033605 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f228704a-00f6-400a-800a-909ca1c476a5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:00.034032 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f228704a-00f6-400a-800a-909ca1c476a5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:00.092115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f228704a-00f6-400a-800a-909ca1c476a5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:00.099093 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f228704a-00f6-400a-800a-909ca1c476a5 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077078 Oct 15 03:46:00.099644 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 571/1155] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:00 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:00.381747 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-75f483b0-670c-4938-8fc5-6768a192fd67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:00.382581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-75f483b0-670c-4938-8fc5-6768a192fd67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:00.388825 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-75f483b0-670c-4938-8fc5-6768a192fd67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:00.389268 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-75f483b0-670c-4938-8fc5-6768a192fd67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:00.390017 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-75f483b0-670c-4938-8fc5-6768a192fd67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:00.390443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-75f483b0-670c-4938-8fc5-6768a192fd67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:00.418145 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-75f483b0-670c-4938-8fc5-6768a192fd67 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040293 Oct 15 03:46:00.418664 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 585/1156] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:00 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:00.703593 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f1642ad7-8329-42bf-9dea-dc0e7e045c2c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:00.704163 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f1642ad7-8329-42bf-9dea-dc0e7e045c2c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:00.710327 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f1642ad7-8329-42bf-9dea-dc0e7e045c2c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:00.710801 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f1642ad7-8329-42bf-9dea-dc0e7e045c2c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:00.711580 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f1642ad7-8329-42bf-9dea-dc0e7e045c2c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:00.712041 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f1642ad7-8329-42bf-9dea-dc0e7e045c2c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:00.821534 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-56abdda5-d1a0-4aa4-bf93-4b8c6d89ca54 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:00.823375 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-56abdda5-d1a0-4aa4-bf93-4b8c6d89ca54 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:00.829173 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-56abdda5-d1a0-4aa4-bf93-4b8c6d89ca54 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:00.829645 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-56abdda5-d1a0-4aa4-bf93-4b8c6d89ca54 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:00.830407 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-56abdda5-d1a0-4aa4-bf93-4b8c6d89ca54 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:00.830832 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-56abdda5-d1a0-4aa4-bf93-4b8c6d89ca54 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:00.834300 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f1642ad7-8329-42bf-9dea-dc0e7e045c2c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:00.841857 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f1642ad7-8329-42bf-9dea-dc0e7e045c2c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.142057 Oct 15 03:46:00.842426 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 572/1157] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:00 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:00.859237 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-56abdda5-d1a0-4aa4-bf93-4b8c6d89ca54 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041453 Oct 15 03:46:00.859784 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 586/1158] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:00 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:46:01.115909 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-cf3e5006-29e7-4f0f-b313-e0b01c46618f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:01.116530 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-cf3e5006-29e7-4f0f-b313-e0b01c46618f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:01.122867 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cf3e5006-29e7-4f0f-b313-e0b01c46618f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:01.123319 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cf3e5006-29e7-4f0f-b313-e0b01c46618f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:01.124177 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cf3e5006-29e7-4f0f-b313-e0b01c46618f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:01.124615 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cf3e5006-29e7-4f0f-b313-e0b01c46618f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:01.182690 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-cf3e5006-29e7-4f0f-b313-e0b01c46618f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:01.189917 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-cf3e5006-29e7-4f0f-b313-e0b01c46618f tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077596 Oct 15 03:46:01.190482 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 573/1159] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:01 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:01.429317 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5aa1c41e-f4a1-4f98-a09d-4b7da4e0cfea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:01.430189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5aa1c41e-f4a1-4f98-a09d-4b7da4e0cfea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:01.435934 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5aa1c41e-f4a1-4f98-a09d-4b7da4e0cfea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:01.436383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5aa1c41e-f4a1-4f98-a09d-4b7da4e0cfea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:01.437140 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5aa1c41e-f4a1-4f98-a09d-4b7da4e0cfea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:01.437573 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5aa1c41e-f4a1-4f98-a09d-4b7da4e0cfea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:01.467861 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5aa1c41e-f4a1-4f98-a09d-4b7da4e0cfea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041979 Oct 15 03:46:01.471116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 587/1160] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:01 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:01.858348 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-58c39a5f-4f7a-4336-b03e-da23151769eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:01.858948 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-58c39a5f-4f7a-4336-b03e-da23151769eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:01.864922 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-58c39a5f-4f7a-4336-b03e-da23151769eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:01.865361 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-58c39a5f-4f7a-4336-b03e-da23151769eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:01.866110 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-58c39a5f-4f7a-4336-b03e-da23151769eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:01.866542 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-58c39a5f-4f7a-4336-b03e-da23151769eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:01.870225 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9097bb8b-92e7-4947-8f4e-92acad6e9865 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:01.871130 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9097bb8b-92e7-4947-8f4e-92acad6e9865 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:01.876679 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9097bb8b-92e7-4947-8f4e-92acad6e9865 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:01.877124 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9097bb8b-92e7-4947-8f4e-92acad6e9865 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:01.877882 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9097bb8b-92e7-4947-8f4e-92acad6e9865 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:01.878316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9097bb8b-92e7-4947-8f4e-92acad6e9865 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:01.907257 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9097bb8b-92e7-4947-8f4e-92acad6e9865 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040792 Oct 15 03:46:01.907835 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 588/1161] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:01 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:46:01.983897 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-58c39a5f-4f7a-4336-b03e-da23151769eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:01.990985 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-58c39a5f-4f7a-4336-b03e-da23151769eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.136247 Oct 15 03:46:01.991537 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 574/1162] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:01 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:02.206019 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0f504769-9f48-4724-a461-99ae329f8305 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:02.206625 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0f504769-9f48-4724-a461-99ae329f8305 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:02.212620 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0f504769-9f48-4724-a461-99ae329f8305 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:02.213064 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0f504769-9f48-4724-a461-99ae329f8305 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:02.213807 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0f504769-9f48-4724-a461-99ae329f8305 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:02.214236 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0f504769-9f48-4724-a461-99ae329f8305 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:02.275849 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0f504769-9f48-4724-a461-99ae329f8305 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:02.282962 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0f504769-9f48-4724-a461-99ae329f8305 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.080625 Oct 15 03:46:02.283506 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 589/1163] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:02 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:02.482581 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-953550e7-2f1d-4c69-88d4-a3e827c43ac6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:02.483424 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-953550e7-2f1d-4c69-88d4-a3e827c43ac6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:02.489171 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-953550e7-2f1d-4c69-88d4-a3e827c43ac6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:02.489609 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-953550e7-2f1d-4c69-88d4-a3e827c43ac6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:02.490693 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-953550e7-2f1d-4c69-88d4-a3e827c43ac6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:02.491144 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-953550e7-2f1d-4c69-88d4-a3e827c43ac6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:02.519553 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-953550e7-2f1d-4c69-88d4-a3e827c43ac6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041510 Oct 15 03:46:02.520115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 575/1164] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:02 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:02.919076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-82defb27-f6da-40ea-b468-fb367581811e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:02.920063 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-82defb27-f6da-40ea-b468-fb367581811e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:02.925797 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-82defb27-f6da-40ea-b468-fb367581811e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:02.926242 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-82defb27-f6da-40ea-b468-fb367581811e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:02.926997 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-82defb27-f6da-40ea-b468-fb367581811e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:02.927428 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-82defb27-f6da-40ea-b468-fb367581811e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:02.954695 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-82defb27-f6da-40ea-b468-fb367581811e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039949 Oct 15 03:46:02.955226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 590/1165] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:02 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:03.007022 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3c9f9d2b-7b63-43b8-8e04-4cd304b67eb4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:03.007624 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3c9f9d2b-7b63-43b8-8e04-4cd304b67eb4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:03.013336 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3c9f9d2b-7b63-43b8-8e04-4cd304b67eb4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:03.013779 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3c9f9d2b-7b63-43b8-8e04-4cd304b67eb4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:03.014524 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3c9f9d2b-7b63-43b8-8e04-4cd304b67eb4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:03.014950 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3c9f9d2b-7b63-43b8-8e04-4cd304b67eb4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:03.130326 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3c9f9d2b-7b63-43b8-8e04-4cd304b67eb4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:03.137436 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3c9f9d2b-7b63-43b8-8e04-4cd304b67eb4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.134205 Oct 15 03:46:03.137992 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 576/1166] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:03 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:03.299439 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5a4752a5-3f8c-4bed-90d7-de890e49c4ff tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:03.300074 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5a4752a5-3f8c-4bed-90d7-de890e49c4ff tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:03.305885 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a4752a5-3f8c-4bed-90d7-de890e49c4ff tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:03.306331 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a4752a5-3f8c-4bed-90d7-de890e49c4ff tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:03.307085 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a4752a5-3f8c-4bed-90d7-de890e49c4ff tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:03.307517 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a4752a5-3f8c-4bed-90d7-de890e49c4ff tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:03.365957 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5a4752a5-3f8c-4bed-90d7-de890e49c4ff tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:03.373038 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5a4752a5-3f8c-4bed-90d7-de890e49c4ff tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.077295 Oct 15 03:46:03.373587 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 591/1167] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:03 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:03.530111 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-489dd9cf-1ad3-41bc-8204-b7844ddaab20 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:03.530938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-489dd9cf-1ad3-41bc-8204-b7844ddaab20 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:03.536689 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-489dd9cf-1ad3-41bc-8204-b7844ddaab20 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:03.537128 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-489dd9cf-1ad3-41bc-8204-b7844ddaab20 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:03.537874 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-489dd9cf-1ad3-41bc-8204-b7844ddaab20 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:03.538299 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-489dd9cf-1ad3-41bc-8204-b7844ddaab20 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:03.566627 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-489dd9cf-1ad3-41bc-8204-b7844ddaab20 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040284 Oct 15 03:46:03.567169 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 577/1168] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:03 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:03.966499 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e1f49d6c-f542-451d-a4c1-b98c38041f14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:03.967320 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e1f49d6c-f542-451d-a4c1-b98c38041f14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:03.973226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1f49d6c-f542-451d-a4c1-b98c38041f14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:03.973672 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1f49d6c-f542-451d-a4c1-b98c38041f14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:03.974438 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1f49d6c-f542-451d-a4c1-b98c38041f14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:03.974862 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1f49d6c-f542-451d-a4c1-b98c38041f14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:04.002661 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e1f49d6c-f542-451d-a4c1-b98c38041f14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040611 Oct 15 03:46:04.003214 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 592/1169] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:03 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:04.154559 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-58c6b650-c0ac-464c-b001-052913c884e0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:04.155169 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-58c6b650-c0ac-464c-b001-052913c884e0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:04.160851 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-58c6b650-c0ac-464c-b001-052913c884e0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:04.161294 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-58c6b650-c0ac-464c-b001-052913c884e0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:04.162045 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-58c6b650-c0ac-464c-b001-052913c884e0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:04.162470 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-58c6b650-c0ac-464c-b001-052913c884e0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:04.278814 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-58c6b650-c0ac-464c-b001-052913c884e0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:04.285993 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-58c6b650-c0ac-464c-b001-052913c884e0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.135662 Oct 15 03:46:04.286558 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 578/1170] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:04 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:04.389800 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ee652c63-dfbf-4b1c-83dc-9686a73e74ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:04.390421 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ee652c63-dfbf-4b1c-83dc-9686a73e74ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:04.396819 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ee652c63-dfbf-4b1c-83dc-9686a73e74ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:04.397475 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ee652c63-dfbf-4b1c-83dc-9686a73e74ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:04.398402 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ee652c63-dfbf-4b1c-83dc-9686a73e74ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:04.399323 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ee652c63-dfbf-4b1c-83dc-9686a73e74ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:04.459929 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ee652c63-dfbf-4b1c-83dc-9686a73e74ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:04.466931 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ee652c63-dfbf-4b1c-83dc-9686a73e74ba tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.080805 Oct 15 03:46:04.467479 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 593/1171] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:04 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:04.578418 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7d588249-bcbe-4285-948f-a6d4262f9e93 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:04.579332 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7d588249-bcbe-4285-948f-a6d4262f9e93 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:04.585476 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7d588249-bcbe-4285-948f-a6d4262f9e93 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:04.585924 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7d588249-bcbe-4285-948f-a6d4262f9e93 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:04.586685 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7d588249-bcbe-4285-948f-a6d4262f9e93 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:04.587122 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7d588249-bcbe-4285-948f-a6d4262f9e93 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:04.616037 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7d588249-bcbe-4285-948f-a6d4262f9e93 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041315 Oct 15 03:46:04.616575 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 579/1172] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:04 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:05.014571 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9f546d3b-7249-4cd7-b094-5fac50b9eaf5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:05.015469 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9f546d3b-7249-4cd7-b094-5fac50b9eaf5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:05.021169 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9f546d3b-7249-4cd7-b094-5fac50b9eaf5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:05.021612 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9f546d3b-7249-4cd7-b094-5fac50b9eaf5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:05.022359 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9f546d3b-7249-4cd7-b094-5fac50b9eaf5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:05.022787 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9f546d3b-7249-4cd7-b094-5fac50b9eaf5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:05.051037 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9f546d3b-7249-4cd7-b094-5fac50b9eaf5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040383 Oct 15 03:46:05.051571 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 594/1173] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:05 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:05.303580 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0e052321-291b-4119-884d-2890d1190105 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:05.304212 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0e052321-291b-4119-884d-2890d1190105 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:05.310491 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0e052321-291b-4119-884d-2890d1190105 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:05.310931 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0e052321-291b-4119-884d-2890d1190105 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:05.311695 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0e052321-291b-4119-884d-2890d1190105 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:05.312141 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0e052321-291b-4119-884d-2890d1190105 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:05.430534 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0e052321-291b-4119-884d-2890d1190105 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:05.438275 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0e052321-291b-4119-884d-2890d1190105 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.138354 Oct 15 03:46:05.438834 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 580/1174] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:05 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:05.483042 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-64f2fd21-c7de-4707-b632-0577b0d31d14 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:05.483639 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-64f2fd21-c7de-4707-b632-0577b0d31d14 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:05.489253 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64f2fd21-c7de-4707-b632-0577b0d31d14 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:05.489695 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64f2fd21-c7de-4707-b632-0577b0d31d14 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:05.490440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64f2fd21-c7de-4707-b632-0577b0d31d14 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:05.490865 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64f2fd21-c7de-4707-b632-0577b0d31d14 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:05.547958 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-64f2fd21-c7de-4707-b632-0577b0d31d14 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:05.554887 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-64f2fd21-c7de-4707-b632-0577b0d31d14 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1224 microversion: 2.1 time: 0.075464 Oct 15 03:46:05.555438 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 595/1175] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:05 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1224 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:05.627175 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e4cfd3fa-3653-4d31-bf01-955322b6c405 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:05.628142 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e4cfd3fa-3653-4d31-bf01-955322b6c405 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:05.633733 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4cfd3fa-3653-4d31-bf01-955322b6c405 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:05.634181 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4cfd3fa-3653-4d31-bf01-955322b6c405 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:05.634935 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4cfd3fa-3653-4d31-bf01-955322b6c405 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:05.635368 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4cfd3fa-3653-4d31-bf01-955322b6c405 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:05.662544 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e4cfd3fa-3653-4d31-bf01-955322b6c405 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039111 Oct 15 03:46:05.663076 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 581/1176] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:05 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:06.062343 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-eb311426-7b5b-46df-a4c9-998183c3f4f4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:06.063250 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-eb311426-7b5b-46df-a4c9-998183c3f4f4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:06.069077 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eb311426-7b5b-46df-a4c9-998183c3f4f4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:06.069525 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eb311426-7b5b-46df-a4c9-998183c3f4f4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:06.070280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eb311426-7b5b-46df-a4c9-998183c3f4f4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:06.070717 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eb311426-7b5b-46df-a4c9-998183c3f4f4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:06.098892 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-eb311426-7b5b-46df-a4c9-998183c3f4f4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040331 Oct 15 03:46:06.099421 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 596/1177] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:06 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:06.454893 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-59a54c09-473d-4cc2-915b-f0221d77fe5f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:06.455417 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-59a54c09-473d-4cc2-915b-f0221d77fe5f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:06.461400 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-59a54c09-473d-4cc2-915b-f0221d77fe5f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:06.461843 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-59a54c09-473d-4cc2-915b-f0221d77fe5f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:06.462581 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-59a54c09-473d-4cc2-915b-f0221d77fe5f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:06.463137 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-59a54c09-473d-4cc2-915b-f0221d77fe5f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:06.573700 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6ef5aa9d-2015-4ad3-8c2a-49547f750a85 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:06.574337 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6ef5aa9d-2015-4ad3-8c2a-49547f750a85 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:06.581696 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6ef5aa9d-2015-4ad3-8c2a-49547f750a85 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:06.582178 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6ef5aa9d-2015-4ad3-8c2a-49547f750a85 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:06.583329 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6ef5aa9d-2015-4ad3-8c2a-49547f750a85 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:06.583963 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6ef5aa9d-2015-4ad3-8c2a-49547f750a85 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:06.590355 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-59a54c09-473d-4cc2-915b-f0221d77fe5f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:06.598141 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-59a54c09-473d-4cc2-915b-f0221d77fe5f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.146945 Oct 15 03:46:06.599060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 582/1178] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:06 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:06.614697 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6ef5aa9d-2015-4ad3-8c2a-49547f750a85 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:06.615138 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6ef5aa9d-2015-4ad3-8c2a-49547f750a85 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:06.615578 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.objects.instance [None req-6ef5aa9d-2015-4ad3-8c2a-49547f750a85 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lazy-loading 'fault' on Instance uuid 6e429526-26c8-4d98-8691-73770db59513 {{(pid=120897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 03:46:06.657577 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6ef5aa9d-2015-4ad3-8c2a-49547f750a85 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bb22a3461a47e5afeb229038cb4a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de088af04e804d909ae6daa141302d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:06.664692 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6ef5aa9d-2015-4ad3-8c2a-49547f750a85 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 200 len: 1229 microversion: 2.1 time: 0.096256 Oct 15 03:46:06.665320 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 597/1179] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:06 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 1229 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:06.674056 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f966f945-1057-4fd3-9320-cec83508c707 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:06.674969 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f966f945-1057-4fd3-9320-cec83508c707 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:06.680665 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f966f945-1057-4fd3-9320-cec83508c707 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:06.681115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f966f945-1057-4fd3-9320-cec83508c707 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:06.681878 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f966f945-1057-4fd3-9320-cec83508c707 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:06.682833 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f966f945-1057-4fd3-9320-cec83508c707 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:06.712041 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f966f945-1057-4fd3-9320-cec83508c707 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041642 Oct 15 03:46:06.712522 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 583/1180] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:06 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:07.110172 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-52426271-a301-4e24-a6a7-4b191186db49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:07.111086 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-52426271-a301-4e24-a6a7-4b191186db49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:07.117190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-52426271-a301-4e24-a6a7-4b191186db49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:07.117641 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-52426271-a301-4e24-a6a7-4b191186db49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:07.118405 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-52426271-a301-4e24-a6a7-4b191186db49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:07.118839 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-52426271-a301-4e24-a6a7-4b191186db49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:07.147433 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-52426271-a301-4e24-a6a7-4b191186db49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041087 Oct 15 03:46:07.147992 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 598/1181] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:07 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:46:07.614985 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-366ea326-ba05-41fd-b112-93b52c590b65 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:07.615586 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-366ea326-ba05-41fd-b112-93b52c590b65 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:07.621456 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-366ea326-ba05-41fd-b112-93b52c590b65 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:07.621898 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-366ea326-ba05-41fd-b112-93b52c590b65 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:07.622678 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-366ea326-ba05-41fd-b112-93b52c590b65 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:07.623102 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-366ea326-ba05-41fd-b112-93b52c590b65 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:07.680856 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b1fe3473-641e-4297-a7b8-49ec2da47183 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:07.681467 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b1fe3473-641e-4297-a7b8-49ec2da47183 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:07.687081 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b1fe3473-641e-4297-a7b8-49ec2da47183 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:07.687529 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b1fe3473-641e-4297-a7b8-49ec2da47183 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:07.688330 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b1fe3473-641e-4297-a7b8-49ec2da47183 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:07.688765 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b1fe3473-641e-4297-a7b8-49ec2da47183 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:07.702397 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.wsgi [None req-b1fe3473-641e-4297-a7b8-49ec2da47183 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] HTTP exception thrown: Instance 6e429526-26c8-4d98-8691-73770db59513 could not be found. Oct 15 03:46:07.703011 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b1fe3473-641e-4297-a7b8-49ec2da47183 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Returning 404 to user: Instance 6e429526-26c8-4d98-8691-73770db59513 could not be found. {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:46:07.703857 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b1fe3473-641e-4297-a7b8-49ec2da47183 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 404 len: 111 microversion: 2.1 time: 0.026605 Oct 15 03:46:07.704639 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 599/1182] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:07 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 03:46:07.723263 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-53d9fe50-430a-4ef3-81c3-6e6bac91ab00 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:07.723460 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-53d9fe50-430a-4ef3-81c3-6e6bac91ab00 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:07.729785 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53d9fe50-430a-4ef3-81c3-6e6bac91ab00 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:07.730269 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53d9fe50-430a-4ef3-81c3-6e6bac91ab00 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:07.731172 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53d9fe50-430a-4ef3-81c3-6e6bac91ab00 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:07.731608 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53d9fe50-430a-4ef3-81c3-6e6bac91ab00 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:07.743039 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-366ea326-ba05-41fd-b112-93b52c590b65 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:07.750580 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-366ea326-ba05-41fd-b112-93b52c590b65 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.139216 Oct 15 03:46:07.754107 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 584/1183] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:07 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:07.759378 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-435e9a82-9cac-4d5e-9ba2-a01924417b40 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1231438643", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-878614080", "security_groups": [{"name": "tempest-secgroup-smoke-749950884"}], "block_device_mapping_v2": [{"uuid": "59826191-e1c1-44b2-93af-a4c16173150d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0006c2d5-d608-4255-8781-4a519d11899d"}]}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:46:07.762673 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-53d9fe50-430a-4ef3-81c3-6e6bac91ab00 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044308 Oct 15 03:46:07.763149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 600/1184] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:07 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:46:08.158666 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ce527e34-0419-4df0-86ea-751d970723df tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:08.159526 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ce527e34-0419-4df0-86ea-751d970723df tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:08.165326 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ce527e34-0419-4df0-86ea-751d970723df tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:08.165773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ce527e34-0419-4df0-86ea-751d970723df tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:08.166535 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ce527e34-0419-4df0-86ea-751d970723df tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:08.166968 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ce527e34-0419-4df0-86ea-751d970723df tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:08.195246 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ce527e34-0419-4df0-86ea-751d970723df tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040422 Oct 15 03:46:08.195803 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 601/1185] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:08 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:08.766964 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c5b475a5-6794-4bf5-97d9-27fd6a5dfc6b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:08.767570 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c5b475a5-6794-4bf5-97d9-27fd6a5dfc6b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:08.773354 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c5b475a5-6794-4bf5-97d9-27fd6a5dfc6b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:08.773791 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c5b475a5-6794-4bf5-97d9-27fd6a5dfc6b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:08.774554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c5b475a5-6794-4bf5-97d9-27fd6a5dfc6b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:08.774985 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c5b475a5-6794-4bf5-97d9-27fd6a5dfc6b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:08.893201 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c5b475a5-6794-4bf5-97d9-27fd6a5dfc6b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:08.900320 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c5b475a5-6794-4bf5-97d9-27fd6a5dfc6b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.136977 Oct 15 03:46:08.901454 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 602/1186] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:08 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:08.906041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f447ba85-85ca-465c-ad8d-c29a111cb5ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:08.907721 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f447ba85-85ca-465c-ad8d-c29a111cb5ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:08.913913 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f447ba85-85ca-465c-ad8d-c29a111cb5ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:08.914369 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f447ba85-85ca-465c-ad8d-c29a111cb5ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:08.915201 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f447ba85-85ca-465c-ad8d-c29a111cb5ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:08.915638 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f447ba85-85ca-465c-ad8d-c29a111cb5ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:08.943857 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f447ba85-85ca-465c-ad8d-c29a111cb5ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041131 Oct 15 03:46:08.944386 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 603/1187] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:08 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:09.206935 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-664970fc-9029-41d5-b748-ddffec1de504 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:09.207773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-664970fc-9029-41d5-b748-ddffec1de504 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:09.214245 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-664970fc-9029-41d5-b748-ddffec1de504 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:09.214682 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-664970fc-9029-41d5-b748-ddffec1de504 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:09.215423 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-664970fc-9029-41d5-b748-ddffec1de504 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:09.215878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-664970fc-9029-41d5-b748-ddffec1de504 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:09.243628 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-664970fc-9029-41d5-b748-ddffec1de504 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039933 Oct 15 03:46:09.243955 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 604/1188] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:09 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:46:09.918028 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f5ac7060-9d9a-49e5-b7d5-5a42f33dddb8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:09.918635 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f5ac7060-9d9a-49e5-b7d5-5a42f33dddb8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:09.924421 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f5ac7060-9d9a-49e5-b7d5-5a42f33dddb8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:09.924868 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f5ac7060-9d9a-49e5-b7d5-5a42f33dddb8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:09.925622 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f5ac7060-9d9a-49e5-b7d5-5a42f33dddb8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:09.926056 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f5ac7060-9d9a-49e5-b7d5-5a42f33dddb8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:10.040892 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f5ac7060-9d9a-49e5-b7d5-5a42f33dddb8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:10.048556 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f5ac7060-9d9a-49e5-b7d5-5a42f33dddb8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.134201 Oct 15 03:46:10.049106 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 605/1189] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:09 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:10.053336 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-57d0006b-482e-4b06-a0de-192195aaf76f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:10.054220 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-57d0006b-482e-4b06-a0de-192195aaf76f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:10.060004 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-57d0006b-482e-4b06-a0de-192195aaf76f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:10.060455 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-57d0006b-482e-4b06-a0de-192195aaf76f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:10.061207 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-57d0006b-482e-4b06-a0de-192195aaf76f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:10.061640 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-57d0006b-482e-4b06-a0de-192195aaf76f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:10.089289 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-57d0006b-482e-4b06-a0de-192195aaf76f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039233 Oct 15 03:46:10.089810 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 606/1190] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:10 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:10.254192 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cd91a680-e1dc-40d2-b221-90d86335e782 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:10.255094 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cd91a680-e1dc-40d2-b221-90d86335e782 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:10.260911 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd91a680-e1dc-40d2-b221-90d86335e782 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:10.261356 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd91a680-e1dc-40d2-b221-90d86335e782 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:10.262110 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd91a680-e1dc-40d2-b221-90d86335e782 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:10.262541 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd91a680-e1dc-40d2-b221-90d86335e782 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:10.289879 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cd91a680-e1dc-40d2-b221-90d86335e782 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039433 Oct 15 03:46:10.290403 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 607/1191] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:10 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:46:11.066324 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a7f84a60-6702-4021-b666-5427965badde tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:11.066931 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a7f84a60-6702-4021-b666-5427965badde tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:11.073258 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a7f84a60-6702-4021-b666-5427965badde tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:11.073723 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a7f84a60-6702-4021-b666-5427965badde tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:11.074467 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a7f84a60-6702-4021-b666-5427965badde tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:11.074891 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a7f84a60-6702-4021-b666-5427965badde tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:11.190464 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a7f84a60-6702-4021-b666-5427965badde tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:11.198165 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a7f84a60-6702-4021-b666-5427965badde tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.135039 Oct 15 03:46:11.198711 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 608/1192] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:11 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:11.202901 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-dd82468b-cf6f-4018-868e-e3c237eab26d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:11.203812 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-dd82468b-cf6f-4018-868e-e3c237eab26d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:11.209658 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dd82468b-cf6f-4018-868e-e3c237eab26d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:11.210104 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dd82468b-cf6f-4018-868e-e3c237eab26d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:11.210847 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dd82468b-cf6f-4018-868e-e3c237eab26d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:11.211271 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dd82468b-cf6f-4018-868e-e3c237eab26d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:11.238584 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-dd82468b-cf6f-4018-868e-e3c237eab26d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038888 Oct 15 03:46:11.239120 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 609/1193] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:11 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:11.302050 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bee57023-4624-4472-b9b1-5108540c1616 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:11.302956 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bee57023-4624-4472-b9b1-5108540c1616 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:11.309133 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bee57023-4624-4472-b9b1-5108540c1616 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:11.309575 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bee57023-4624-4472-b9b1-5108540c1616 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:11.310327 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bee57023-4624-4472-b9b1-5108540c1616 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:11.310754 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bee57023-4624-4472-b9b1-5108540c1616 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:11.339163 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bee57023-4624-4472-b9b1-5108540c1616 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040723 Oct 15 03:46:11.339632 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 610/1194] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:11 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:46:12.214238 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-809db15f-f7ff-4745-b163-5bf0cf80e8d9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:12.214835 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-809db15f-f7ff-4745-b163-5bf0cf80e8d9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:12.220682 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-809db15f-f7ff-4745-b163-5bf0cf80e8d9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:12.221125 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-809db15f-f7ff-4745-b163-5bf0cf80e8d9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:12.221867 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-809db15f-f7ff-4745-b163-5bf0cf80e8d9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:12.222293 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-809db15f-f7ff-4745-b163-5bf0cf80e8d9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:12.342474 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-809db15f-f7ff-4745-b163-5bf0cf80e8d9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:12.349642 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-809db15f-f7ff-4745-b163-5bf0cf80e8d9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.139027 Oct 15 03:46:12.350193 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 611/1195] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:12 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:12.354925 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2e1b69ba-0936-4d9e-9ec5-f710757d466b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:12.355839 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2e1b69ba-0936-4d9e-9ec5-f710757d466b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:12.361058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2e1b69ba-0936-4d9e-9ec5-f710757d466b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:12.361504 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2e1b69ba-0936-4d9e-9ec5-f710757d466b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:12.362269 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2e1b69ba-0936-4d9e-9ec5-f710757d466b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:12.362688 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2e1b69ba-0936-4d9e-9ec5-f710757d466b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:12.391549 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2e1b69ba-0936-4d9e-9ec5-f710757d466b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040403 Oct 15 03:46:12.392107 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 612/1196] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:12 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:12.396257 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1dca42ef-322a-4e95-8381-edefce1b6f23 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:12.397110 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1dca42ef-322a-4e95-8381-edefce1b6f23 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:12.402215 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1dca42ef-322a-4e95-8381-edefce1b6f23 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:12.402663 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1dca42ef-322a-4e95-8381-edefce1b6f23 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:12.403405 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1dca42ef-322a-4e95-8381-edefce1b6f23 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:12.403873 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1dca42ef-322a-4e95-8381-edefce1b6f23 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:12.431113 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1dca42ef-322a-4e95-8381-edefce1b6f23 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038086 Oct 15 03:46:12.432193 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 613/1197] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:12 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:13.366937 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ad2f8b74-2dac-450e-9435-0ad43a5ed5ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:13.367527 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ad2f8b74-2dac-450e-9435-0ad43a5ed5ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:13.373797 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ad2f8b74-2dac-450e-9435-0ad43a5ed5ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:13.374241 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ad2f8b74-2dac-450e-9435-0ad43a5ed5ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:13.374990 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ad2f8b74-2dac-450e-9435-0ad43a5ed5ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:13.375418 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ad2f8b74-2dac-450e-9435-0ad43a5ed5ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:13.492756 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ad2f8b74-2dac-450e-9435-0ad43a5ed5ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:13.500539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ad2f8b74-2dac-450e-9435-0ad43a5ed5ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.137156 Oct 15 03:46:13.501036 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 614/1198] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:13 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:13.505277 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-229e2462-3f07-436f-b58b-dcc84a307c5c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:13.506175 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-229e2462-3f07-436f-b58b-dcc84a307c5c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:13.512101 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-229e2462-3f07-436f-b58b-dcc84a307c5c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:13.512551 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-229e2462-3f07-436f-b58b-dcc84a307c5c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:13.513308 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-229e2462-3f07-436f-b58b-dcc84a307c5c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:13.513742 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-229e2462-3f07-436f-b58b-dcc84a307c5c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:13.541388 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-229e2462-3f07-436f-b58b-dcc84a307c5c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039393 Oct 15 03:46:13.541921 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 615/1199] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:13 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:13.546074 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-abaea3a0-5c1a-4007-a28c-38a480626ce3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:13.546929 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-abaea3a0-5c1a-4007-a28c-38a480626ce3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:13.552101 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-abaea3a0-5c1a-4007-a28c-38a480626ce3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:13.552552 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-abaea3a0-5c1a-4007-a28c-38a480626ce3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:13.553321 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-abaea3a0-5c1a-4007-a28c-38a480626ce3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:13.553741 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-abaea3a0-5c1a-4007-a28c-38a480626ce3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:13.581868 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-abaea3a0-5c1a-4007-a28c-38a480626ce3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039029 Oct 15 03:46:13.582386 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 616/1200] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:13 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:14.517609 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4755923b-4a20-4ecd-a888-65b4a0785c8e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:14.518250 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4755923b-4a20-4ecd-a888-65b4a0785c8e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:14.523986 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4755923b-4a20-4ecd-a888-65b4a0785c8e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:14.524432 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4755923b-4a20-4ecd-a888-65b4a0785c8e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:14.525215 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4755923b-4a20-4ecd-a888-65b4a0785c8e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:14.525647 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4755923b-4a20-4ecd-a888-65b4a0785c8e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:14.640252 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4755923b-4a20-4ecd-a888-65b4a0785c8e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:14.647367 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4755923b-4a20-4ecd-a888-65b4a0785c8e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.133447 Oct 15 03:46:14.647948 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 617/1201] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:14 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:14.652844 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-21e865f9-62ba-452d-afa3-a87633174da9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:14.653728 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-21e865f9-62ba-452d-afa3-a87633174da9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:14.659157 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-21e865f9-62ba-452d-afa3-a87633174da9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:14.659599 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-21e865f9-62ba-452d-afa3-a87633174da9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:14.660392 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-21e865f9-62ba-452d-afa3-a87633174da9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:14.660856 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-21e865f9-62ba-452d-afa3-a87633174da9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:14.688194 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-21e865f9-62ba-452d-afa3-a87633174da9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039286 Oct 15 03:46:14.688727 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 618/1202] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:14 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:14.692895 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-006aee8a-c4eb-4741-b629-8abe2254e998 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:14.693758 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-006aee8a-c4eb-4741-b629-8abe2254e998 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:14.699270 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-006aee8a-c4eb-4741-b629-8abe2254e998 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:14.699743 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-006aee8a-c4eb-4741-b629-8abe2254e998 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:14.700487 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-006aee8a-c4eb-4741-b629-8abe2254e998 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:14.701210 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-006aee8a-c4eb-4741-b629-8abe2254e998 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:14.729462 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-006aee8a-c4eb-4741-b629-8abe2254e998 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039795 Oct 15 03:46:14.730001 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 619/1203] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:14 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:15.664522 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bb9394d6-cb75-4f2d-8736-0aeacd5752d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:15.665134 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bb9394d6-cb75-4f2d-8736-0aeacd5752d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:15.671403 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bb9394d6-cb75-4f2d-8736-0aeacd5752d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:15.671884 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bb9394d6-cb75-4f2d-8736-0aeacd5752d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:15.672631 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bb9394d6-cb75-4f2d-8736-0aeacd5752d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:15.673065 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bb9394d6-cb75-4f2d-8736-0aeacd5752d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:15.791493 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bb9394d6-cb75-4f2d-8736-0aeacd5752d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:15.799229 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bb9394d6-cb75-4f2d-8736-0aeacd5752d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.138428 Oct 15 03:46:15.799800 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 620/1204] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:15 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:15.804057 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7f054ba7-812b-4388-b9fe-15dfd5e56300 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:15.804943 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7f054ba7-812b-4388-b9fe-15dfd5e56300 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:15.810109 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7f054ba7-812b-4388-b9fe-15dfd5e56300 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:15.810543 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7f054ba7-812b-4388-b9fe-15dfd5e56300 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:15.811288 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7f054ba7-812b-4388-b9fe-15dfd5e56300 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:15.811804 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7f054ba7-812b-4388-b9fe-15dfd5e56300 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:15.839761 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7f054ba7-812b-4388-b9fe-15dfd5e56300 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038982 Oct 15 03:46:15.840280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 621/1205] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:15 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:15.844526 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-558b12a4-d266-45f8-9c77-3e80b32294cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:15.845370 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-558b12a4-d266-45f8-9c77-3e80b32294cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:15.850385 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-558b12a4-d266-45f8-9c77-3e80b32294cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:15.850824 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-558b12a4-d266-45f8-9c77-3e80b32294cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:15.851553 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-558b12a4-d266-45f8-9c77-3e80b32294cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:15.852003 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-558b12a4-d266-45f8-9c77-3e80b32294cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:15.878965 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-558b12a4-d266-45f8-9c77-3e80b32294cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.037778 Oct 15 03:46:15.879475 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 622/1206] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:15 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:16.815866 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e88d6841-8d22-4e94-bfa7-48f534fe6d98 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:16.816511 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e88d6841-8d22-4e94-bfa7-48f534fe6d98 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:16.822169 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e88d6841-8d22-4e94-bfa7-48f534fe6d98 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:16.822612 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e88d6841-8d22-4e94-bfa7-48f534fe6d98 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:16.823890 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e88d6841-8d22-4e94-bfa7-48f534fe6d98 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:16.824320 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e88d6841-8d22-4e94-bfa7-48f534fe6d98 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:16.943640 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e88d6841-8d22-4e94-bfa7-48f534fe6d98 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:16.951233 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e88d6841-8d22-4e94-bfa7-48f534fe6d98 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.139012 Oct 15 03:46:16.951803 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 623/1207] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:16 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:16.956077 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8b6053d4-3b01-4c84-8e91-5032038aa5d8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:16.956958 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8b6053d4-3b01-4c84-8e91-5032038aa5d8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:16.962308 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8b6053d4-3b01-4c84-8e91-5032038aa5d8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:16.962748 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8b6053d4-3b01-4c84-8e91-5032038aa5d8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:16.964154 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8b6053d4-3b01-4c84-8e91-5032038aa5d8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:16.964583 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8b6053d4-3b01-4c84-8e91-5032038aa5d8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:16.992290 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8b6053d4-3b01-4c84-8e91-5032038aa5d8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039551 Oct 15 03:46:16.992810 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 624/1208] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:16 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:16.997042 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a25f5815-f011-45c3-bc9b-0173fcb4ed88 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:16.997885 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a25f5815-f011-45c3-bc9b-0173fcb4ed88 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:17.002907 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a25f5815-f011-45c3-bc9b-0173fcb4ed88 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:17.003348 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a25f5815-f011-45c3-bc9b-0173fcb4ed88 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:17.004117 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a25f5815-f011-45c3-bc9b-0173fcb4ed88 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:17.004547 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a25f5815-f011-45c3-bc9b-0173fcb4ed88 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:17.032061 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a25f5815-f011-45c3-bc9b-0173fcb4ed88 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038306 Oct 15 03:46:17.032583 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 625/1209] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:16 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:17.968742 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2b5923d8-0241-4c3b-bb57-2fcb02cf5e32 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:17.969413 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2b5923d8-0241-4c3b-bb57-2fcb02cf5e32 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:17.975116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2b5923d8-0241-4c3b-bb57-2fcb02cf5e32 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:17.975565 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2b5923d8-0241-4c3b-bb57-2fcb02cf5e32 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:17.976357 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2b5923d8-0241-4c3b-bb57-2fcb02cf5e32 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:17.976791 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2b5923d8-0241-4c3b-bb57-2fcb02cf5e32 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:18.093585 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2b5923d8-0241-4c3b-bb57-2fcb02cf5e32 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:18.101605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2b5923d8-0241-4c3b-bb57-2fcb02cf5e32 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.136553 Oct 15 03:46:18.102163 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 626/1210] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:17 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:18.106995 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c7b6d9fa-6e3f-41d2-bc4d-b68d6dd7122a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:18.107920 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c7b6d9fa-6e3f-41d2-bc4d-b68d6dd7122a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:18.113269 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c7b6d9fa-6e3f-41d2-bc4d-b68d6dd7122a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:18.113723 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c7b6d9fa-6e3f-41d2-bc4d-b68d6dd7122a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:18.114478 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c7b6d9fa-6e3f-41d2-bc4d-b68d6dd7122a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:18.114915 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c7b6d9fa-6e3f-41d2-bc4d-b68d6dd7122a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:18.142332 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c7b6d9fa-6e3f-41d2-bc4d-b68d6dd7122a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039214 Oct 15 03:46:18.142860 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 627/1211] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:18 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:18.147006 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a516c0eb-58e4-4cda-b534-4ba88166faf9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:18.147899 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a516c0eb-58e4-4cda-b534-4ba88166faf9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:18.153510 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a516c0eb-58e4-4cda-b534-4ba88166faf9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:18.153959 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a516c0eb-58e4-4cda-b534-4ba88166faf9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:18.154704 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a516c0eb-58e4-4cda-b534-4ba88166faf9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:18.155137 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a516c0eb-58e4-4cda-b534-4ba88166faf9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:18.182555 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a516c0eb-58e4-4cda-b534-4ba88166faf9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038670 Oct 15 03:46:18.183082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 628/1212] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:18 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:19.118952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f66cc299-f6f8-4124-9d36-df151b644b8a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:19.119616 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f66cc299-f6f8-4124-9d36-df151b644b8a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:19.125364 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f66cc299-f6f8-4124-9d36-df151b644b8a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:19.125814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f66cc299-f6f8-4124-9d36-df151b644b8a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:19.126617 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f66cc299-f6f8-4124-9d36-df151b644b8a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:19.127052 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f66cc299-f6f8-4124-9d36-df151b644b8a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:19.246669 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f66cc299-f6f8-4124-9d36-df151b644b8a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:19.253806 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f66cc299-f6f8-4124-9d36-df151b644b8a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.138493 Oct 15 03:46:19.254353 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 629/1213] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:19 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:19.258540 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-013b9f3c-e669-4654-9fe3-f038dc7815d9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:19.259425 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-013b9f3c-e669-4654-9fe3-f038dc7815d9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:19.265590 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-013b9f3c-e669-4654-9fe3-f038dc7815d9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:19.266025 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-013b9f3c-e669-4654-9fe3-f038dc7815d9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:19.266767 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-013b9f3c-e669-4654-9fe3-f038dc7815d9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:19.267190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-013b9f3c-e669-4654-9fe3-f038dc7815d9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:19.294873 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-013b9f3c-e669-4654-9fe3-f038dc7815d9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039583 Oct 15 03:46:19.295395 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 630/1214] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:19 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:19.299511 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e1814f78-7b1a-4b67-8dd1-021f0fae1c2c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:19.300383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e1814f78-7b1a-4b67-8dd1-021f0fae1c2c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:19.305635 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1814f78-7b1a-4b67-8dd1-021f0fae1c2c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:19.306077 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1814f78-7b1a-4b67-8dd1-021f0fae1c2c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:19.306808 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1814f78-7b1a-4b67-8dd1-021f0fae1c2c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:19.307236 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1814f78-7b1a-4b67-8dd1-021f0fae1c2c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:19.335888 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e1814f78-7b1a-4b67-8dd1-021f0fae1c2c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039513 Oct 15 03:46:19.336413 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 631/1215] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:19 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:20.270106 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f6a28d22-3f0a-4f5a-8c99-8e5c19d0d81a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:20.270721 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f6a28d22-3f0a-4f5a-8c99-8e5c19d0d81a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:20.276651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6a28d22-3f0a-4f5a-8c99-8e5c19d0d81a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:20.277707 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6a28d22-3f0a-4f5a-8c99-8e5c19d0d81a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:20.278495 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6a28d22-3f0a-4f5a-8c99-8e5c19d0d81a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:20.278919 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6a28d22-3f0a-4f5a-8c99-8e5c19d0d81a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:20.394983 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f6a28d22-3f0a-4f5a-8c99-8e5c19d0d81a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:20.402562 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f6a28d22-3f0a-4f5a-8c99-8e5c19d0d81a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.135635 Oct 15 03:46:20.403107 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 632/1216] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:20 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:20.407306 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-108e420a-182c-4e76-b09c-06cb3eb74926 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:20.408221 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-108e420a-182c-4e76-b09c-06cb3eb74926 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:20.413445 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-108e420a-182c-4e76-b09c-06cb3eb74926 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:20.413883 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-108e420a-182c-4e76-b09c-06cb3eb74926 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:20.414635 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-108e420a-182c-4e76-b09c-06cb3eb74926 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:20.415058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-108e420a-182c-4e76-b09c-06cb3eb74926 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:20.442981 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-108e420a-182c-4e76-b09c-06cb3eb74926 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038909 Oct 15 03:46:20.443508 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 633/1217] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:20 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:20.447670 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3156a8c1-8752-4286-96c9-63167686ee20 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:20.448549 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3156a8c1-8752-4286-96c9-63167686ee20 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:20.455133 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3156a8c1-8752-4286-96c9-63167686ee20 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:20.455589 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3156a8c1-8752-4286-96c9-63167686ee20 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:20.456344 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3156a8c1-8752-4286-96c9-63167686ee20 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:20.456770 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3156a8c1-8752-4286-96c9-63167686ee20 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:20.484939 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3156a8c1-8752-4286-96c9-63167686ee20 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040151 Oct 15 03:46:20.485468 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 634/1218] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:20 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:21.419769 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-770f8cd5-5e3c-40a5-876d-c50d69705c32 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:21.420332 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-770f8cd5-5e3c-40a5-876d-c50d69705c32 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:21.426054 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-770f8cd5-5e3c-40a5-876d-c50d69705c32 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:21.426495 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-770f8cd5-5e3c-40a5-876d-c50d69705c32 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:21.427243 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-770f8cd5-5e3c-40a5-876d-c50d69705c32 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:21.427672 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-770f8cd5-5e3c-40a5-876d-c50d69705c32 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:21.552909 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-770f8cd5-5e3c-40a5-876d-c50d69705c32 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:21.560472 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-770f8cd5-5e3c-40a5-876d-c50d69705c32 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.144886 Oct 15 03:46:21.561005 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 635/1219] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:21 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:21.568186 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f1d788cc-2be5-48d5-8177-2b3011a493ce tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:21.568186 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f1d788cc-2be5-48d5-8177-2b3011a493ce tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:21.571454 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f1d788cc-2be5-48d5-8177-2b3011a493ce tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:21.571942 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f1d788cc-2be5-48d5-8177-2b3011a493ce tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:21.572706 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f1d788cc-2be5-48d5-8177-2b3011a493ce tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:21.573143 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f1d788cc-2be5-48d5-8177-2b3011a493ce tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:21.602547 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f1d788cc-2be5-48d5-8177-2b3011a493ce tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040588 Oct 15 03:46:21.603076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 636/1220] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:21 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:21.608127 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1e54d744-ac5c-48cf-a459-b0def0e5e4e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:21.608989 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1e54d744-ac5c-48cf-a459-b0def0e5e4e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:21.614163 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e54d744-ac5c-48cf-a459-b0def0e5e4e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:21.614607 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e54d744-ac5c-48cf-a459-b0def0e5e4e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:21.615357 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e54d744-ac5c-48cf-a459-b0def0e5e4e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:21.615831 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e54d744-ac5c-48cf-a459-b0def0e5e4e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:21.642671 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1e54d744-ac5c-48cf-a459-b0def0e5e4e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038660 Oct 15 03:46:21.643200 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 637/1221] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:21 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:22.578194 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-40ea5d3e-2204-49cb-9025-27b9290fffa8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:22.578834 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-40ea5d3e-2204-49cb-9025-27b9290fffa8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:22.584892 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-40ea5d3e-2204-49cb-9025-27b9290fffa8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:22.585340 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-40ea5d3e-2204-49cb-9025-27b9290fffa8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:22.586097 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-40ea5d3e-2204-49cb-9025-27b9290fffa8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:22.586533 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-40ea5d3e-2204-49cb-9025-27b9290fffa8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:22.704931 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-40ea5d3e-2204-49cb-9025-27b9290fffa8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:22.712321 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-40ea5d3e-2204-49cb-9025-27b9290fffa8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.138395 Oct 15 03:46:22.712887 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 638/1222] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:22 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:22.717274 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a6694a1c-5210-4ab3-8ca4-193ec9e44426 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:22.718168 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a6694a1c-5210-4ab3-8ca4-193ec9e44426 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:22.723385 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a6694a1c-5210-4ab3-8ca4-193ec9e44426 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:22.723886 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a6694a1c-5210-4ab3-8ca4-193ec9e44426 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:22.724647 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a6694a1c-5210-4ab3-8ca4-193ec9e44426 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:22.725082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a6694a1c-5210-4ab3-8ca4-193ec9e44426 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:22.753558 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a6694a1c-5210-4ab3-8ca4-193ec9e44426 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039716 Oct 15 03:46:22.754089 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 639/1223] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:22 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:22.758395 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1008e638-c38e-4a31-b255-21a9ee3da58f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:22.759256 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1008e638-c38e-4a31-b255-21a9ee3da58f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:22.764436 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1008e638-c38e-4a31-b255-21a9ee3da58f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:22.764887 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1008e638-c38e-4a31-b255-21a9ee3da58f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:22.765645 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1008e638-c38e-4a31-b255-21a9ee3da58f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:22.766088 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1008e638-c38e-4a31-b255-21a9ee3da58f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:22.793509 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1008e638-c38e-4a31-b255-21a9ee3da58f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038416 Oct 15 03:46:22.794034 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 640/1224] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:22 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:23.729029 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e22ccada-3c5e-4acc-9061-e9be6fa70879 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:23.729647 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e22ccada-3c5e-4acc-9061-e9be6fa70879 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:23.735249 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e22ccada-3c5e-4acc-9061-e9be6fa70879 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:23.735724 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e22ccada-3c5e-4acc-9061-e9be6fa70879 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:23.736489 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e22ccada-3c5e-4acc-9061-e9be6fa70879 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:23.736927 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e22ccada-3c5e-4acc-9061-e9be6fa70879 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:23.851834 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e22ccada-3c5e-4acc-9061-e9be6fa70879 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:23.858960 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e22ccada-3c5e-4acc-9061-e9be6fa70879 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.133682 Oct 15 03:46:23.859512 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 641/1225] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:23 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:23.863870 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-14fc6967-ea39-48f4-944d-ff2ca8902aa5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:23.864758 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-14fc6967-ea39-48f4-944d-ff2ca8902aa5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:23.870133 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-14fc6967-ea39-48f4-944d-ff2ca8902aa5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:23.871107 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-14fc6967-ea39-48f4-944d-ff2ca8902aa5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:23.871924 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-14fc6967-ea39-48f4-944d-ff2ca8902aa5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:23.872352 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-14fc6967-ea39-48f4-944d-ff2ca8902aa5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:23.900178 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-14fc6967-ea39-48f4-944d-ff2ca8902aa5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039648 Oct 15 03:46:23.900708 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 642/1226] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:23 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:23.904872 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2e531b72-06b7-4ce7-a632-d2758c61b1e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:23.905720 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2e531b72-06b7-4ce7-a632-d2758c61b1e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:23.910804 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2e531b72-06b7-4ce7-a632-d2758c61b1e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:23.911253 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2e531b72-06b7-4ce7-a632-d2758c61b1e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:23.912030 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2e531b72-06b7-4ce7-a632-d2758c61b1e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:23.912458 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2e531b72-06b7-4ce7-a632-d2758c61b1e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:23.939491 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2e531b72-06b7-4ce7-a632-d2758c61b1e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.037863 Oct 15 03:46:23.940048 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 643/1227] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:23 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:24.875729 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d0905a99-7b82-432d-b001-2d458cfe99e5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:24.876442 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d0905a99-7b82-432d-b001-2d458cfe99e5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:24.882271 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d0905a99-7b82-432d-b001-2d458cfe99e5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:24.882719 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d0905a99-7b82-432d-b001-2d458cfe99e5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:24.883483 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d0905a99-7b82-432d-b001-2d458cfe99e5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:24.883948 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d0905a99-7b82-432d-b001-2d458cfe99e5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:24.999963 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d0905a99-7b82-432d-b001-2d458cfe99e5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:25.007378 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d0905a99-7b82-432d-b001-2d458cfe99e5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.135298 Oct 15 03:46:25.007971 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 644/1228] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:24 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:25.012873 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-89246742-d33c-42fc-b9ce-48b5be624940 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:25.013762 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-89246742-d33c-42fc-b9ce-48b5be624940 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:25.019124 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-89246742-d33c-42fc-b9ce-48b5be624940 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:25.019570 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-89246742-d33c-42fc-b9ce-48b5be624940 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:25.020357 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-89246742-d33c-42fc-b9ce-48b5be624940 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:25.020791 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-89246742-d33c-42fc-b9ce-48b5be624940 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:25.048568 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-89246742-d33c-42fc-b9ce-48b5be624940 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039653 Oct 15 03:46:25.049092 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 645/1229] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:25 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:25.053333 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e745c505-9a18-4619-b1ca-f3dcb6193cb5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:25.054183 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e745c505-9a18-4619-b1ca-f3dcb6193cb5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:25.059724 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e745c505-9a18-4619-b1ca-f3dcb6193cb5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:25.060178 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e745c505-9a18-4619-b1ca-f3dcb6193cb5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:25.060947 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e745c505-9a18-4619-b1ca-f3dcb6193cb5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:25.061383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e745c505-9a18-4619-b1ca-f3dcb6193cb5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:25.090007 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e745c505-9a18-4619-b1ca-f3dcb6193cb5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039413 Oct 15 03:46:25.090527 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 646/1230] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:25 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:26.024047 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2d558d27-979c-4ba2-9bed-8daa4cc01a6b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:26.024712 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2d558d27-979c-4ba2-9bed-8daa4cc01a6b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:26.030721 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2d558d27-979c-4ba2-9bed-8daa4cc01a6b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:26.031164 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2d558d27-979c-4ba2-9bed-8daa4cc01a6b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:26.031954 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2d558d27-979c-4ba2-9bed-8daa4cc01a6b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:26.032382 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2d558d27-979c-4ba2-9bed-8daa4cc01a6b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:26.149903 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2d558d27-979c-4ba2-9bed-8daa4cc01a6b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:26.157469 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2d558d27-979c-4ba2-9bed-8daa4cc01a6b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.137128 Oct 15 03:46:26.158020 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 647/1231] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:26 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:26.162237 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-df9496b7-8f8d-4f5e-8847-fd08ecdf1834 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:26.163119 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-df9496b7-8f8d-4f5e-8847-fd08ecdf1834 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:26.168882 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df9496b7-8f8d-4f5e-8847-fd08ecdf1834 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:26.169324 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df9496b7-8f8d-4f5e-8847-fd08ecdf1834 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:26.170070 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df9496b7-8f8d-4f5e-8847-fd08ecdf1834 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:26.170497 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df9496b7-8f8d-4f5e-8847-fd08ecdf1834 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:26.198875 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-df9496b7-8f8d-4f5e-8847-fd08ecdf1834 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039869 Oct 15 03:46:26.199414 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 648/1232] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:26 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:26.203606 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-abcd6e0b-69aa-4b22-b207-e84b28284f35 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:26.204500 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-abcd6e0b-69aa-4b22-b207-e84b28284f35 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:26.210073 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-abcd6e0b-69aa-4b22-b207-e84b28284f35 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:26.210512 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-abcd6e0b-69aa-4b22-b207-e84b28284f35 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:26.211252 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-abcd6e0b-69aa-4b22-b207-e84b28284f35 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:26.211695 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-abcd6e0b-69aa-4b22-b207-e84b28284f35 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:26.240234 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-abcd6e0b-69aa-4b22-b207-e84b28284f35 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039791 Oct 15 03:46:26.241024 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 649/1233] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:26 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:27.174585 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d6567480-82ba-4633-b9fc-09cb08617c15 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:27.175243 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d6567480-82ba-4633-b9fc-09cb08617c15 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:27.180809 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6567480-82ba-4633-b9fc-09cb08617c15 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:27.181251 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6567480-82ba-4633-b9fc-09cb08617c15 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:27.181995 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6567480-82ba-4633-b9fc-09cb08617c15 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:27.182423 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6567480-82ba-4633-b9fc-09cb08617c15 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:27.301573 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d6567480-82ba-4633-b9fc-09cb08617c15 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:27.309376 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d6567480-82ba-4633-b9fc-09cb08617c15 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.137789 Oct 15 03:46:27.309930 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 650/1234] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:27 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:27.314168 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9ab889c6-6ab5-4528-8794-2302458cd023 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:27.315058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9ab889c6-6ab5-4528-8794-2302458cd023 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:27.320340 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9ab889c6-6ab5-4528-8794-2302458cd023 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:27.320787 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9ab889c6-6ab5-4528-8794-2302458cd023 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:27.321538 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9ab889c6-6ab5-4528-8794-2302458cd023 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:27.321969 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9ab889c6-6ab5-4528-8794-2302458cd023 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:27.349693 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9ab889c6-6ab5-4528-8794-2302458cd023 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038790 Oct 15 03:46:27.350216 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 651/1235] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:27 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:27.354321 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-41de5cfb-3ba6-42ba-a7dc-f9ef317e88a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:27.355672 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-41de5cfb-3ba6-42ba-a7dc-f9ef317e88a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:27.360760 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-41de5cfb-3ba6-42ba-a7dc-f9ef317e88a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:27.361205 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-41de5cfb-3ba6-42ba-a7dc-f9ef317e88a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:27.362131 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-41de5cfb-3ba6-42ba-a7dc-f9ef317e88a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:27.362557 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-41de5cfb-3ba6-42ba-a7dc-f9ef317e88a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:27.390375 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-41de5cfb-3ba6-42ba-a7dc-f9ef317e88a5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039238 Oct 15 03:46:27.390892 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 652/1236] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:27 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:28.326720 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-810f09c6-c152-4bdd-ba6e-3ea37ae1e9b4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:28.327316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-810f09c6-c152-4bdd-ba6e-3ea37ae1e9b4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:28.333071 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-810f09c6-c152-4bdd-ba6e-3ea37ae1e9b4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:28.333514 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-810f09c6-c152-4bdd-ba6e-3ea37ae1e9b4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:28.334513 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-810f09c6-c152-4bdd-ba6e-3ea37ae1e9b4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:28.334941 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-810f09c6-c152-4bdd-ba6e-3ea37ae1e9b4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:28.452178 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-810f09c6-c152-4bdd-ba6e-3ea37ae1e9b4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:28.459552 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-810f09c6-c152-4bdd-ba6e-3ea37ae1e9b4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.136918 Oct 15 03:46:28.460131 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 653/1237] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:28 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:28.464410 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4131f9aa-2539-4f0c-898c-71443639f1cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:28.465290 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4131f9aa-2539-4f0c-898c-71443639f1cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:28.470554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4131f9aa-2539-4f0c-898c-71443639f1cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:28.470994 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4131f9aa-2539-4f0c-898c-71443639f1cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:28.471763 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4131f9aa-2539-4f0c-898c-71443639f1cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:28.472188 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4131f9aa-2539-4f0c-898c-71443639f1cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:28.499728 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4131f9aa-2539-4f0c-898c-71443639f1cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038632 Oct 15 03:46:28.500245 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 654/1238] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:28 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:28.504463 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-66b8c520-69b6-47b3-b329-372b6ac550e0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:28.505303 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-66b8c520-69b6-47b3-b329-372b6ac550e0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:28.510334 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-66b8c520-69b6-47b3-b329-372b6ac550e0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:28.510778 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-66b8c520-69b6-47b3-b329-372b6ac550e0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:28.512142 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-66b8c520-69b6-47b3-b329-372b6ac550e0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:28.512574 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-66b8c520-69b6-47b3-b329-372b6ac550e0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:28.539067 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-66b8c520-69b6-47b3-b329-372b6ac550e0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.037910 Oct 15 03:46:28.539590 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 655/1239] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:28 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:29.476169 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7815588a-7830-4b94-8582-95b6671e30ca tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:29.476754 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7815588a-7830-4b94-8582-95b6671e30ca tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:29.483101 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7815588a-7830-4b94-8582-95b6671e30ca tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:29.483554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7815588a-7830-4b94-8582-95b6671e30ca tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:29.484331 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7815588a-7830-4b94-8582-95b6671e30ca tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:29.484758 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7815588a-7830-4b94-8582-95b6671e30ca tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:29.605015 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7815588a-7830-4b94-8582-95b6671e30ca tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:29.612686 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7815588a-7830-4b94-8582-95b6671e30ca tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.140145 Oct 15 03:46:29.613232 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 656/1240] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:29 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:29.617488 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-35a47bb7-710e-485a-a7c1-20c90356241c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:29.618364 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-35a47bb7-710e-485a-a7c1-20c90356241c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:29.624097 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35a47bb7-710e-485a-a7c1-20c90356241c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:29.624539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35a47bb7-710e-485a-a7c1-20c90356241c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:29.625283 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35a47bb7-710e-485a-a7c1-20c90356241c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:29.625706 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35a47bb7-710e-485a-a7c1-20c90356241c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:29.652948 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-35a47bb7-710e-485a-a7c1-20c90356241c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038776 Oct 15 03:46:29.653477 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 657/1241] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:29 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:29.657698 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a0fd2f16-1326-4d9d-991c-339d4ed635a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:29.658541 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a0fd2f16-1326-4d9d-991c-339d4ed635a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:29.663549 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0fd2f16-1326-4d9d-991c-339d4ed635a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:29.664020 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0fd2f16-1326-4d9d-991c-339d4ed635a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:29.664753 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0fd2f16-1326-4d9d-991c-339d4ed635a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:29.665179 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0fd2f16-1326-4d9d-991c-339d4ed635a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:29.692778 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a0fd2f16-1326-4d9d-991c-339d4ed635a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038326 Oct 15 03:46:29.693297 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 658/1242] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:29 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:30.629977 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-11d1223d-43dd-4d0e-b0f3-49840ab67cb9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:30.630654 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-11d1223d-43dd-4d0e-b0f3-49840ab67cb9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:30.636418 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-11d1223d-43dd-4d0e-b0f3-49840ab67cb9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:30.636872 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-11d1223d-43dd-4d0e-b0f3-49840ab67cb9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:30.637630 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-11d1223d-43dd-4d0e-b0f3-49840ab67cb9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:30.638068 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-11d1223d-43dd-4d0e-b0f3-49840ab67cb9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:30.759586 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-11d1223d-43dd-4d0e-b0f3-49840ab67cb9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:30.766921 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-11d1223d-43dd-4d0e-b0f3-49840ab67cb9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.140660 Oct 15 03:46:30.767476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 659/1243] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:30 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:30.771988 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f3ae00c2-bde1-40ee-be3b-f40dfb966856 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:30.773000 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f3ae00c2-bde1-40ee-be3b-f40dfb966856 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:30.780317 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f3ae00c2-bde1-40ee-be3b-f40dfb966856 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:30.780862 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f3ae00c2-bde1-40ee-be3b-f40dfb966856 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:30.781633 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f3ae00c2-bde1-40ee-be3b-f40dfb966856 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:30.782050 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f3ae00c2-bde1-40ee-be3b-f40dfb966856 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:30.811543 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f3ae00c2-bde1-40ee-be3b-f40dfb966856 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043029 Oct 15 03:46:30.812146 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 660/1244] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:30 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:30.816576 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e958f4fa-f9f7-41af-a8f1-8b3409027ecc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:30.817461 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e958f4fa-f9f7-41af-a8f1-8b3409027ecc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:30.822778 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e958f4fa-f9f7-41af-a8f1-8b3409027ecc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:30.823221 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e958f4fa-f9f7-41af-a8f1-8b3409027ecc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:30.824182 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e958f4fa-f9f7-41af-a8f1-8b3409027ecc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:30.824629 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e958f4fa-f9f7-41af-a8f1-8b3409027ecc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:30.864068 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e958f4fa-f9f7-41af-a8f1-8b3409027ecc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050875 Oct 15 03:46:30.864620 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 661/1245] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:30 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:31.783933 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1942c40e-0d8d-4e44-9112-2346f50a4609 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:31.784579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1942c40e-0d8d-4e44-9112-2346f50a4609 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:31.790270 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1942c40e-0d8d-4e44-9112-2346f50a4609 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:31.790722 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1942c40e-0d8d-4e44-9112-2346f50a4609 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:31.791481 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1942c40e-0d8d-4e44-9112-2346f50a4609 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:31.791940 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1942c40e-0d8d-4e44-9112-2346f50a4609 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:31.910207 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1942c40e-0d8d-4e44-9112-2346f50a4609 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:31.917328 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1942c40e-0d8d-4e44-9112-2346f50a4609 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.137083 Oct 15 03:46:31.917870 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 662/1246] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:31 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:31.922182 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8764c1a2-b232-475f-89e7-3b9a1915b86d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:31.923062 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8764c1a2-b232-475f-89e7-3b9a1915b86d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:31.928753 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8764c1a2-b232-475f-89e7-3b9a1915b86d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:31.929188 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8764c1a2-b232-475f-89e7-3b9a1915b86d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:31.929933 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8764c1a2-b232-475f-89e7-3b9a1915b86d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:31.930358 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8764c1a2-b232-475f-89e7-3b9a1915b86d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:31.957975 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8764c1a2-b232-475f-89e7-3b9a1915b86d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039162 Oct 15 03:46:31.958501 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 663/1247] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:31 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:31.962864 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-aa493f2f-8623-4a7f-9863-f8fd2604e20d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:31.963728 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-aa493f2f-8623-4a7f-9863-f8fd2604e20d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:31.969399 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aa493f2f-8623-4a7f-9863-f8fd2604e20d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:31.969837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aa493f2f-8623-4a7f-9863-f8fd2604e20d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:31.970568 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aa493f2f-8623-4a7f-9863-f8fd2604e20d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:31.970991 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aa493f2f-8623-4a7f-9863-f8fd2604e20d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:31.997723 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-aa493f2f-8623-4a7f-9863-f8fd2604e20d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038053 Oct 15 03:46:31.998239 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 664/1248] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:31 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:32.933888 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-620446a5-609f-438b-b6c6-643e8a07d905 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:32.934580 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-620446a5-609f-438b-b6c6-643e8a07d905 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:32.940443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-620446a5-609f-438b-b6c6-643e8a07d905 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:32.940888 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-620446a5-609f-438b-b6c6-643e8a07d905 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:32.941639 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-620446a5-609f-438b-b6c6-643e8a07d905 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:32.942068 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-620446a5-609f-438b-b6c6-643e8a07d905 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:33.060990 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-620446a5-609f-438b-b6c6-643e8a07d905 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:33.068208 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-620446a5-609f-438b-b6c6-643e8a07d905 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.137933 Oct 15 03:46:33.068761 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 665/1249] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:32 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:33.072994 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f29a1c7a-af9b-45cf-bef2-836354b0ceb9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:33.073884 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f29a1c7a-af9b-45cf-bef2-836354b0ceb9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:33.079076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f29a1c7a-af9b-45cf-bef2-836354b0ceb9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:33.079524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f29a1c7a-af9b-45cf-bef2-836354b0ceb9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:33.080312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f29a1c7a-af9b-45cf-bef2-836354b0ceb9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:33.080744 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f29a1c7a-af9b-45cf-bef2-836354b0ceb9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:33.109254 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f29a1c7a-af9b-45cf-bef2-836354b0ceb9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039541 Oct 15 03:46:33.109775 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 666/1250] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:33 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:33.113956 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7eb90faa-57e7-4d2d-b028-7c400019eb56 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:33.118216 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7eb90faa-57e7-4d2d-b028-7c400019eb56 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:33.120601 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7eb90faa-57e7-4d2d-b028-7c400019eb56 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:33.121052 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7eb90faa-57e7-4d2d-b028-7c400019eb56 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:33.121816 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7eb90faa-57e7-4d2d-b028-7c400019eb56 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:33.122244 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7eb90faa-57e7-4d2d-b028-7c400019eb56 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:33.150829 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7eb90faa-57e7-4d2d-b028-7c400019eb56 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040110 Oct 15 03:46:33.151363 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 667/1251] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:33 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:34.085186 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-67ed8fa5-3396-4629-b34e-35c3d4e6fafb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:34.085807 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-67ed8fa5-3396-4629-b34e-35c3d4e6fafb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:34.092142 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-67ed8fa5-3396-4629-b34e-35c3d4e6fafb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:34.092589 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-67ed8fa5-3396-4629-b34e-35c3d4e6fafb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:34.093343 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-67ed8fa5-3396-4629-b34e-35c3d4e6fafb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:34.093773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-67ed8fa5-3396-4629-b34e-35c3d4e6fafb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:34.208255 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-67ed8fa5-3396-4629-b34e-35c3d4e6fafb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:34.216249 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-67ed8fa5-3396-4629-b34e-35c3d4e6fafb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.134983 Oct 15 03:46:34.216800 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 668/1252] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:34 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:34.221034 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cb0b1c3b-150c-4f3b-9e51-36f72411fa88 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:34.221921 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cb0b1c3b-150c-4f3b-9e51-36f72411fa88 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:34.227409 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cb0b1c3b-150c-4f3b-9e51-36f72411fa88 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:34.227899 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cb0b1c3b-150c-4f3b-9e51-36f72411fa88 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:34.228672 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cb0b1c3b-150c-4f3b-9e51-36f72411fa88 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:34.229131 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cb0b1c3b-150c-4f3b-9e51-36f72411fa88 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:34.257475 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cb0b1c3b-150c-4f3b-9e51-36f72411fa88 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039663 Oct 15 03:46:34.258023 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 669/1253] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:34 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:34.262860 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-da5b8c67-1112-423e-a6a9-f07dd34b0780 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:34.263773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-da5b8c67-1112-423e-a6a9-f07dd34b0780 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:34.269352 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-da5b8c67-1112-423e-a6a9-f07dd34b0780 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:34.269800 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-da5b8c67-1112-423e-a6a9-f07dd34b0780 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:34.270565 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-da5b8c67-1112-423e-a6a9-f07dd34b0780 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:34.271006 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-da5b8c67-1112-423e-a6a9-f07dd34b0780 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:34.299474 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-da5b8c67-1112-423e-a6a9-f07dd34b0780 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040461 Oct 15 03:46:34.300040 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 670/1254] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:34 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:35.232977 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f580f239-9a4f-4b51-a64e-e35e395e8dd0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:35.233624 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f580f239-9a4f-4b51-a64e-e35e395e8dd0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:35.239381 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f580f239-9a4f-4b51-a64e-e35e395e8dd0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:35.239866 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f580f239-9a4f-4b51-a64e-e35e395e8dd0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:35.240625 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f580f239-9a4f-4b51-a64e-e35e395e8dd0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:35.241053 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f580f239-9a4f-4b51-a64e-e35e395e8dd0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:35.359412 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f580f239-9a4f-4b51-a64e-e35e395e8dd0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:35.366526 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f580f239-9a4f-4b51-a64e-e35e395e8dd0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.137378 Oct 15 03:46:35.367070 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 671/1255] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:35 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:35.371872 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f3c0b5ec-eea9-485a-b17e-b57865fc4c4c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:35.372752 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f3c0b5ec-eea9-485a-b17e-b57865fc4c4c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:35.377999 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f3c0b5ec-eea9-485a-b17e-b57865fc4c4c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:35.378379 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f3c0b5ec-eea9-485a-b17e-b57865fc4c4c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:35.379122 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f3c0b5ec-eea9-485a-b17e-b57865fc4c4c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:35.379553 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f3c0b5ec-eea9-485a-b17e-b57865fc4c4c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:35.408638 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f3c0b5ec-eea9-485a-b17e-b57865fc4c4c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040601 Oct 15 03:46:35.409176 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 672/1256] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:35 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:35.413354 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f0acc520-8329-4c89-ade6-a8d5f589f637 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:35.414212 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f0acc520-8329-4c89-ade6-a8d5f589f637 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:35.419878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f0acc520-8329-4c89-ade6-a8d5f589f637 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:35.420323 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f0acc520-8329-4c89-ade6-a8d5f589f637 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:35.421075 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f0acc520-8329-4c89-ade6-a8d5f589f637 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:35.421502 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f0acc520-8329-4c89-ade6-a8d5f589f637 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:35.450044 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f0acc520-8329-4c89-ade6-a8d5f589f637 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039893 Oct 15 03:46:35.450586 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 673/1257] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:35 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:36.383703 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-827d726d-4ffa-4930-89de-19f693c7cf75 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:36.384346 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-827d726d-4ffa-4930-89de-19f693c7cf75 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:36.390471 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-827d726d-4ffa-4930-89de-19f693c7cf75 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:36.390916 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-827d726d-4ffa-4930-89de-19f693c7cf75 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:36.391666 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-827d726d-4ffa-4930-89de-19f693c7cf75 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:36.392120 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-827d726d-4ffa-4930-89de-19f693c7cf75 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:36.513651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-827d726d-4ffa-4930-89de-19f693c7cf75 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:36.520764 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-827d726d-4ffa-4930-89de-19f693c7cf75 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.140763 Oct 15 03:46:36.521318 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 674/1258] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:36 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:36.525606 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d8ba511f-3a72-4ca6-bab7-287eb2d77bec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:36.526498 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d8ba511f-3a72-4ca6-bab7-287eb2d77bec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:36.531870 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d8ba511f-3a72-4ca6-bab7-287eb2d77bec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:36.532322 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d8ba511f-3a72-4ca6-bab7-287eb2d77bec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:36.533076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d8ba511f-3a72-4ca6-bab7-287eb2d77bec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:36.533509 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d8ba511f-3a72-4ca6-bab7-287eb2d77bec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:36.561508 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d8ba511f-3a72-4ca6-bab7-287eb2d77bec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039135 Oct 15 03:46:36.562049 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 675/1259] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:36 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:36.566379 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2b672126-0e92-4948-9af8-308bf3cb0bcc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:36.567298 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2b672126-0e92-4948-9af8-308bf3cb0bcc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:36.572824 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2b672126-0e92-4948-9af8-308bf3cb0bcc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:36.573270 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2b672126-0e92-4948-9af8-308bf3cb0bcc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:36.574019 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2b672126-0e92-4948-9af8-308bf3cb0bcc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:36.575058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2b672126-0e92-4948-9af8-308bf3cb0bcc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:36.602308 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2b672126-0e92-4948-9af8-308bf3cb0bcc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039282 Oct 15 03:46:36.602840 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 676/1260] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:36 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:37.538094 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2626834a-64c6-4be1-acff-2e0f03b050ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:37.538711 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2626834a-64c6-4be1-acff-2e0f03b050ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:37.545300 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2626834a-64c6-4be1-acff-2e0f03b050ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:37.545758 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2626834a-64c6-4be1-acff-2e0f03b050ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:37.546848 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2626834a-64c6-4be1-acff-2e0f03b050ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:37.547414 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2626834a-64c6-4be1-acff-2e0f03b050ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:37.664023 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2626834a-64c6-4be1-acff-2e0f03b050ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:37.671080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2626834a-64c6-4be1-acff-2e0f03b050ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.136582 Oct 15 03:46:37.671650 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 677/1261] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:37 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:37.676047 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7b02daa9-430b-4f00-8877-1994a406e499 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:37.676935 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7b02daa9-430b-4f00-8877-1994a406e499 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:37.682127 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7b02daa9-430b-4f00-8877-1994a406e499 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:37.682571 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7b02daa9-430b-4f00-8877-1994a406e499 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:37.683319 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7b02daa9-430b-4f00-8877-1994a406e499 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:37.683774 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7b02daa9-430b-4f00-8877-1994a406e499 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:37.711513 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7b02daa9-430b-4f00-8877-1994a406e499 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038834 Oct 15 03:46:37.712072 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 678/1262] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:37 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:37.717006 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e4f6ca62-29fe-4cda-8d79-2cb3b1afd61e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:37.717869 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e4f6ca62-29fe-4cda-8d79-2cb3b1afd61e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:37.723178 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e4f6ca62-29fe-4cda-8d79-2cb3b1afd61e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:37.723625 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e4f6ca62-29fe-4cda-8d79-2cb3b1afd61e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:37.724408 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e4f6ca62-29fe-4cda-8d79-2cb3b1afd61e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:37.724843 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e4f6ca62-29fe-4cda-8d79-2cb3b1afd61e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:37.751794 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e4f6ca62-29fe-4cda-8d79-2cb3b1afd61e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038648 Oct 15 03:46:37.752322 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 679/1263] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:37 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:38.071840 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:46:38.072016 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 03:46:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:46:38.688322 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b344c450-8de0-4178-94f3-ffeba949936c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:38.688980 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b344c450-8de0-4178-94f3-ffeba949936c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:38.694608 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b344c450-8de0-4178-94f3-ffeba949936c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:38.695046 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b344c450-8de0-4178-94f3-ffeba949936c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:38.695822 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b344c450-8de0-4178-94f3-ffeba949936c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:38.696250 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b344c450-8de0-4178-94f3-ffeba949936c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:38.812050 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b344c450-8de0-4178-94f3-ffeba949936c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:38.819154 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b344c450-8de0-4178-94f3-ffeba949936c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.134444 Oct 15 03:46:38.819786 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 680/1264] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:38 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:38.824015 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-af650e62-9f09-45b7-a253-f769c60ad6c2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:38.824903 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-af650e62-9f09-45b7-a253-f769c60ad6c2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:38.830114 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-af650e62-9f09-45b7-a253-f769c60ad6c2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:38.830560 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-af650e62-9f09-45b7-a253-f769c60ad6c2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:38.831314 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-af650e62-9f09-45b7-a253-f769c60ad6c2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:38.831774 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-af650e62-9f09-45b7-a253-f769c60ad6c2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:38.860410 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-af650e62-9f09-45b7-a253-f769c60ad6c2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039621 Oct 15 03:46:38.860957 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 681/1265] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:38 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:38.865200 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-45a10fec-c0fd-47bb-afe9-5a8ebf8dc74b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:38.866076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-45a10fec-c0fd-47bb-afe9-5a8ebf8dc74b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:38.871355 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45a10fec-c0fd-47bb-afe9-5a8ebf8dc74b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:38.871843 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45a10fec-c0fd-47bb-afe9-5a8ebf8dc74b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:38.872596 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45a10fec-c0fd-47bb-afe9-5a8ebf8dc74b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:38.873031 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45a10fec-c0fd-47bb-afe9-5a8ebf8dc74b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:38.899893 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-45a10fec-c0fd-47bb-afe9-5a8ebf8dc74b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.037960 Oct 15 03:46:38.900425 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 682/1266] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:38 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:39.836618 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5a3e0139-32b4-42f2-a4ab-b8fcabc09d27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:39.837207 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5a3e0139-32b4-42f2-a4ab-b8fcabc09d27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:39.843013 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a3e0139-32b4-42f2-a4ab-b8fcabc09d27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:39.843454 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a3e0139-32b4-42f2-a4ab-b8fcabc09d27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:39.844268 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a3e0139-32b4-42f2-a4ab-b8fcabc09d27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:39.844698 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a3e0139-32b4-42f2-a4ab-b8fcabc09d27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:39.963426 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5a3e0139-32b4-42f2-a4ab-b8fcabc09d27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:39.970527 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5a3e0139-32b4-42f2-a4ab-b8fcabc09d27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.137891 Oct 15 03:46:39.971088 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 683/1267] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:39 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:39.975283 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b0877c22-df69-4c56-af6b-e4d7daf29686 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:39.976192 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b0877c22-df69-4c56-af6b-e4d7daf29686 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:39.981838 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b0877c22-df69-4c56-af6b-e4d7daf29686 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:39.982305 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b0877c22-df69-4c56-af6b-e4d7daf29686 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:39.983049 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b0877c22-df69-4c56-af6b-e4d7daf29686 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:39.983472 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b0877c22-df69-4c56-af6b-e4d7daf29686 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:40.011056 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b0877c22-df69-4c56-af6b-e4d7daf29686 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039026 Oct 15 03:46:40.011575 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 684/1268] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:39 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:40.015649 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-09b6387c-0469-454f-8929-bcc11e32c423 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:40.016513 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-09b6387c-0469-454f-8929-bcc11e32c423 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:40.021622 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-09b6387c-0469-454f-8929-bcc11e32c423 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:40.022059 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-09b6387c-0469-454f-8929-bcc11e32c423 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:40.022792 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-09b6387c-0469-454f-8929-bcc11e32c423 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:40.023216 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-09b6387c-0469-454f-8929-bcc11e32c423 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:40.050683 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-09b6387c-0469-454f-8929-bcc11e32c423 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038146 Oct 15 03:46:40.051217 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 685/1269] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:40 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:40.986476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fb0b6a6d-a571-4752-9f36-f7d5f450c039 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:40.987095 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fb0b6a6d-a571-4752-9f36-f7d5f450c039 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:40.992708 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fb0b6a6d-a571-4752-9f36-f7d5f450c039 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:40.993152 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fb0b6a6d-a571-4752-9f36-f7d5f450c039 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:40.993896 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fb0b6a6d-a571-4752-9f36-f7d5f450c039 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:40.994321 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fb0b6a6d-a571-4752-9f36-f7d5f450c039 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:41.109904 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fb0b6a6d-a571-4752-9f36-f7d5f450c039 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:41.116939 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fb0b6a6d-a571-4752-9f36-f7d5f450c039 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.134218 Oct 15 03:46:41.117486 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 686/1270] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:40 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:41.122257 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-edf33d2a-8797-49a6-89c4-447c2e453835 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:41.123137 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-edf33d2a-8797-49a6-89c4-447c2e453835 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:41.128329 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edf33d2a-8797-49a6-89c4-447c2e453835 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:41.128773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edf33d2a-8797-49a6-89c4-447c2e453835 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:41.129511 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edf33d2a-8797-49a6-89c4-447c2e453835 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:41.129936 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edf33d2a-8797-49a6-89c4-447c2e453835 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:41.158189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-edf33d2a-8797-49a6-89c4-447c2e453835 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039710 Oct 15 03:46:41.158737 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 687/1271] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:41 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:41.162947 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f408a97a-ab93-479a-9479-829f4a88750d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:41.163849 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f408a97a-ab93-479a-9479-829f4a88750d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:41.169076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f408a97a-ab93-479a-9479-829f4a88750d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:41.169523 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f408a97a-ab93-479a-9479-829f4a88750d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:41.170267 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f408a97a-ab93-479a-9479-829f4a88750d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:41.170698 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f408a97a-ab93-479a-9479-829f4a88750d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:41.203711 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f408a97a-ab93-479a-9479-829f4a88750d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043975 Oct 15 03:46:41.204247 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 688/1272] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:41 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:42.133971 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bf8a28f8-8b6e-4986-b0a2-0eae4ec62d9d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:42.134629 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bf8a28f8-8b6e-4986-b0a2-0eae4ec62d9d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:42.140962 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf8a28f8-8b6e-4986-b0a2-0eae4ec62d9d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:42.141399 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf8a28f8-8b6e-4986-b0a2-0eae4ec62d9d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:42.142147 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf8a28f8-8b6e-4986-b0a2-0eae4ec62d9d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:42.142572 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf8a28f8-8b6e-4986-b0a2-0eae4ec62d9d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:42.258921 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bf8a28f8-8b6e-4986-b0a2-0eae4ec62d9d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:42.266033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bf8a28f8-8b6e-4986-b0a2-0eae4ec62d9d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.135669 Oct 15 03:46:42.266572 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 689/1273] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:42 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:42.270756 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-df6beec4-bacb-43f7-aff9-5b076b3dcd04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:42.271635 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-df6beec4-bacb-43f7-aff9-5b076b3dcd04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:42.279247 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df6beec4-bacb-43f7-aff9-5b076b3dcd04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:42.279247 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df6beec4-bacb-43f7-aff9-5b076b3dcd04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:42.279247 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df6beec4-bacb-43f7-aff9-5b076b3dcd04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:42.279247 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df6beec4-bacb-43f7-aff9-5b076b3dcd04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:42.313474 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-df6beec4-bacb-43f7-aff9-5b076b3dcd04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045895 Oct 15 03:46:42.317457 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 690/1274] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:42 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:42.319110 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-07c540b7-5f4c-4296-8341-8d7241a42ba4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:42.320518 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-07c540b7-5f4c-4296-8341-8d7241a42ba4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:42.327498 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-07c540b7-5f4c-4296-8341-8d7241a42ba4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:42.327976 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-07c540b7-5f4c-4296-8341-8d7241a42ba4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:42.328737 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-07c540b7-5f4c-4296-8341-8d7241a42ba4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:42.329168 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-07c540b7-5f4c-4296-8341-8d7241a42ba4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:42.359956 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-07c540b7-5f4c-4296-8341-8d7241a42ba4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044862 Oct 15 03:46:42.363450 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 691/1275] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:42 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:42.616009 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.network.neutron [None req-435e9a82-9cac-4d5e-9ba2-a01924417b40 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] validate_networks() for [('0006c2d5-d608-4255-8781-4a519d11899d', None, None, None, None, None)] {{(pid=120899) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 15 03:46:43.012256 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-435e9a82-9cac-4d5e-9ba2-a01924417b40 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Flavor limits 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 03:46:43.012701 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-435e9a82-9cac-4d5e-9ba2-a01924417b40 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Image limits 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 03:46:43.013166 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-435e9a82-9cac-4d5e-9ba2-a01924417b40 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Flavor pref 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 03:46:43.013567 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-435e9a82-9cac-4d5e-9ba2-a01924417b40 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Image pref 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 03:46:43.013970 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-435e9a82-9cac-4d5e-9ba2-a01924417b40 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 03:46:43.022197 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-435e9a82-9cac-4d5e-9ba2-a01924417b40 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:43.022635 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-435e9a82-9cac-4d5e-9ba2-a01924417b40 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:43.023415 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-435e9a82-9cac-4d5e-9ba2-a01924417b40 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:43.023880 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-435e9a82-9cac-4d5e-9ba2-a01924417b40 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:43.040653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-435e9a82-9cac-4d5e-9ba2-a01924417b40 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Getting quotas for project de088af04e804d909ae6daa141302d4c. Resources: {'cores', 'instances', 'ram'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:46:43.044504 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-435e9a82-9cac-4d5e-9ba2-a01924417b40 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Getting quotas for user d1bb22a3461a47e5afeb229038cb4a8d and project de088af04e804d909ae6daa141302d4c. Resources: {'cores', 'instances', 'ram'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:46:43.101623 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-435e9a82-9cac-4d5e-9ba2-a01924417b40 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Going to run 1 instances... {{(pid=120899) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 15 03:46:43.103740 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-435e9a82-9cac-4d5e-9ba2-a01924417b40 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: cbac54f7-2b62-409e-9b4e-42694afb469b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='59826191-e1c1-44b2-93af-a4c16173150d',volume_size=None,volume_type=None)] {{(pid=120899) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 15 03:46:43.160451 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-435e9a82-9cac-4d5e-9ba2-a01924417b40 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Volume 59826191-e1c1-44b2-93af-a4c16173150d status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-d02d7160-ac4e-4732-9b4a-44b543281c1a) Oct 15 03:46:43.161060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-435e9a82-9cac-4d5e-9ba2-a01924417b40 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Volume 59826191-e1c1-44b2-93af-a4c16173150d status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-d02d7160-ac4e-4732-9b4a-44b543281c1a) {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:46:43.161878 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-435e9a82-9cac-4d5e-9ba2-a01924417b40 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 295 microversion: 2.1 time: 35.406729 Oct 15 03:46:43.162465 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 585/1276] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Oct 15 03:46:07 2021] POST /compute/v2.1/servers => generated 295 bytes in 35408 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 15 03:46:43.282206 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-26d47539-bac8-4011-8fbf-905ea5841fe3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:43.282740 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-26d47539-bac8-4011-8fbf-905ea5841fe3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:43.288991 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-26d47539-bac8-4011-8fbf-905ea5841fe3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:43.289440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-26d47539-bac8-4011-8fbf-905ea5841fe3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:43.290201 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-26d47539-bac8-4011-8fbf-905ea5841fe3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:43.290634 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-26d47539-bac8-4011-8fbf-905ea5841fe3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:43.335067 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c6d77fa3-2a4b-4ffd-bcf6-4dd69da9bdc6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:43.336093 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c6d77fa3-2a4b-4ffd-bcf6-4dd69da9bdc6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:43.343029 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6d77fa3-2a4b-4ffd-bcf6-4dd69da9bdc6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:43.343470 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6d77fa3-2a4b-4ffd-bcf6-4dd69da9bdc6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:43.344256 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6d77fa3-2a4b-4ffd-bcf6-4dd69da9bdc6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:43.344883 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6d77fa3-2a4b-4ffd-bcf6-4dd69da9bdc6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:43.378849 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c6d77fa3-2a4b-4ffd-bcf6-4dd69da9bdc6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048057 Oct 15 03:46:43.382598 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 586/1277] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:43 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:43.384462 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ba4b8828-dcd1-4713-9260-2963bbb9964a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:43.385442 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ba4b8828-dcd1-4713-9260-2963bbb9964a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:43.392574 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ba4b8828-dcd1-4713-9260-2963bbb9964a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:43.392863 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ba4b8828-dcd1-4713-9260-2963bbb9964a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:43.393629 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ba4b8828-dcd1-4713-9260-2963bbb9964a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:43.394393 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ba4b8828-dcd1-4713-9260-2963bbb9964a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:43.415625 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-26d47539-bac8-4011-8fbf-905ea5841fe3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:43.422438 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ba4b8828-dcd1-4713-9260-2963bbb9964a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041554 Oct 15 03:46:43.422995 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 587/1278] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:43 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:43.424484 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-26d47539-bac8-4011-8fbf-905ea5841fe3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.145958 Oct 15 03:46:43.425036 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 692/1279] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:43 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:43.658322 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-473339d0-8278-48a1-aab6-29f0c55aa971 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:43.658851 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-473339d0-8278-48a1-aab6-29f0c55aa971 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:43.664555 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-473339d0-8278-48a1-aab6-29f0c55aa971 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:43.665005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-473339d0-8278-48a1-aab6-29f0c55aa971 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:43.665767 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-473339d0-8278-48a1-aab6-29f0c55aa971 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:43.666202 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-473339d0-8278-48a1-aab6-29f0c55aa971 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:43.679474 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-473339d0-8278-48a1-aab6-29f0c55aa971 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] HTTP exception thrown: Instance 6e429526-26c8-4d98-8691-73770db59513 could not be found. Oct 15 03:46:43.680080 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-473339d0-8278-48a1-aab6-29f0c55aa971 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Returning 404 to user: Instance 6e429526-26c8-4d98-8691-73770db59513 could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:46:43.680874 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-473339d0-8278-48a1-aab6-29f0c55aa971 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 404 len: 111 microversion: 2.1 time: 0.027864 Oct 15 03:46:43.681383 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 588/1280] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 03:46:43 2021] DELETE /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 03:46:43.689706 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e499aa45-bd44-4bf5-9e1e-2f9f5b966159 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:43.690392 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e499aa45-bd44-4bf5-9e1e-2f9f5b966159 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] [instance: 6e429526-26c8-4d98-8691-73770db59513] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:43.696320 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e499aa45-bd44-4bf5-9e1e-2f9f5b966159 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:43.696910 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e499aa45-bd44-4bf5-9e1e-2f9f5b966159 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:43.697812 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e499aa45-bd44-4bf5-9e1e-2f9f5b966159 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:43.698245 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e499aa45-bd44-4bf5-9e1e-2f9f5b966159 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:43.711287 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.wsgi [None req-e499aa45-bd44-4bf5-9e1e-2f9f5b966159 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] HTTP exception thrown: Instance 6e429526-26c8-4d98-8691-73770db59513 could not be found. Oct 15 03:46:43.711888 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e499aa45-bd44-4bf5-9e1e-2f9f5b966159 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Returning 404 to user: Instance 6e429526-26c8-4d98-8691-73770db59513 could not be found. {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:46:43.712680 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e499aa45-bd44-4bf5-9e1e-2f9f5b966159 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513" status: 404 len: 111 microversion: 2.1 time: 0.026656 Oct 15 03:46:43.713184 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 693/1281] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:43 2021] GET /compute/v2.1/servers/6e429526-26c8-4d98-8691-73770db59513 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 03:46:44.390756 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5f663ec3-13bb-4cfa-8499-dd9dc3eebc05 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:44.392017 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5f663ec3-13bb-4cfa-8499-dd9dc3eebc05 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:44.398127 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5f663ec3-13bb-4cfa-8499-dd9dc3eebc05 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:44.398579 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5f663ec3-13bb-4cfa-8499-dd9dc3eebc05 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:44.399327 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5f663ec3-13bb-4cfa-8499-dd9dc3eebc05 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:44.399782 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5f663ec3-13bb-4cfa-8499-dd9dc3eebc05 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:44.429419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5f663ec3-13bb-4cfa-8499-dd9dc3eebc05 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042962 Oct 15 03:46:44.429958 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 589/1282] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:44 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:44.433497 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e351da1a-6199-435e-b7ab-78b2fd079627 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:44.434400 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e351da1a-6199-435e-b7ab-78b2fd079627 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:44.440080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e351da1a-6199-435e-b7ab-78b2fd079627 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:44.440519 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e351da1a-6199-435e-b7ab-78b2fd079627 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:44.441298 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e351da1a-6199-435e-b7ab-78b2fd079627 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:44.441414 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ffe65952-4767-4c4f-8791-a48cc9546c2f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:44.441724 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e351da1a-6199-435e-b7ab-78b2fd079627 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:44.441892 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ffe65952-4767-4c4f-8791-a48cc9546c2f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:44.447425 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ffe65952-4767-4c4f-8791-a48cc9546c2f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:44.447901 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ffe65952-4767-4c4f-8791-a48cc9546c2f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:44.448651 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ffe65952-4767-4c4f-8791-a48cc9546c2f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:44.449608 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ffe65952-4767-4c4f-8791-a48cc9546c2f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:44.470986 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e351da1a-6199-435e-b7ab-78b2fd079627 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041230 Oct 15 03:46:44.471448 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 694/1283] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:44 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:46:44.565152 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ffe65952-4767-4c4f-8791-a48cc9546c2f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:44.572437 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ffe65952-4767-4c4f-8791-a48cc9546c2f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134404 Oct 15 03:46:44.573002 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 590/1284] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:44 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:45.440669 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b121181e-0e8e-40d6-ad10-bf7cfb90c3ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:45.441614 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b121181e-0e8e-40d6-ad10-bf7cfb90c3ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:45.447415 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b121181e-0e8e-40d6-ad10-bf7cfb90c3ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:45.447908 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b121181e-0e8e-40d6-ad10-bf7cfb90c3ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:45.448671 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b121181e-0e8e-40d6-ad10-bf7cfb90c3ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:45.449139 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b121181e-0e8e-40d6-ad10-bf7cfb90c3ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:45.481368 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b121181e-0e8e-40d6-ad10-bf7cfb90c3ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044254 Oct 15 03:46:45.482355 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 695/1285] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:45 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:45.483991 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-bef6d7df-c9c4-4a68-b0fa-7291668bc611 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:45.485583 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-bef6d7df-c9c4-4a68-b0fa-7291668bc611 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:45.491912 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bef6d7df-c9c4-4a68-b0fa-7291668bc611 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:45.492357 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bef6d7df-c9c4-4a68-b0fa-7291668bc611 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:45.493120 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bef6d7df-c9c4-4a68-b0fa-7291668bc611 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:45.493603 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bef6d7df-c9c4-4a68-b0fa-7291668bc611 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:45.523244 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-bef6d7df-c9c4-4a68-b0fa-7291668bc611 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044518 Oct 15 03:46:45.523801 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 591/1286] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:45 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:46:45.588931 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-08dcaa52-e041-47b9-becb-ddd3964a193a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:45.589543 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-08dcaa52-e041-47b9-becb-ddd3964a193a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:45.595939 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-08dcaa52-e041-47b9-becb-ddd3964a193a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:45.596389 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-08dcaa52-e041-47b9-becb-ddd3964a193a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:45.597149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-08dcaa52-e041-47b9-becb-ddd3964a193a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:45.597585 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-08dcaa52-e041-47b9-becb-ddd3964a193a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:45.631162 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:46:45.631351 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 03:46:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 (ip 10.222.0.30) !!! Oct 15 03:46:45.715652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-08dcaa52-e041-47b9-becb-ddd3964a193a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:45.722810 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-08dcaa52-e041-47b9-becb-ddd3964a193a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.137523 Oct 15 03:46:45.723358 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 696/1287] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:45 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:46.493441 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5c2365bd-0a93-40de-8026-bb77ec74316a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:46.494342 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5c2365bd-0a93-40de-8026-bb77ec74316a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:46.500572 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c2365bd-0a93-40de-8026-bb77ec74316a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:46.501011 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c2365bd-0a93-40de-8026-bb77ec74316a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:46.501758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c2365bd-0a93-40de-8026-bb77ec74316a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:46.502182 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c2365bd-0a93-40de-8026-bb77ec74316a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:46.533342 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5c2365bd-0a93-40de-8026-bb77ec74316a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043517 Oct 15 03:46:46.534083 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 592/1288] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:46 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:46.535062 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5247e6eb-3515-4a13-9cbb-342728c5d0dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:46.536330 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5247e6eb-3515-4a13-9cbb-342728c5d0dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:46.542210 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5247e6eb-3515-4a13-9cbb-342728c5d0dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:46.542745 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5247e6eb-3515-4a13-9cbb-342728c5d0dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:46.543577 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5247e6eb-3515-4a13-9cbb-342728c5d0dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:46.544134 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5247e6eb-3515-4a13-9cbb-342728c5d0dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:46.573516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5247e6eb-3515-4a13-9cbb-342728c5d0dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042691 Oct 15 03:46:46.575730 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 697/1289] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:46 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:46:46.739426 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e46fd6b5-16a1-44a0-a065-196d446440cd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:46.740095 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e46fd6b5-16a1-44a0-a065-196d446440cd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:46.746466 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e46fd6b5-16a1-44a0-a065-196d446440cd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:46.746809 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e46fd6b5-16a1-44a0-a065-196d446440cd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:46.747560 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e46fd6b5-16a1-44a0-a065-196d446440cd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:46.748042 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e46fd6b5-16a1-44a0-a065-196d446440cd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:46.866783 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e46fd6b5-16a1-44a0-a065-196d446440cd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:46.874530 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e46fd6b5-16a1-44a0-a065-196d446440cd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138762 Oct 15 03:46:46.875090 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 593/1290] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:46 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:47.545171 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5f060471-913c-4577-b13c-f4e9e34a25a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:47.545997 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5f060471-913c-4577-b13c-f4e9e34a25a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:47.551754 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5f060471-913c-4577-b13c-f4e9e34a25a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:47.552195 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5f060471-913c-4577-b13c-f4e9e34a25a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:47.552943 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5f060471-913c-4577-b13c-f4e9e34a25a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:47.553368 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5f060471-913c-4577-b13c-f4e9e34a25a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:47.582784 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5f060471-913c-4577-b13c-f4e9e34a25a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041383 Oct 15 03:46:47.583328 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 698/1291] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:47 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:47.585835 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-97020271-1ca5-4f86-9946-9e7077bec2ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:47.586803 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-97020271-1ca5-4f86-9946-9e7077bec2ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:47.593171 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-97020271-1ca5-4f86-9946-9e7077bec2ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:47.593613 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-97020271-1ca5-4f86-9946-9e7077bec2ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:47.594361 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-97020271-1ca5-4f86-9946-9e7077bec2ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:47.594788 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-97020271-1ca5-4f86-9946-9e7077bec2ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:47.622411 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-97020271-1ca5-4f86-9946-9e7077bec2ed tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040583 Oct 15 03:46:47.622952 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 594/1292] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:47 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:46:47.891190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a0e9fb99-1124-48c1-819b-cc2040dc778a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:47.891784 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a0e9fb99-1124-48c1-819b-cc2040dc778a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:47.897513 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0e9fb99-1124-48c1-819b-cc2040dc778a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:47.897966 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0e9fb99-1124-48c1-819b-cc2040dc778a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:47.898715 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0e9fb99-1124-48c1-819b-cc2040dc778a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:47.899147 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0e9fb99-1124-48c1-819b-cc2040dc778a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:48.015701 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a0e9fb99-1124-48c1-819b-cc2040dc778a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:48.022851 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a0e9fb99-1124-48c1-819b-cc2040dc778a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135974 Oct 15 03:46:48.023394 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 699/1293] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:47 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:48.594787 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-408a352a-6053-4045-8ca8-111d929fdf3f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:48.595719 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-408a352a-6053-4045-8ca8-111d929fdf3f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:48.601640 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-408a352a-6053-4045-8ca8-111d929fdf3f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:48.602091 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-408a352a-6053-4045-8ca8-111d929fdf3f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:48.602851 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-408a352a-6053-4045-8ca8-111d929fdf3f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:48.603283 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-408a352a-6053-4045-8ca8-111d929fdf3f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:48.631530 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-408a352a-6053-4045-8ca8-111d929fdf3f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040550 Oct 15 03:46:48.632136 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 595/1294] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:48 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:48.633990 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b7809218-bff2-4b95-806c-944b83c6eb2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:48.634887 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b7809218-bff2-4b95-806c-944b83c6eb2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:48.640629 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b7809218-bff2-4b95-806c-944b83c6eb2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:48.641070 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b7809218-bff2-4b95-806c-944b83c6eb2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:48.641817 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b7809218-bff2-4b95-806c-944b83c6eb2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:48.642273 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b7809218-bff2-4b95-806c-944b83c6eb2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:48.671029 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b7809218-bff2-4b95-806c-944b83c6eb2a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040876 Oct 15 03:46:48.671558 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 700/1295] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:48 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:46:49.039630 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3af1349f-746a-4da3-9368-ae4ac3482b92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:49.040332 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3af1349f-746a-4da3-9368-ae4ac3482b92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:49.046055 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3af1349f-746a-4da3-9368-ae4ac3482b92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:49.046504 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3af1349f-746a-4da3-9368-ae4ac3482b92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:49.047272 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3af1349f-746a-4da3-9368-ae4ac3482b92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:49.047723 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3af1349f-746a-4da3-9368-ae4ac3482b92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:49.163148 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3af1349f-746a-4da3-9368-ae4ac3482b92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:49.170308 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3af1349f-746a-4da3-9368-ae4ac3482b92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134353 Oct 15 03:46:49.170864 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 596/1296] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:49 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:49.643028 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e140bef1-0ea9-409e-a98d-39fd93eb1565 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:49.643977 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e140bef1-0ea9-409e-a98d-39fd93eb1565 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:49.650069 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e140bef1-0ea9-409e-a98d-39fd93eb1565 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:49.650523 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e140bef1-0ea9-409e-a98d-39fd93eb1565 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:49.651280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e140bef1-0ea9-409e-a98d-39fd93eb1565 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:49.651738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e140bef1-0ea9-409e-a98d-39fd93eb1565 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:49.680192 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e140bef1-0ea9-409e-a98d-39fd93eb1565 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040828 Oct 15 03:46:49.680728 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 701/1297] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:49 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:49.682260 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a10414ec-8cf4-482d-ac5b-c7e9ee392e00 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:49.683158 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a10414ec-8cf4-482d-ac5b-c7e9ee392e00 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:49.688856 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a10414ec-8cf4-482d-ac5b-c7e9ee392e00 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:49.689302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a10414ec-8cf4-482d-ac5b-c7e9ee392e00 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:49.690052 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a10414ec-8cf4-482d-ac5b-c7e9ee392e00 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:49.690510 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a10414ec-8cf4-482d-ac5b-c7e9ee392e00 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:49.719305 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a10414ec-8cf4-482d-ac5b-c7e9ee392e00 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040835 Oct 15 03:46:49.719868 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 597/1298] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:49 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:46:50.187089 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a4fc7d29-84e2-4db0-8ef3-dda1b1089f6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:50.187709 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a4fc7d29-84e2-4db0-8ef3-dda1b1089f6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:50.193370 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4fc7d29-84e2-4db0-8ef3-dda1b1089f6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:50.193814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4fc7d29-84e2-4db0-8ef3-dda1b1089f6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:50.194564 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4fc7d29-84e2-4db0-8ef3-dda1b1089f6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:50.194997 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4fc7d29-84e2-4db0-8ef3-dda1b1089f6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:50.313702 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a4fc7d29-84e2-4db0-8ef3-dda1b1089f6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:50.320819 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a4fc7d29-84e2-4db0-8ef3-dda1b1089f6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.137930 Oct 15 03:46:50.321369 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 702/1299] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:50 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:50.691348 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-44fdae83-5714-47d8-99f6-b55c398842c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:50.692207 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-44fdae83-5714-47d8-99f6-b55c398842c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:50.698005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-44fdae83-5714-47d8-99f6-b55c398842c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:50.698446 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-44fdae83-5714-47d8-99f6-b55c398842c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:50.699273 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-44fdae83-5714-47d8-99f6-b55c398842c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:50.699727 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-44fdae83-5714-47d8-99f6-b55c398842c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:50.728687 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-44fdae83-5714-47d8-99f6-b55c398842c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041209 Oct 15 03:46:50.729235 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 598/1300] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:50 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:50.731156 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-07aebe09-482f-4b01-a002-f6d5f03c6659 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:50.732118 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-07aebe09-482f-4b01-a002-f6d5f03c6659 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:50.737755 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-07aebe09-482f-4b01-a002-f6d5f03c6659 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:50.738203 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-07aebe09-482f-4b01-a002-f6d5f03c6659 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:50.738958 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-07aebe09-482f-4b01-a002-f6d5f03c6659 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:50.739386 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-07aebe09-482f-4b01-a002-f6d5f03c6659 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:50.774426 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-07aebe09-482f-4b01-a002-f6d5f03c6659 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047646 Oct 15 03:46:50.774970 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 703/1301] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:50 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:46:50.778595 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:46:50.778736 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 03:46:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:46:51.009165 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:46:51.009366 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 03:46:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:46:51.338485 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ee3cd84c-c1bc-4d57-bf52-9a1f45d7678b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:51.339034 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ee3cd84c-c1bc-4d57-bf52-9a1f45d7678b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:51.345393 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee3cd84c-c1bc-4d57-bf52-9a1f45d7678b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:51.345840 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee3cd84c-c1bc-4d57-bf52-9a1f45d7678b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:51.346595 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee3cd84c-c1bc-4d57-bf52-9a1f45d7678b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:51.347024 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee3cd84c-c1bc-4d57-bf52-9a1f45d7678b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:51.464387 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ee3cd84c-c1bc-4d57-bf52-9a1f45d7678b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:51.472127 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ee3cd84c-c1bc-4d57-bf52-9a1f45d7678b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.137368 Oct 15 03:46:51.472686 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 599/1302] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:51 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:51.740350 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-64025b94-d42c-4b0a-9799-aaecaac341b9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:51.741213 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-64025b94-d42c-4b0a-9799-aaecaac341b9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:51.747578 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64025b94-d42c-4b0a-9799-aaecaac341b9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:51.748047 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64025b94-d42c-4b0a-9799-aaecaac341b9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:51.748795 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64025b94-d42c-4b0a-9799-aaecaac341b9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:51.749221 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64025b94-d42c-4b0a-9799-aaecaac341b9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:51.780108 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-64025b94-d42c-4b0a-9799-aaecaac341b9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043429 Oct 15 03:46:51.780653 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 704/1303] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:51 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:51.787334 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9eccb7de-f2a8-4c95-a59d-c6d1cf3247e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:51.788258 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9eccb7de-f2a8-4c95-a59d-c6d1cf3247e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:51.793932 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9eccb7de-f2a8-4c95-a59d-c6d1cf3247e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:51.794372 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9eccb7de-f2a8-4c95-a59d-c6d1cf3247e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:51.795115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9eccb7de-f2a8-4c95-a59d-c6d1cf3247e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:51.795539 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9eccb7de-f2a8-4c95-a59d-c6d1cf3247e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:51.823045 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9eccb7de-f2a8-4c95-a59d-c6d1cf3247e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039497 Oct 15 03:46:51.823575 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 600/1304] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:51 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:52.488829 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-080c0313-4468-42a6-bca3-5a4e0484de44 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:52.489353 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-080c0313-4468-42a6-bca3-5a4e0484de44 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:52.495131 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-080c0313-4468-42a6-bca3-5a4e0484de44 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:52.495573 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-080c0313-4468-42a6-bca3-5a4e0484de44 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:52.496356 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-080c0313-4468-42a6-bca3-5a4e0484de44 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:52.496787 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-080c0313-4468-42a6-bca3-5a4e0484de44 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:52.611409 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-080c0313-4468-42a6-bca3-5a4e0484de44 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:52.618568 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-080c0313-4468-42a6-bca3-5a4e0484de44 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.133439 Oct 15 03:46:52.619116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 705/1305] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:52 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:52.791080 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-75ae57db-f4f3-4058-8b11-7a895827a403 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:52.792012 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-75ae57db-f4f3-4058-8b11-7a895827a403 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:52.797660 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-75ae57db-f4f3-4058-8b11-7a895827a403 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:52.798105 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-75ae57db-f4f3-4058-8b11-7a895827a403 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:52.798858 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-75ae57db-f4f3-4058-8b11-7a895827a403 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:52.799290 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-75ae57db-f4f3-4058-8b11-7a895827a403 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:52.827028 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-75ae57db-f4f3-4058-8b11-7a895827a403 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039665 Oct 15 03:46:52.827555 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 601/1306] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:52 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:52.834524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-752322c5-dd27-4a07-a826-ba9cb9d8416f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:52.835446 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-752322c5-dd27-4a07-a826-ba9cb9d8416f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:52.841757 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-752322c5-dd27-4a07-a826-ba9cb9d8416f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:52.842198 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-752322c5-dd27-4a07-a826-ba9cb9d8416f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:52.842942 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-752322c5-dd27-4a07-a826-ba9cb9d8416f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:52.843366 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-752322c5-dd27-4a07-a826-ba9cb9d8416f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:52.870537 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-752322c5-dd27-4a07-a826-ba9cb9d8416f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040026 Oct 15 03:46:52.871058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 706/1307] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:52 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:53.635263 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-00f35990-cb61-4832-9f2e-bf09a581fb34 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:53.635986 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-00f35990-cb61-4832-9f2e-bf09a581fb34 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:53.642216 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-00f35990-cb61-4832-9f2e-bf09a581fb34 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:53.642659 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-00f35990-cb61-4832-9f2e-bf09a581fb34 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:53.643413 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-00f35990-cb61-4832-9f2e-bf09a581fb34 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:53.643869 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-00f35990-cb61-4832-9f2e-bf09a581fb34 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:53.768660 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-00f35990-cb61-4832-9f2e-bf09a581fb34 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:53.775735 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-00f35990-cb61-4832-9f2e-bf09a581fb34 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.144085 Oct 15 03:46:53.776287 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 602/1308] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:53 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:53.838278 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-50683e69-eccc-4f42-8b2b-110d8ddbb112 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:53.839190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-50683e69-eccc-4f42-8b2b-110d8ddbb112 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:53.844863 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50683e69-eccc-4f42-8b2b-110d8ddbb112 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:53.845332 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50683e69-eccc-4f42-8b2b-110d8ddbb112 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:53.846085 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50683e69-eccc-4f42-8b2b-110d8ddbb112 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:53.846516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50683e69-eccc-4f42-8b2b-110d8ddbb112 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:53.875270 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-50683e69-eccc-4f42-8b2b-110d8ddbb112 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040717 Oct 15 03:46:53.875827 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 707/1309] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:53 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:53.881642 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0ff68bb0-ba66-432a-b8b7-0b7b30a15b4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:53.882539 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0ff68bb0-ba66-432a-b8b7-0b7b30a15b4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:53.888793 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0ff68bb0-ba66-432a-b8b7-0b7b30a15b4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:53.889182 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0ff68bb0-ba66-432a-b8b7-0b7b30a15b4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:53.889929 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0ff68bb0-ba66-432a-b8b7-0b7b30a15b4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:53.890354 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0ff68bb0-ba66-432a-b8b7-0b7b30a15b4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:53.917666 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0ff68bb0-ba66-432a-b8b7-0b7b30a15b4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039747 Oct 15 03:46:53.918182 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 603/1310] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:53 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:54.793337 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-357e544a-6b05-4ba9-8313-4669930dd31b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:54.793938 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-357e544a-6b05-4ba9-8313-4669930dd31b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:54.799529 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-357e544a-6b05-4ba9-8313-4669930dd31b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:54.800012 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-357e544a-6b05-4ba9-8313-4669930dd31b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:54.800770 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-357e544a-6b05-4ba9-8313-4669930dd31b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:54.801200 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-357e544a-6b05-4ba9-8313-4669930dd31b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:54.886819 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ad7f62b7-4e7b-438e-a678-ac8d9a431648 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:54.887800 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ad7f62b7-4e7b-438e-a678-ac8d9a431648 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:54.893818 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ad7f62b7-4e7b-438e-a678-ac8d9a431648 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:54.894257 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ad7f62b7-4e7b-438e-a678-ac8d9a431648 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:54.895017 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ad7f62b7-4e7b-438e-a678-ac8d9a431648 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:54.895442 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ad7f62b7-4e7b-438e-a678-ac8d9a431648 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:54.918241 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-357e544a-6b05-4ba9-8313-4669930dd31b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:54.924631 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ad7f62b7-4e7b-438e-a678-ac8d9a431648 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041811 Oct 15 03:46:54.928484 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 604/1311] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:54 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:46:54.928628 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-357e544a-6b05-4ba9-8313-4669930dd31b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.136550 Oct 15 03:46:54.928628 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 708/1312] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:54 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:54.929502 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-83da3319-3000-454c-bd6c-b61d96bce28a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:54.930375 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-83da3319-3000-454c-bd6c-b61d96bce28a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:54.936032 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-83da3319-3000-454c-bd6c-b61d96bce28a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:54.936485 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-83da3319-3000-454c-bd6c-b61d96bce28a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:54.937249 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-83da3319-3000-454c-bd6c-b61d96bce28a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:54.937682 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-83da3319-3000-454c-bd6c-b61d96bce28a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:54.966596 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-83da3319-3000-454c-bd6c-b61d96bce28a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040468 Oct 15 03:46:54.967126 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 605/1313] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:54 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:55.936685 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-821d6750-c961-4e50-b47d-68569048cd19 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:55.937591 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-821d6750-c961-4e50-b47d-68569048cd19 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:55.941584 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c5e0b963-f2af-473f-8b16-c04f987423e0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:55.942196 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c5e0b963-f2af-473f-8b16-c04f987423e0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:55.943273 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-821d6750-c961-4e50-b47d-68569048cd19 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:55.943754 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-821d6750-c961-4e50-b47d-68569048cd19 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:55.944515 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-821d6750-c961-4e50-b47d-68569048cd19 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:55.944942 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-821d6750-c961-4e50-b47d-68569048cd19 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:55.947843 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c5e0b963-f2af-473f-8b16-c04f987423e0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:55.948307 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c5e0b963-f2af-473f-8b16-c04f987423e0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:55.949121 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c5e0b963-f2af-473f-8b16-c04f987423e0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:55.949554 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c5e0b963-f2af-473f-8b16-c04f987423e0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:55.973120 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-821d6750-c961-4e50-b47d-68569048cd19 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041147 Oct 15 03:46:55.973789 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 709/1314] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:55 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:55.980775 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-49c6c136-c5b2-4186-81a4-e81b6def9240 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:55.981709 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-49c6c136-c5b2-4186-81a4-e81b6def9240 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:55.987331 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-49c6c136-c5b2-4186-81a4-e81b6def9240 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:55.987813 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-49c6c136-c5b2-4186-81a4-e81b6def9240 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:55.988567 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-49c6c136-c5b2-4186-81a4-e81b6def9240 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:55.988990 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-49c6c136-c5b2-4186-81a4-e81b6def9240 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:56.018825 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-49c6c136-c5b2-4186-81a4-e81b6def9240 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044024 Oct 15 03:46:56.019366 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 710/1315] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:55 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:56.066002 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c5e0b963-f2af-473f-8b16-c04f987423e0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:56.073098 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c5e0b963-f2af-473f-8b16-c04f987423e0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135099 Oct 15 03:46:56.073651 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 606/1316] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:55 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:46:56.984848 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3b2f611c-13dd-407a-b0cc-f8a0e417aaa2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:56.985785 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3b2f611c-13dd-407a-b0cc-f8a0e417aaa2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:56.991499 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b2f611c-13dd-407a-b0cc-f8a0e417aaa2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:56.991975 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b2f611c-13dd-407a-b0cc-f8a0e417aaa2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:56.992728 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b2f611c-13dd-407a-b0cc-f8a0e417aaa2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:56.993160 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b2f611c-13dd-407a-b0cc-f8a0e417aaa2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:57.020933 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3b2f611c-13dd-407a-b0cc-f8a0e417aaa2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039771 Oct 15 03:46:57.021470 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 711/1317] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:56 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:57.030584 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-84e0fad4-3c2e-45e1-89b7-1f7b520e9964 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:57.031496 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-84e0fad4-3c2e-45e1-89b7-1f7b520e9964 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:57.037164 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-84e0fad4-3c2e-45e1-89b7-1f7b520e9964 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:57.037647 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-84e0fad4-3c2e-45e1-89b7-1f7b520e9964 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:57.038413 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-84e0fad4-3c2e-45e1-89b7-1f7b520e9964 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:57.038855 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-84e0fad4-3c2e-45e1-89b7-1f7b520e9964 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:57.067056 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-84e0fad4-3c2e-45e1-89b7-1f7b520e9964 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040732 Oct 15 03:46:57.067592 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 607/1318] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:57 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:57.090524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a6ca43d1-21c2-4443-a8cd-7f093155af5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:57.091128 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a6ca43d1-21c2-4443-a8cd-7f093155af5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:57.096743 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a6ca43d1-21c2-4443-a8cd-7f093155af5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:57.097188 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a6ca43d1-21c2-4443-a8cd-7f093155af5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:57.097941 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a6ca43d1-21c2-4443-a8cd-7f093155af5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:57.098371 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a6ca43d1-21c2-4443-a8cd-7f093155af5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:57.220736 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a6ca43d1-21c2-4443-a8cd-7f093155af5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:57.227960 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a6ca43d1-21c2-4443-a8cd-7f093155af5a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.141533 Oct 15 03:46:57.228527 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 712/1319] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:57 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:58.032566 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-933d5e77-3bc9-4c8a-a2f1-b4f376d90d71 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:58.033466 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-933d5e77-3bc9-4c8a-a2f1-b4f376d90d71 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:58.039227 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-933d5e77-3bc9-4c8a-a2f1-b4f376d90d71 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:58.039669 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-933d5e77-3bc9-4c8a-a2f1-b4f376d90d71 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:58.040445 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-933d5e77-3bc9-4c8a-a2f1-b4f376d90d71 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:58.040875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-933d5e77-3bc9-4c8a-a2f1-b4f376d90d71 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:58.069155 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-933d5e77-3bc9-4c8a-a2f1-b4f376d90d71 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040680 Oct 15 03:46:58.069687 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 608/1320] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:58 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:58.078155 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b6e60105-f87b-4e39-96fb-b6d3109bf26f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:58.079095 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b6e60105-f87b-4e39-96fb-b6d3109bf26f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:58.085093 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b6e60105-f87b-4e39-96fb-b6d3109bf26f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:58.085539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b6e60105-f87b-4e39-96fb-b6d3109bf26f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:58.086297 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b6e60105-f87b-4e39-96fb-b6d3109bf26f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:58.086728 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b6e60105-f87b-4e39-96fb-b6d3109bf26f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:58.114856 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b6e60105-f87b-4e39-96fb-b6d3109bf26f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040490 Oct 15 03:46:58.115375 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 713/1321] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:58 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:58.244358 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5ed6cb58-e3a9-42e0-b679-9520e06dc6a7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:58.244990 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5ed6cb58-e3a9-42e0-b679-9520e06dc6a7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:58.251390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ed6cb58-e3a9-42e0-b679-9520e06dc6a7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:58.251867 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ed6cb58-e3a9-42e0-b679-9520e06dc6a7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:58.252619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ed6cb58-e3a9-42e0-b679-9520e06dc6a7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:58.253044 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ed6cb58-e3a9-42e0-b679-9520e06dc6a7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:58.367816 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5ed6cb58-e3a9-42e0-b679-9520e06dc6a7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:58.375189 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5ed6cb58-e3a9-42e0-b679-9520e06dc6a7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134385 Oct 15 03:46:58.375775 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 609/1322] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:58 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:46:59.080837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e33c75ea-0fd6-4ab8-9f58-4a0cd0ff7c89 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:59.081749 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e33c75ea-0fd6-4ab8-9f58-4a0cd0ff7c89 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:59.087775 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e33c75ea-0fd6-4ab8-9f58-4a0cd0ff7c89 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:59.088225 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e33c75ea-0fd6-4ab8-9f58-4a0cd0ff7c89 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:59.088978 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e33c75ea-0fd6-4ab8-9f58-4a0cd0ff7c89 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:59.089411 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e33c75ea-0fd6-4ab8-9f58-4a0cd0ff7c89 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:59.116828 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e33c75ea-0fd6-4ab8-9f58-4a0cd0ff7c89 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039732 Oct 15 03:46:59.117349 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 714/1323] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:46:59 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:46:59.126534 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-61f77ff7-4bdb-4d67-befd-3ce5100c1a7e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:59.127496 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-61f77ff7-4bdb-4d67-befd-3ce5100c1a7e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:59.133131 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-61f77ff7-4bdb-4d67-befd-3ce5100c1a7e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:59.133575 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-61f77ff7-4bdb-4d67-befd-3ce5100c1a7e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:59.134327 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-61f77ff7-4bdb-4d67-befd-3ce5100c1a7e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:59.134758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-61f77ff7-4bdb-4d67-befd-3ce5100c1a7e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:59.163209 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-61f77ff7-4bdb-4d67-befd-3ce5100c1a7e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040385 Oct 15 03:46:59.163772 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 610/1324] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:46:59 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:46:59.391888 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-16e0dd93-ec5d-4316-bc71-b6b641fef6da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:46:59.392416 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-16e0dd93-ec5d-4316-bc71-b6b641fef6da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:46:59.398133 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16e0dd93-ec5d-4316-bc71-b6b641fef6da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:59.398579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16e0dd93-ec5d-4316-bc71-b6b641fef6da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:59.399333 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16e0dd93-ec5d-4316-bc71-b6b641fef6da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:46:59.399797 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16e0dd93-ec5d-4316-bc71-b6b641fef6da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:46:59.516110 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-16e0dd93-ec5d-4316-bc71-b6b641fef6da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:46:59.523282 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-16e0dd93-ec5d-4316-bc71-b6b641fef6da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135078 Oct 15 03:46:59.523878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 715/1325] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:46:59 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:00.127153 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-cc2cc754-de20-4b94-9eeb-dc7873cef2eb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:00.128084 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-cc2cc754-de20-4b94-9eeb-dc7873cef2eb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:00.133831 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc2cc754-de20-4b94-9eeb-dc7873cef2eb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:00.134271 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc2cc754-de20-4b94-9eeb-dc7873cef2eb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:00.135023 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc2cc754-de20-4b94-9eeb-dc7873cef2eb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:00.135454 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc2cc754-de20-4b94-9eeb-dc7873cef2eb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:00.164170 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-cc2cc754-de20-4b94-9eeb-dc7873cef2eb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040694 Oct 15 03:47:00.164707 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 611/1326] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:00 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:00.174151 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-36a03a85-f888-4dff-9c13-a17f0b79d7d5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:00.175054 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-36a03a85-f888-4dff-9c13-a17f0b79d7d5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:00.180778 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-36a03a85-f888-4dff-9c13-a17f0b79d7d5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:00.181222 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-36a03a85-f888-4dff-9c13-a17f0b79d7d5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:00.182042 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-36a03a85-f888-4dff-9c13-a17f0b79d7d5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:00.182476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-36a03a85-f888-4dff-9c13-a17f0b79d7d5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:00.210605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-36a03a85-f888-4dff-9c13-a17f0b79d7d5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040234 Oct 15 03:47:00.211151 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 716/1327] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:00 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:00.540061 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-46db0d3b-fc6c-4fe4-8fc1-a644f7ae1bc5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:00.540659 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-46db0d3b-fc6c-4fe4-8fc1-a644f7ae1bc5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:00.546975 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-46db0d3b-fc6c-4fe4-8fc1-a644f7ae1bc5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:00.547416 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-46db0d3b-fc6c-4fe4-8fc1-a644f7ae1bc5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:00.548197 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-46db0d3b-fc6c-4fe4-8fc1-a644f7ae1bc5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:00.548620 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-46db0d3b-fc6c-4fe4-8fc1-a644f7ae1bc5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:00.668017 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-46db0d3b-fc6c-4fe4-8fc1-a644f7ae1bc5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:00.675972 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-46db0d3b-fc6c-4fe4-8fc1-a644f7ae1bc5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.139524 Oct 15 03:47:00.676541 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 612/1328] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:00 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:01.175329 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-99d4a35b-3fa6-4779-aaeb-0895ee152a47 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:01.176186 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-99d4a35b-3fa6-4779-aaeb-0895ee152a47 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:01.181917 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-99d4a35b-3fa6-4779-aaeb-0895ee152a47 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:01.182358 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-99d4a35b-3fa6-4779-aaeb-0895ee152a47 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:01.183103 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-99d4a35b-3fa6-4779-aaeb-0895ee152a47 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:01.183529 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-99d4a35b-3fa6-4779-aaeb-0895ee152a47 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:01.211740 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-99d4a35b-3fa6-4779-aaeb-0895ee152a47 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040169 Oct 15 03:47:01.212271 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 717/1329] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:01 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:01.221732 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-78f6ba09-39c1-4d86-be4e-2618e96cbba5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:01.222653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-78f6ba09-39c1-4d86-be4e-2618e96cbba5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:01.228313 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-78f6ba09-39c1-4d86-be4e-2618e96cbba5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:01.228754 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-78f6ba09-39c1-4d86-be4e-2618e96cbba5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:01.229496 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-78f6ba09-39c1-4d86-be4e-2618e96cbba5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:01.229922 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-78f6ba09-39c1-4d86-be4e-2618e96cbba5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:01.258456 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-78f6ba09-39c1-4d86-be4e-2618e96cbba5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040471 Oct 15 03:47:01.259032 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 613/1330] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:01 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:47:01.692440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9c3812f0-6804-4892-ae19-314a16285102 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:01.693041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9c3812f0-6804-4892-ae19-314a16285102 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:01.698619 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9c3812f0-6804-4892-ae19-314a16285102 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:01.699059 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9c3812f0-6804-4892-ae19-314a16285102 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:01.699832 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9c3812f0-6804-4892-ae19-314a16285102 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:01.700262 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9c3812f0-6804-4892-ae19-314a16285102 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:01.815508 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9c3812f0-6804-4892-ae19-314a16285102 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:01.822856 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9c3812f0-6804-4892-ae19-314a16285102 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.133953 Oct 15 03:47:01.823413 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 718/1331] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:01 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:02.223605 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e8626296-ecbb-4e5f-a3bc-4e9f06bc853a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:02.224785 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e8626296-ecbb-4e5f-a3bc-4e9f06bc853a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:02.231374 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e8626296-ecbb-4e5f-a3bc-4e9f06bc853a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:02.231848 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e8626296-ecbb-4e5f-a3bc-4e9f06bc853a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:02.232599 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e8626296-ecbb-4e5f-a3bc-4e9f06bc853a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:02.233024 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e8626296-ecbb-4e5f-a3bc-4e9f06bc853a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:02.261648 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e8626296-ecbb-4e5f-a3bc-4e9f06bc853a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041756 Oct 15 03:47:02.262258 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 614/1332] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:02 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:02.270179 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-069f1efd-000f-4681-af95-d44329c800e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:02.271091 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-069f1efd-000f-4681-af95-d44329c800e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:02.277363 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-069f1efd-000f-4681-af95-d44329c800e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:02.277812 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-069f1efd-000f-4681-af95-d44329c800e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:02.278570 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-069f1efd-000f-4681-af95-d44329c800e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:02.279004 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-069f1efd-000f-4681-af95-d44329c800e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:02.309686 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-069f1efd-000f-4681-af95-d44329c800e2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043230 Oct 15 03:47:02.310212 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 719/1333] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:02 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:02.840283 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2970b22b-0c98-4b00-863a-d51e7079b1a6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:02.840886 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2970b22b-0c98-4b00-863a-d51e7079b1a6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:02.846583 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2970b22b-0c98-4b00-863a-d51e7079b1a6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:02.847023 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2970b22b-0c98-4b00-863a-d51e7079b1a6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:02.847789 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2970b22b-0c98-4b00-863a-d51e7079b1a6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:02.848219 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2970b22b-0c98-4b00-863a-d51e7079b1a6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:02.963125 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2970b22b-0c98-4b00-863a-d51e7079b1a6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:02.970363 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2970b22b-0c98-4b00-863a-d51e7079b1a6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.133807 Oct 15 03:47:02.970938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 615/1334] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:02 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:47:03.272918 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-14b5fa64-e0e3-4eeb-8e00-9b424ab4cb58 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:03.273825 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-14b5fa64-e0e3-4eeb-8e00-9b424ab4cb58 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:03.279594 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-14b5fa64-e0e3-4eeb-8e00-9b424ab4cb58 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:03.280077 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-14b5fa64-e0e3-4eeb-8e00-9b424ab4cb58 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:03.280835 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-14b5fa64-e0e3-4eeb-8e00-9b424ab4cb58 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:03.281271 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-14b5fa64-e0e3-4eeb-8e00-9b424ab4cb58 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:03.310384 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-14b5fa64-e0e3-4eeb-8e00-9b424ab4cb58 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041225 Oct 15 03:47:03.310915 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 720/1335] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:03 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:03.321021 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b6f06bdd-8002-4534-976d-1d7c1e1654b4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:03.321914 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b6f06bdd-8002-4534-976d-1d7c1e1654b4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:03.327523 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b6f06bdd-8002-4534-976d-1d7c1e1654b4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:03.327997 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b6f06bdd-8002-4534-976d-1d7c1e1654b4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:03.328746 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b6f06bdd-8002-4534-976d-1d7c1e1654b4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:03.329173 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b6f06bdd-8002-4534-976d-1d7c1e1654b4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:03.357283 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b6f06bdd-8002-4534-976d-1d7c1e1654b4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040093 Oct 15 03:47:03.357798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 616/1336] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:03 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:03.987253 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-734ad0b7-22d8-401c-8b29-91fe82041cb0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:03.987803 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-734ad0b7-22d8-401c-8b29-91fe82041cb0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:03.993560 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-734ad0b7-22d8-401c-8b29-91fe82041cb0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:03.994004 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-734ad0b7-22d8-401c-8b29-91fe82041cb0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:03.994756 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-734ad0b7-22d8-401c-8b29-91fe82041cb0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:03.995188 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-734ad0b7-22d8-401c-8b29-91fe82041cb0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:04.112744 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-734ad0b7-22d8-401c-8b29-91fe82041cb0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:04.119832 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-734ad0b7-22d8-401c-8b29-91fe82041cb0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.136308 Oct 15 03:47:04.120383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 721/1337] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:03 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:04.321555 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ee0d23a3-7fa5-4d54-99f6-e25996ccbee7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:04.322483 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ee0d23a3-7fa5-4d54-99f6-e25996ccbee7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:04.328815 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee0d23a3-7fa5-4d54-99f6-e25996ccbee7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:04.329258 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee0d23a3-7fa5-4d54-99f6-e25996ccbee7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:04.330004 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee0d23a3-7fa5-4d54-99f6-e25996ccbee7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:04.330429 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee0d23a3-7fa5-4d54-99f6-e25996ccbee7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:04.357883 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ee0d23a3-7fa5-4d54-99f6-e25996ccbee7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040135 Oct 15 03:47:04.358411 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 617/1338] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:04 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:04.368430 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-982c6723-c61b-43a4-8a7c-2ff9b9e4c6bf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:04.369389 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-982c6723-c61b-43a4-8a7c-2ff9b9e4c6bf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:04.375537 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-982c6723-c61b-43a4-8a7c-2ff9b9e4c6bf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:04.376021 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-982c6723-c61b-43a4-8a7c-2ff9b9e4c6bf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:04.376780 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-982c6723-c61b-43a4-8a7c-2ff9b9e4c6bf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:04.377207 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-982c6723-c61b-43a4-8a7c-2ff9b9e4c6bf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:04.406204 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-982c6723-c61b-43a4-8a7c-2ff9b9e4c6bf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041514 Oct 15 03:47:04.406753 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 722/1339] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:04 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:05.136658 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f4f3dcd8-7123-4e13-a2d2-3dd5085aed39 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:05.137252 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f4f3dcd8-7123-4e13-a2d2-3dd5085aed39 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:05.142996 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f4f3dcd8-7123-4e13-a2d2-3dd5085aed39 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:05.143437 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f4f3dcd8-7123-4e13-a2d2-3dd5085aed39 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:05.144223 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f4f3dcd8-7123-4e13-a2d2-3dd5085aed39 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:05.144655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f4f3dcd8-7123-4e13-a2d2-3dd5085aed39 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:05.263205 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f4f3dcd8-7123-4e13-a2d2-3dd5085aed39 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:05.270373 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f4f3dcd8-7123-4e13-a2d2-3dd5085aed39 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.137414 Oct 15 03:47:05.270930 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 618/1340] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:05 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:05.366335 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: ERROR oslo.messaging._drivers.impl_rabbit [-] [62b4e7dd-437c-4699-815c-b81f4b01b864] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 15 03:47:05.369760 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4faf8a39-1130-40b5-854f-e6cb4f7bf4d2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:05.370682 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4faf8a39-1130-40b5-854f-e6cb4f7bf4d2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:05.376345 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4faf8a39-1130-40b5-854f-e6cb4f7bf4d2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:05.376800 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4faf8a39-1130-40b5-854f-e6cb4f7bf4d2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:05.377552 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4faf8a39-1130-40b5-854f-e6cb4f7bf4d2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:05.377989 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4faf8a39-1130-40b5-854f-e6cb4f7bf4d2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:05.406403 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4faf8a39-1130-40b5-854f-e6cb4f7bf4d2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041232 Oct 15 03:47:05.406872 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 723/1341] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:05 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:05.417199 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1d43dbf3-d842-4057-adba-ebca92ef76a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:05.418229 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1d43dbf3-d842-4057-adba-ebca92ef76a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:05.423861 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1d43dbf3-d842-4057-adba-ebca92ef76a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:05.424323 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1d43dbf3-d842-4057-adba-ebca92ef76a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:05.425056 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1d43dbf3-d842-4057-adba-ebca92ef76a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:05.425488 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1d43dbf3-d842-4057-adba-ebca92ef76a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:05.453442 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1d43dbf3-d842-4057-adba-ebca92ef76a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039943 Oct 15 03:47:05.453979 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 619/1342] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:05 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:06.287796 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fdfb7cb9-aa2a-4529-8405-7a5873b3b8f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:06.288398 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fdfb7cb9-aa2a-4529-8405-7a5873b3b8f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:06.294918 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fdfb7cb9-aa2a-4529-8405-7a5873b3b8f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:06.295362 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fdfb7cb9-aa2a-4529-8405-7a5873b3b8f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:06.296143 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fdfb7cb9-aa2a-4529-8405-7a5873b3b8f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:06.296576 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fdfb7cb9-aa2a-4529-8405-7a5873b3b8f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:06.389471 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] [62b4e7dd-437c-4699-815c-b81f4b01b864] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 58926. Oct 15 03:47:06.418299 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8cdc23a4-4617-4481-b303-5d94f4f70017 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:06.419142 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8cdc23a4-4617-4481-b303-5d94f4f70017 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:06.419274 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fdfb7cb9-aa2a-4529-8405-7a5873b3b8f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:06.424869 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8cdc23a4-4617-4481-b303-5d94f4f70017 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:06.425319 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8cdc23a4-4617-4481-b303-5d94f4f70017 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:06.426079 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8cdc23a4-4617-4481-b303-5d94f4f70017 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:06.426452 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fdfb7cb9-aa2a-4529-8405-7a5873b3b8f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.142496 Oct 15 03:47:06.426579 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8cdc23a4-4617-4481-b303-5d94f4f70017 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:06.427014 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 724/1343] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:06 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:06.457945 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8cdc23a4-4617-4481-b303-5d94f4f70017 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043995 Oct 15 03:47:06.458954 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 620/1344] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:06 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:47:06.464491 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b1bdaace-5783-4d75-9139-76471d8a5e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:06.465342 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b1bdaace-5783-4d75-9139-76471d8a5e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:06.471127 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b1bdaace-5783-4d75-9139-76471d8a5e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:06.471575 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b1bdaace-5783-4d75-9139-76471d8a5e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:06.472367 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b1bdaace-5783-4d75-9139-76471d8a5e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:06.472805 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b1bdaace-5783-4d75-9139-76471d8a5e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:06.501473 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b1bdaace-5783-4d75-9139-76471d8a5e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040825 Oct 15 03:47:06.502004 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 725/1345] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:06 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:07.446214 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3f17dde2-e914-4a9b-8820-3b96f21742d2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:07.446814 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3f17dde2-e914-4a9b-8820-3b96f21742d2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:07.453244 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f17dde2-e914-4a9b-8820-3b96f21742d2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:07.453692 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f17dde2-e914-4a9b-8820-3b96f21742d2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:07.454435 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f17dde2-e914-4a9b-8820-3b96f21742d2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:07.454863 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f17dde2-e914-4a9b-8820-3b96f21742d2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:07.469568 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ca12f969-8596-4740-9d0e-d2473877decb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:07.470476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ca12f969-8596-4740-9d0e-d2473877decb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:07.476120 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ca12f969-8596-4740-9d0e-d2473877decb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:07.476568 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ca12f969-8596-4740-9d0e-d2473877decb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:07.477324 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ca12f969-8596-4740-9d0e-d2473877decb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:07.477761 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ca12f969-8596-4740-9d0e-d2473877decb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:07.506320 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ca12f969-8596-4740-9d0e-d2473877decb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040299 Oct 15 03:47:07.510155 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 726/1346] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:07 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:47:07.513140 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0f10cc31-8c65-4b02-9fb8-ca6b66ed8bf3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:07.514191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0f10cc31-8c65-4b02-9fb8-ca6b66ed8bf3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:07.520261 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0f10cc31-8c65-4b02-9fb8-ca6b66ed8bf3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:07.520444 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0f10cc31-8c65-4b02-9fb8-ca6b66ed8bf3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:07.521250 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0f10cc31-8c65-4b02-9fb8-ca6b66ed8bf3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:07.521581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0f10cc31-8c65-4b02-9fb8-ca6b66ed8bf3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:07.550566 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0f10cc31-8c65-4b02-9fb8-ca6b66ed8bf3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041658 Oct 15 03:47:07.551106 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 727/1347] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:07 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:47:07.579646 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3f17dde2-e914-4a9b-8820-3b96f21742d2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:07.587504 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3f17dde2-e914-4a9b-8820-3b96f21742d2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.144915 Oct 15 03:47:07.588446 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 621/1348] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:07 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:08.518142 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-57cc62c8-3b85-4871-acba-ecde49d0cc54 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:08.519049 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-57cc62c8-3b85-4871-acba-ecde49d0cc54 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:08.524842 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-57cc62c8-3b85-4871-acba-ecde49d0cc54 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:08.525280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-57cc62c8-3b85-4871-acba-ecde49d0cc54 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:08.526023 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-57cc62c8-3b85-4871-acba-ecde49d0cc54 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:08.526452 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-57cc62c8-3b85-4871-acba-ecde49d0cc54 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:08.554384 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-57cc62c8-3b85-4871-acba-ecde49d0cc54 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040068 Oct 15 03:47:08.554909 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 728/1349] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:08 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:08.561927 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6f8a4454-d4e0-4c17-8d46-f2bb47495147 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:08.562836 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6f8a4454-d4e0-4c17-8d46-f2bb47495147 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:08.568589 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f8a4454-d4e0-4c17-8d46-f2bb47495147 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:08.569033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f8a4454-d4e0-4c17-8d46-f2bb47495147 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:08.569797 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f8a4454-d4e0-4c17-8d46-f2bb47495147 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:08.570232 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f8a4454-d4e0-4c17-8d46-f2bb47495147 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:08.599196 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6f8a4454-d4e0-4c17-8d46-f2bb47495147 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041102 Oct 15 03:47:08.599762 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 622/1350] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:08 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:08.604193 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3b58410f-be8b-43e4-a6d6-34a3c928170e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:08.605229 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3b58410f-be8b-43e4-a6d6-34a3c928170e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:08.610886 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b58410f-be8b-43e4-a6d6-34a3c928170e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:08.611322 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b58410f-be8b-43e4-a6d6-34a3c928170e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:08.612100 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b58410f-be8b-43e4-a6d6-34a3c928170e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:08.612525 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b58410f-be8b-43e4-a6d6-34a3c928170e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:08.734691 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3b58410f-be8b-43e4-a6d6-34a3c928170e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:08.742236 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3b58410f-be8b-43e4-a6d6-34a3c928170e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.141609 Oct 15 03:47:08.742794 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 729/1351] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:08 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:47:09.565977 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d56aff0f-10da-4bf7-b6af-0d0e4e760675 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:09.566812 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d56aff0f-10da-4bf7-b6af-0d0e4e760675 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:09.572653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d56aff0f-10da-4bf7-b6af-0d0e4e760675 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:09.573101 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d56aff0f-10da-4bf7-b6af-0d0e4e760675 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:09.573855 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d56aff0f-10da-4bf7-b6af-0d0e4e760675 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:09.574287 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d56aff0f-10da-4bf7-b6af-0d0e4e760675 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:09.602896 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d56aff0f-10da-4bf7-b6af-0d0e4e760675 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040810 Oct 15 03:47:09.603430 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 623/1352] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:09 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:47:09.610843 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f51b8ee2-d925-44c9-b062-d5fa7508ba91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:09.611773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f51b8ee2-d925-44c9-b062-d5fa7508ba91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:09.617453 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f51b8ee2-d925-44c9-b062-d5fa7508ba91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:09.617900 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f51b8ee2-d925-44c9-b062-d5fa7508ba91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:09.618651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f51b8ee2-d925-44c9-b062-d5fa7508ba91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:09.619077 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f51b8ee2-d925-44c9-b062-d5fa7508ba91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:09.646301 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f51b8ee2-d925-44c9-b062-d5fa7508ba91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039247 Oct 15 03:47:09.646828 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 730/1353] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:09 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:09.759337 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-efec0a06-44f0-4984-bcdf-a149761a8adf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:09.759977 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-efec0a06-44f0-4984-bcdf-a149761a8adf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:09.765848 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-efec0a06-44f0-4984-bcdf-a149761a8adf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:09.766299 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-efec0a06-44f0-4984-bcdf-a149761a8adf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:09.767086 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-efec0a06-44f0-4984-bcdf-a149761a8adf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:09.767520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-efec0a06-44f0-4984-bcdf-a149761a8adf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:09.883404 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-efec0a06-44f0-4984-bcdf-a149761a8adf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:09.891100 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-efec0a06-44f0-4984-bcdf-a149761a8adf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135377 Oct 15 03:47:09.891662 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 624/1354] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:09 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:10.614728 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6169e8d6-cf26-4cd6-97db-206279a6e5a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:10.615708 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6169e8d6-cf26-4cd6-97db-206279a6e5a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:10.621443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6169e8d6-cf26-4cd6-97db-206279a6e5a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:10.621886 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6169e8d6-cf26-4cd6-97db-206279a6e5a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:10.622632 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6169e8d6-cf26-4cd6-97db-206279a6e5a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:10.623058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6169e8d6-cf26-4cd6-97db-206279a6e5a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:10.651353 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6169e8d6-cf26-4cd6-97db-206279a6e5a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040365 Oct 15 03:47:10.651978 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 731/1355] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:10 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:10.657881 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-48a5fd44-ebec-4e43-b805-8330cea30875 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:10.658777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-48a5fd44-ebec-4e43-b805-8330cea30875 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:10.664610 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-48a5fd44-ebec-4e43-b805-8330cea30875 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:10.665056 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-48a5fd44-ebec-4e43-b805-8330cea30875 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:10.665804 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-48a5fd44-ebec-4e43-b805-8330cea30875 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:10.666230 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-48a5fd44-ebec-4e43-b805-8330cea30875 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:10.694025 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-48a5fd44-ebec-4e43-b805-8330cea30875 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039862 Oct 15 03:47:10.694560 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 625/1356] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:10 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:10.908389 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4be300a1-67ee-4704-909c-44ef25193ea4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:10.908930 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4be300a1-67ee-4704-909c-44ef25193ea4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:10.914518 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4be300a1-67ee-4704-909c-44ef25193ea4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:10.914955 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4be300a1-67ee-4704-909c-44ef25193ea4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:10.915789 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4be300a1-67ee-4704-909c-44ef25193ea4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:10.916224 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4be300a1-67ee-4704-909c-44ef25193ea4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:11.033871 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4be300a1-67ee-4704-909c-44ef25193ea4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:11.040944 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4be300a1-67ee-4704-909c-44ef25193ea4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.136280 Oct 15 03:47:11.041494 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 732/1357] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:10 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:11.662831 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-22fb4468-e75c-4d16-b945-03a3cf00913e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:11.663716 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-22fb4468-e75c-4d16-b945-03a3cf00913e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:11.670073 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-22fb4468-e75c-4d16-b945-03a3cf00913e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:11.670547 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-22fb4468-e75c-4d16-b945-03a3cf00913e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:11.671312 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-22fb4468-e75c-4d16-b945-03a3cf00913e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:11.671784 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-22fb4468-e75c-4d16-b945-03a3cf00913e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:11.700780 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-22fb4468-e75c-4d16-b945-03a3cf00913e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041723 Oct 15 03:47:11.701313 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 626/1358] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:11 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:11.705601 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e71acca2-41c6-4a79-b763-53cc9da15069 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:11.706550 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e71acca2-41c6-4a79-b763-53cc9da15069 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:11.712549 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e71acca2-41c6-4a79-b763-53cc9da15069 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:11.712996 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e71acca2-41c6-4a79-b763-53cc9da15069 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:11.713755 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e71acca2-41c6-4a79-b763-53cc9da15069 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:11.714191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e71acca2-41c6-4a79-b763-53cc9da15069 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:11.742274 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e71acca2-41c6-4a79-b763-53cc9da15069 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040566 Oct 15 03:47:11.742836 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 733/1359] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:11 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:12.057470 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5e53df16-ed10-4828-b8d9-013d96339af8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:12.058069 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5e53df16-ed10-4828-b8d9-013d96339af8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:12.063836 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5e53df16-ed10-4828-b8d9-013d96339af8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:12.064278 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5e53df16-ed10-4828-b8d9-013d96339af8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:12.065028 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5e53df16-ed10-4828-b8d9-013d96339af8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:12.065453 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5e53df16-ed10-4828-b8d9-013d96339af8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:12.181743 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5e53df16-ed10-4828-b8d9-013d96339af8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:12.188945 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5e53df16-ed10-4828-b8d9-013d96339af8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135123 Oct 15 03:47:12.189506 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 627/1360] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:12 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:12.712323 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cf09974e-9b4f-44ea-b7cb-9deab5544da5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:12.713233 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cf09974e-9b4f-44ea-b7cb-9deab5544da5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:12.718981 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cf09974e-9b4f-44ea-b7cb-9deab5544da5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:12.719428 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cf09974e-9b4f-44ea-b7cb-9deab5544da5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:12.720221 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cf09974e-9b4f-44ea-b7cb-9deab5544da5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:12.720683 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cf09974e-9b4f-44ea-b7cb-9deab5544da5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:12.748327 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cf09974e-9b4f-44ea-b7cb-9deab5544da5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039995 Oct 15 03:47:12.748857 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 734/1361] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:12 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:12.753636 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5ecf47d7-bdd1-4e22-9793-2e6a3df6ae91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:12.754538 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5ecf47d7-bdd1-4e22-9793-2e6a3df6ae91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:12.760220 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ecf47d7-bdd1-4e22-9793-2e6a3df6ae91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:12.760667 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ecf47d7-bdd1-4e22-9793-2e6a3df6ae91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:12.762095 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ecf47d7-bdd1-4e22-9793-2e6a3df6ae91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:12.762528 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ecf47d7-bdd1-4e22-9793-2e6a3df6ae91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:12.789801 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5ecf47d7-bdd1-4e22-9793-2e6a3df6ae91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039844 Oct 15 03:47:12.790324 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 628/1362] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:12 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:13.205920 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bfc53440-60f1-4e31-82e1-de9b4a0a3e08 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:13.206520 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bfc53440-60f1-4e31-82e1-de9b4a0a3e08 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:13.212462 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bfc53440-60f1-4e31-82e1-de9b4a0a3e08 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:13.212900 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bfc53440-60f1-4e31-82e1-de9b4a0a3e08 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:13.213642 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bfc53440-60f1-4e31-82e1-de9b4a0a3e08 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:13.214067 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bfc53440-60f1-4e31-82e1-de9b4a0a3e08 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:13.329284 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bfc53440-60f1-4e31-82e1-de9b4a0a3e08 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:13.336823 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bfc53440-60f1-4e31-82e1-de9b4a0a3e08 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134524 Oct 15 03:47:13.337376 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 735/1363] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:13 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:13.758956 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-501561b7-ac13-4e5c-9d09-7001d5839890 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:13.759886 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-501561b7-ac13-4e5c-9d09-7001d5839890 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:13.765982 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-501561b7-ac13-4e5c-9d09-7001d5839890 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:13.766421 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-501561b7-ac13-4e5c-9d09-7001d5839890 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:13.767163 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-501561b7-ac13-4e5c-9d09-7001d5839890 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:13.767589 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-501561b7-ac13-4e5c-9d09-7001d5839890 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:13.795372 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-501561b7-ac13-4e5c-9d09-7001d5839890 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040200 Oct 15 03:47:13.795931 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 629/1364] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:13 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:13.801119 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1b83a9ff-09f1-4d38-b31b-be612868d1a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:13.802014 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1b83a9ff-09f1-4d38-b31b-be612868d1a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:13.807635 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b83a9ff-09f1-4d38-b31b-be612868d1a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:13.808109 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b83a9ff-09f1-4d38-b31b-be612868d1a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:13.808858 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b83a9ff-09f1-4d38-b31b-be612868d1a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:13.809283 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b83a9ff-09f1-4d38-b31b-be612868d1a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:13.837247 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1b83a9ff-09f1-4d38-b31b-be612868d1a7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039929 Oct 15 03:47:13.837769 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 736/1365] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:13 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:14.353943 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5d9cdc8e-1821-45ab-9ee2-af82a64e20c4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:14.354546 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5d9cdc8e-1821-45ab-9ee2-af82a64e20c4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:14.360351 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5d9cdc8e-1821-45ab-9ee2-af82a64e20c4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:14.360793 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5d9cdc8e-1821-45ab-9ee2-af82a64e20c4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:14.361537 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5d9cdc8e-1821-45ab-9ee2-af82a64e20c4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:14.361961 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5d9cdc8e-1821-45ab-9ee2-af82a64e20c4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:14.482761 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5d9cdc8e-1821-45ab-9ee2-af82a64e20c4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:14.489899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5d9cdc8e-1821-45ab-9ee2-af82a64e20c4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.139539 Oct 15 03:47:14.490451 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 630/1366] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:14 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:14.808546 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-df1c3ab9-704a-4663-8cc0-f37bb48ad8d1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:14.809524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-df1c3ab9-704a-4663-8cc0-f37bb48ad8d1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:14.815213 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df1c3ab9-704a-4663-8cc0-f37bb48ad8d1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:14.815652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df1c3ab9-704a-4663-8cc0-f37bb48ad8d1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:14.816425 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df1c3ab9-704a-4663-8cc0-f37bb48ad8d1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:14.816851 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df1c3ab9-704a-4663-8cc0-f37bb48ad8d1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:14.844994 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-df1c3ab9-704a-4663-8cc0-f37bb48ad8d1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040864 Oct 15 03:47:14.845683 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 737/1367] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:14 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:14.848902 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-41bae912-a4bf-478c-85a9-8a35be3ca6bc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:14.849837 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-41bae912-a4bf-478c-85a9-8a35be3ca6bc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:14.855505 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-41bae912-a4bf-478c-85a9-8a35be3ca6bc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:14.856006 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-41bae912-a4bf-478c-85a9-8a35be3ca6bc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:14.856762 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-41bae912-a4bf-478c-85a9-8a35be3ca6bc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:14.857189 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-41bae912-a4bf-478c-85a9-8a35be3ca6bc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:14.885367 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-41bae912-a4bf-478c-85a9-8a35be3ca6bc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040411 Oct 15 03:47:14.886537 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 631/1368] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:14 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:47:15.506429 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-479b9974-0668-4d94-a852-6361b30d2e0d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:15.506969 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-479b9974-0668-4d94-a852-6361b30d2e0d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:15.512681 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-479b9974-0668-4d94-a852-6361b30d2e0d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:15.513121 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-479b9974-0668-4d94-a852-6361b30d2e0d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:15.513862 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-479b9974-0668-4d94-a852-6361b30d2e0d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:15.514287 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-479b9974-0668-4d94-a852-6361b30d2e0d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:15.628654 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-479b9974-0668-4d94-a852-6361b30d2e0d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:15.635738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-479b9974-0668-4d94-a852-6361b30d2e0d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.132953 Oct 15 03:47:15.636316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 738/1369] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:15 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:15.857032 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5b26a697-d237-4dd0-af09-854c6de634cb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:15.857859 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5b26a697-d237-4dd0-af09-854c6de634cb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:15.863583 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5b26a697-d237-4dd0-af09-854c6de634cb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:15.864055 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5b26a697-d237-4dd0-af09-854c6de634cb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:15.864805 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5b26a697-d237-4dd0-af09-854c6de634cb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:15.865230 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5b26a697-d237-4dd0-af09-854c6de634cb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:15.893562 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5b26a697-d237-4dd0-af09-854c6de634cb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040989 Oct 15 03:47:15.894109 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 632/1370] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:15 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:15.896848 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d052f5c1-6b70-4fec-aa48-aebe1b7a5b10 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:15.897743 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d052f5c1-6b70-4fec-aa48-aebe1b7a5b10 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:15.904070 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d052f5c1-6b70-4fec-aa48-aebe1b7a5b10 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:15.904516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d052f5c1-6b70-4fec-aa48-aebe1b7a5b10 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:15.905263 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d052f5c1-6b70-4fec-aa48-aebe1b7a5b10 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:15.905685 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d052f5c1-6b70-4fec-aa48-aebe1b7a5b10 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:15.936292 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d052f5c1-6b70-4fec-aa48-aebe1b7a5b10 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043200 Oct 15 03:47:15.936991 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 739/1371] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:15 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:47:16.652017 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fe6aba25-70b9-4f66-b4ae-aaad42673c4a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:16.652624 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fe6aba25-70b9-4f66-b4ae-aaad42673c4a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:16.658266 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe6aba25-70b9-4f66-b4ae-aaad42673c4a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:16.658716 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe6aba25-70b9-4f66-b4ae-aaad42673c4a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:16.659473 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe6aba25-70b9-4f66-b4ae-aaad42673c4a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:16.659936 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe6aba25-70b9-4f66-b4ae-aaad42673c4a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:16.774166 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fe6aba25-70b9-4f66-b4ae-aaad42673c4a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:16.781351 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fe6aba25-70b9-4f66-b4ae-aaad42673c4a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.132951 Oct 15 03:47:16.781910 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 633/1372] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:16 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:16.903972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-adb955a7-b0ec-4a6a-930c-231ede9d3953 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:16.904811 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-adb955a7-b0ec-4a6a-930c-231ede9d3953 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:16.910494 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-adb955a7-b0ec-4a6a-930c-231ede9d3953 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:16.910937 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-adb955a7-b0ec-4a6a-930c-231ede9d3953 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:16.911705 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-adb955a7-b0ec-4a6a-930c-231ede9d3953 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:16.912139 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-adb955a7-b0ec-4a6a-930c-231ede9d3953 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:16.940798 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-adb955a7-b0ec-4a6a-930c-231ede9d3953 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040774 Oct 15 03:47:16.941335 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 740/1373] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:16 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:16.947649 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fe4278b2-bf78-4ce4-ae6d-be8980348b28 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:16.948616 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fe4278b2-bf78-4ce4-ae6d-be8980348b28 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:16.954224 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe4278b2-bf78-4ce4-ae6d-be8980348b28 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:16.954667 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe4278b2-bf78-4ce4-ae6d-be8980348b28 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:16.955414 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe4278b2-bf78-4ce4-ae6d-be8980348b28 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:16.955882 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe4278b2-bf78-4ce4-ae6d-be8980348b28 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:16.984704 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fe4278b2-bf78-4ce4-ae6d-be8980348b28 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040189 Oct 15 03:47:16.984959 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 634/1374] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:16 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:17.798072 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5e0ee839-3f20-43f4-97d1-bb016aec5ff1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:17.798582 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5e0ee839-3f20-43f4-97d1-bb016aec5ff1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:17.804248 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5e0ee839-3f20-43f4-97d1-bb016aec5ff1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:17.804693 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5e0ee839-3f20-43f4-97d1-bb016aec5ff1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:17.805438 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5e0ee839-3f20-43f4-97d1-bb016aec5ff1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:17.805865 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5e0ee839-3f20-43f4-97d1-bb016aec5ff1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:17.952758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-420e4434-b207-47b2-b53c-36b8a7bb85f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:17.953668 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-420e4434-b207-47b2-b53c-36b8a7bb85f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:17.960075 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-420e4434-b207-47b2-b53c-36b8a7bb85f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:17.960514 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-420e4434-b207-47b2-b53c-36b8a7bb85f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:17.961292 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-420e4434-b207-47b2-b53c-36b8a7bb85f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:17.961750 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-420e4434-b207-47b2-b53c-36b8a7bb85f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:17.991811 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-420e4434-b207-47b2-b53c-36b8a7bb85f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043282 Oct 15 03:47:17.992389 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 635/1375] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:17 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:47:17.997632 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e445062a-331f-4a1b-92fa-604622224af9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:17.998536 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e445062a-331f-4a1b-92fa-604622224af9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:18.004510 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e445062a-331f-4a1b-92fa-604622224af9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:18.004953 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e445062a-331f-4a1b-92fa-604622224af9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:18.005716 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e445062a-331f-4a1b-92fa-604622224af9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:18.006142 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e445062a-331f-4a1b-92fa-604622224af9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:18.039740 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e445062a-331f-4a1b-92fa-604622224af9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046256 Oct 15 03:47:18.040542 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 636/1376] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:17 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:18.132843 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5e0ee839-3f20-43f4-97d1-bb016aec5ff1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:18.145201 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5e0ee839-3f20-43f4-97d1-bb016aec5ff1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.350845 Oct 15 03:47:18.145965 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 741/1377] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:17 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:19.003511 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-af7c88e4-ba46-41db-84c1-23c60eb8803f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:19.004446 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-af7c88e4-ba46-41db-84c1-23c60eb8803f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:19.010280 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-af7c88e4-ba46-41db-84c1-23c60eb8803f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:19.011236 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-af7c88e4-ba46-41db-84c1-23c60eb8803f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:19.012021 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-af7c88e4-ba46-41db-84c1-23c60eb8803f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:19.012455 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-af7c88e4-ba46-41db-84c1-23c60eb8803f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:19.040389 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-af7c88e4-ba46-41db-84c1-23c60eb8803f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040649 Oct 15 03:47:19.040926 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 637/1378] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:18 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:19.051189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bf5caba5-6c17-42f2-b039-8fead14eae44 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:19.052182 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bf5caba5-6c17-42f2-b039-8fead14eae44 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:19.057903 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf5caba5-6c17-42f2-b039-8fead14eae44 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:19.058350 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf5caba5-6c17-42f2-b039-8fead14eae44 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:19.059105 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf5caba5-6c17-42f2-b039-8fead14eae44 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:19.059538 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf5caba5-6c17-42f2-b039-8fead14eae44 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:19.090835 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bf5caba5-6c17-42f2-b039-8fead14eae44 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043300 Oct 15 03:47:19.091391 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 742/1379] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:19 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:19.162372 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-de6ec97e-819d-4b7b-8fdb-a13188e545fe tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:19.162974 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-de6ec97e-819d-4b7b-8fdb-a13188e545fe tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:19.168633 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-de6ec97e-819d-4b7b-8fdb-a13188e545fe tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:19.169074 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-de6ec97e-819d-4b7b-8fdb-a13188e545fe tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:19.169825 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-de6ec97e-819d-4b7b-8fdb-a13188e545fe tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:19.170251 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-de6ec97e-819d-4b7b-8fdb-a13188e545fe tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:19.286023 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-de6ec97e-819d-4b7b-8fdb-a13188e545fe tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:19.293095 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-de6ec97e-819d-4b7b-8fdb-a13188e545fe tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134274 Oct 15 03:47:19.293661 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 638/1380] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:19 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:20.051817 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9e869157-a499-4303-a9ca-e12bb0409036 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:20.052727 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9e869157-a499-4303-a9ca-e12bb0409036 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:20.059024 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9e869157-a499-4303-a9ca-e12bb0409036 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:20.059467 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9e869157-a499-4303-a9ca-e12bb0409036 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:20.060253 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9e869157-a499-4303-a9ca-e12bb0409036 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:20.060960 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9e869157-a499-4303-a9ca-e12bb0409036 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:20.090460 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9e869157-a499-4303-a9ca-e12bb0409036 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042432 Oct 15 03:47:20.090987 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 743/1381] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:20 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:20.101949 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b4d57091-e6c5-4e26-bf99-849717c52696 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:20.102846 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b4d57091-e6c5-4e26-bf99-849717c52696 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:20.108430 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b4d57091-e6c5-4e26-bf99-849717c52696 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:20.108870 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b4d57091-e6c5-4e26-bf99-849717c52696 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:20.109616 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b4d57091-e6c5-4e26-bf99-849717c52696 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:20.110062 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b4d57091-e6c5-4e26-bf99-849717c52696 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:20.139196 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b4d57091-e6c5-4e26-bf99-849717c52696 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040908 Oct 15 03:47:20.139777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 639/1382] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:20 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:20.310366 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-73a882c5-266b-45ab-9942-7a1c65ea9582 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:20.310913 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-73a882c5-266b-45ab-9942-7a1c65ea9582 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:20.316719 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-73a882c5-266b-45ab-9942-7a1c65ea9582 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:20.317167 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-73a882c5-266b-45ab-9942-7a1c65ea9582 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:20.317922 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-73a882c5-266b-45ab-9942-7a1c65ea9582 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:20.318354 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-73a882c5-266b-45ab-9942-7a1c65ea9582 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:20.435568 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-73a882c5-266b-45ab-9942-7a1c65ea9582 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:20.442620 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-73a882c5-266b-45ab-9942-7a1c65ea9582 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.136730 Oct 15 03:47:20.443160 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 744/1383] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:20 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:21.101842 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7ccc8aaa-aa7d-47bf-953f-7ea78b530198 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:21.102747 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7ccc8aaa-aa7d-47bf-953f-7ea78b530198 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:21.109162 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7ccc8aaa-aa7d-47bf-953f-7ea78b530198 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:21.109603 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7ccc8aaa-aa7d-47bf-953f-7ea78b530198 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:21.110350 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7ccc8aaa-aa7d-47bf-953f-7ea78b530198 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:21.110779 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7ccc8aaa-aa7d-47bf-953f-7ea78b530198 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:21.138581 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7ccc8aaa-aa7d-47bf-953f-7ea78b530198 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040735 Oct 15 03:47:21.139115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 640/1384] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:21 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:21.150177 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-300b8f8c-0628-49bf-9c38-bdbea678595e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:21.151075 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-300b8f8c-0628-49bf-9c38-bdbea678595e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:21.157443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-300b8f8c-0628-49bf-9c38-bdbea678595e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:21.157889 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-300b8f8c-0628-49bf-9c38-bdbea678595e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:21.158642 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-300b8f8c-0628-49bf-9c38-bdbea678595e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:21.159075 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-300b8f8c-0628-49bf-9c38-bdbea678595e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:21.187178 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-300b8f8c-0628-49bf-9c38-bdbea678595e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040733 Oct 15 03:47:21.190985 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 745/1385] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:21 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:21.459782 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d39250ee-df1d-4fdf-b696-197028db46b1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:21.460296 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d39250ee-df1d-4fdf-b696-197028db46b1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:21.466637 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d39250ee-df1d-4fdf-b696-197028db46b1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:21.467081 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d39250ee-df1d-4fdf-b696-197028db46b1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:21.467863 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d39250ee-df1d-4fdf-b696-197028db46b1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:21.468293 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d39250ee-df1d-4fdf-b696-197028db46b1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:21.585991 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d39250ee-df1d-4fdf-b696-197028db46b1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:21.593439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d39250ee-df1d-4fdf-b696-197028db46b1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.137607 Oct 15 03:47:21.594012 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 641/1386] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:21 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:22.149696 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ad79541d-e6fc-4d6f-bc24-223b8a31009e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:22.150606 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ad79541d-e6fc-4d6f-bc24-223b8a31009e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:22.156423 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ad79541d-e6fc-4d6f-bc24-223b8a31009e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:22.156869 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ad79541d-e6fc-4d6f-bc24-223b8a31009e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:22.157625 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ad79541d-e6fc-4d6f-bc24-223b8a31009e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:22.158059 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ad79541d-e6fc-4d6f-bc24-223b8a31009e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:22.186635 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ad79541d-e6fc-4d6f-bc24-223b8a31009e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040682 Oct 15 03:47:22.187168 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 746/1387] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:22 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:22.198133 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-dd277f4a-46ff-41c7-bd74-d384bcbcba6e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:22.199032 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-dd277f4a-46ff-41c7-bd74-d384bcbcba6e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:22.204691 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dd277f4a-46ff-41c7-bd74-d384bcbcba6e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:22.205128 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dd277f4a-46ff-41c7-bd74-d384bcbcba6e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:22.205875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dd277f4a-46ff-41c7-bd74-d384bcbcba6e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:22.206302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dd277f4a-46ff-41c7-bd74-d384bcbcba6e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:22.236208 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-dd277f4a-46ff-41c7-bd74-d384bcbcba6e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041714 Oct 15 03:47:22.236882 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 642/1388] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:22 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:22.610656 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5201c7ba-c585-4b03-995b-a77602072334 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:22.611262 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5201c7ba-c585-4b03-995b-a77602072334 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:22.617033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5201c7ba-c585-4b03-995b-a77602072334 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:22.617472 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5201c7ba-c585-4b03-995b-a77602072334 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:22.618212 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5201c7ba-c585-4b03-995b-a77602072334 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:22.618638 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5201c7ba-c585-4b03-995b-a77602072334 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:22.735292 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5201c7ba-c585-4b03-995b-a77602072334 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:22.742426 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5201c7ba-c585-4b03-995b-a77602072334 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135385 Oct 15 03:47:22.742974 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 747/1389] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:22 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:23.197800 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9fd4bffe-69b5-4da9-a651-3b972fa29003 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:23.199270 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9fd4bffe-69b5-4da9-a651-3b972fa29003 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:23.204979 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9fd4bffe-69b5-4da9-a651-3b972fa29003 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:23.205424 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9fd4bffe-69b5-4da9-a651-3b972fa29003 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:23.206165 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9fd4bffe-69b5-4da9-a651-3b972fa29003 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:23.206592 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9fd4bffe-69b5-4da9-a651-3b972fa29003 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:23.234663 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9fd4bffe-69b5-4da9-a651-3b972fa29003 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040553 Oct 15 03:47:23.235207 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 643/1390] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:23 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:23.248097 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-10bd3a2e-91b2-4e01-8de4-f17a0a85baf9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:23.248994 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-10bd3a2e-91b2-4e01-8de4-f17a0a85baf9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:23.254764 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-10bd3a2e-91b2-4e01-8de4-f17a0a85baf9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:23.255206 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-10bd3a2e-91b2-4e01-8de4-f17a0a85baf9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:23.255989 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-10bd3a2e-91b2-4e01-8de4-f17a0a85baf9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:23.256416 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-10bd3a2e-91b2-4e01-8de4-f17a0a85baf9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:23.285078 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-10bd3a2e-91b2-4e01-8de4-f17a0a85baf9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041255 Oct 15 03:47:23.285617 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 748/1391] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:23 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:23.758924 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3b78eccd-637e-4b9d-b98b-8adc1f27e070 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:23.759523 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3b78eccd-637e-4b9d-b98b-8adc1f27e070 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:23.765496 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3b78eccd-637e-4b9d-b98b-8adc1f27e070 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:23.765936 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3b78eccd-637e-4b9d-b98b-8adc1f27e070 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:23.766688 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3b78eccd-637e-4b9d-b98b-8adc1f27e070 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:23.767124 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3b78eccd-637e-4b9d-b98b-8adc1f27e070 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:23.881187 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3b78eccd-637e-4b9d-b98b-8adc1f27e070 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:23.888271 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3b78eccd-637e-4b9d-b98b-8adc1f27e070 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.132937 Oct 15 03:47:23.888827 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 644/1392] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:23 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:24.245838 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e4e8597a-7515-4614-9a9d-888c360b7230 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:24.246738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e4e8597a-7515-4614-9a9d-888c360b7230 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:24.252503 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e4e8597a-7515-4614-9a9d-888c360b7230 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:24.252991 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e4e8597a-7515-4614-9a9d-888c360b7230 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:24.253680 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e4e8597a-7515-4614-9a9d-888c360b7230 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:24.254163 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e4e8597a-7515-4614-9a9d-888c360b7230 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:24.282722 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e4e8597a-7515-4614-9a9d-888c360b7230 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040639 Oct 15 03:47:24.283243 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 749/1393] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:24 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:24.296356 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-641b1123-36a0-4413-bf46-090390893d68 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:24.297391 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-641b1123-36a0-4413-bf46-090390893d68 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:24.303179 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-641b1123-36a0-4413-bf46-090390893d68 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:24.303714 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-641b1123-36a0-4413-bf46-090390893d68 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:24.304438 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-641b1123-36a0-4413-bf46-090390893d68 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:24.304873 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-641b1123-36a0-4413-bf46-090390893d68 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:24.334310 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-641b1123-36a0-4413-bf46-090390893d68 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041673 Oct 15 03:47:24.335049 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 645/1394] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:24 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:24.904950 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-39319bc8-e2b0-40e0-acae-c1247d7f8ab0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:24.905555 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-39319bc8-e2b0-40e0-acae-c1247d7f8ab0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:24.911207 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-39319bc8-e2b0-40e0-acae-c1247d7f8ab0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:24.911659 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-39319bc8-e2b0-40e0-acae-c1247d7f8ab0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:24.912439 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-39319bc8-e2b0-40e0-acae-c1247d7f8ab0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:24.912872 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-39319bc8-e2b0-40e0-acae-c1247d7f8ab0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:25.031363 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-39319bc8-e2b0-40e0-acae-c1247d7f8ab0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:25.038516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-39319bc8-e2b0-40e0-acae-c1247d7f8ab0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.137267 Oct 15 03:47:25.039058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 750/1395] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:24 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:25.293860 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7a6a9631-7306-4109-902b-631b779545f8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:25.294788 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7a6a9631-7306-4109-902b-631b779545f8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:25.300539 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7a6a9631-7306-4109-902b-631b779545f8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:25.301109 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7a6a9631-7306-4109-902b-631b779545f8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:25.301740 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7a6a9631-7306-4109-902b-631b779545f8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:25.302173 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7a6a9631-7306-4109-902b-631b779545f8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:25.329591 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7a6a9631-7306-4109-902b-631b779545f8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040110 Oct 15 03:47:25.330127 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 646/1396] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:25 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:25.345660 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6064bcbb-953d-4faa-954b-8f801563e682 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:25.346910 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6064bcbb-953d-4faa-954b-8f801563e682 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:25.352779 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6064bcbb-953d-4faa-954b-8f801563e682 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:25.353300 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6064bcbb-953d-4faa-954b-8f801563e682 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:25.354126 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6064bcbb-953d-4faa-954b-8f801563e682 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:25.355170 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6064bcbb-953d-4faa-954b-8f801563e682 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:25.383893 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6064bcbb-953d-4faa-954b-8f801563e682 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042066 Oct 15 03:47:25.384578 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 751/1397] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:25 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:26.055067 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ddd2525b-5c5e-4d34-8364-cd6306c5f93d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:26.055622 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ddd2525b-5c5e-4d34-8364-cd6306c5f93d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:26.061323 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ddd2525b-5c5e-4d34-8364-cd6306c5f93d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:26.061769 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ddd2525b-5c5e-4d34-8364-cd6306c5f93d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:26.062531 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ddd2525b-5c5e-4d34-8364-cd6306c5f93d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:26.062960 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ddd2525b-5c5e-4d34-8364-cd6306c5f93d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:26.179263 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ddd2525b-5c5e-4d34-8364-cd6306c5f93d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:26.186517 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ddd2525b-5c5e-4d34-8364-cd6306c5f93d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135117 Oct 15 03:47:26.187073 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 647/1398] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:26 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:26.341603 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-97078d0a-b138-444b-aa5f-23ef75fce043 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:26.342442 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-97078d0a-b138-444b-aa5f-23ef75fce043 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:26.348235 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-97078d0a-b138-444b-aa5f-23ef75fce043 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:26.348766 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-97078d0a-b138-444b-aa5f-23ef75fce043 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:26.349419 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-97078d0a-b138-444b-aa5f-23ef75fce043 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:26.349842 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-97078d0a-b138-444b-aa5f-23ef75fce043 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:26.377493 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-97078d0a-b138-444b-aa5f-23ef75fce043 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040199 Oct 15 03:47:26.378015 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 752/1399] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:26 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:26.394780 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-88bdaa61-cf66-4226-9bde-c866eeb44c52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:26.395709 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-88bdaa61-cf66-4226-9bde-c866eeb44c52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:26.402215 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-88bdaa61-cf66-4226-9bde-c866eeb44c52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:26.402779 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-88bdaa61-cf66-4226-9bde-c866eeb44c52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:26.403548 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-88bdaa61-cf66-4226-9bde-c866eeb44c52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:26.404005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-88bdaa61-cf66-4226-9bde-c866eeb44c52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:26.432154 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-88bdaa61-cf66-4226-9bde-c866eeb44c52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041156 Oct 15 03:47:26.432708 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 648/1400] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:26 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:27.202451 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d1736aab-4de5-4cbc-a80f-2fc35731e1d8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:27.202980 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d1736aab-4de5-4cbc-a80f-2fc35731e1d8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:27.208972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1736aab-4de5-4cbc-a80f-2fc35731e1d8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:27.209409 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1736aab-4de5-4cbc-a80f-2fc35731e1d8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:27.210155 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1736aab-4de5-4cbc-a80f-2fc35731e1d8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:27.210583 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1736aab-4de5-4cbc-a80f-2fc35731e1d8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:27.325199 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d1736aab-4de5-4cbc-a80f-2fc35731e1d8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:27.332292 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d1736aab-4de5-4cbc-a80f-2fc35731e1d8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.133521 Oct 15 03:47:27.332856 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 753/1401] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:27 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:27.388117 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a4311d76-7bdb-4cb0-a857-35b102b92f9c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:27.389024 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a4311d76-7bdb-4cb0-a857-35b102b92f9c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:27.394708 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4311d76-7bdb-4cb0-a857-35b102b92f9c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:27.395154 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4311d76-7bdb-4cb0-a857-35b102b92f9c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:27.395937 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4311d76-7bdb-4cb0-a857-35b102b92f9c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:27.396402 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4311d76-7bdb-4cb0-a857-35b102b92f9c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:27.424281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a4311d76-7bdb-4cb0-a857-35b102b92f9c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039854 Oct 15 03:47:27.424852 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 649/1402] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:27 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:27.443618 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e753cf02-3d26-4b14-a4ef-86fad25fa273 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:27.444544 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e753cf02-3d26-4b14-a4ef-86fad25fa273 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:27.450245 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e753cf02-3d26-4b14-a4ef-86fad25fa273 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:27.450687 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e753cf02-3d26-4b14-a4ef-86fad25fa273 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:27.451435 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e753cf02-3d26-4b14-a4ef-86fad25fa273 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:27.451898 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e753cf02-3d26-4b14-a4ef-86fad25fa273 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:27.488992 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e753cf02-3d26-4b14-a4ef-86fad25fa273 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049074 Oct 15 03:47:27.489534 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 754/1403] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:27 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:28.349197 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-853c988d-7ecb-44c8-975b-092a81b870e6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:28.350072 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-853c988d-7ecb-44c8-975b-092a81b870e6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:28.356100 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-853c988d-7ecb-44c8-975b-092a81b870e6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:28.356550 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-853c988d-7ecb-44c8-975b-092a81b870e6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:28.357317 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-853c988d-7ecb-44c8-975b-092a81b870e6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:28.357753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-853c988d-7ecb-44c8-975b-092a81b870e6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:28.436021 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3429f8d6-22fe-492d-a798-c42c80ebc05f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:28.437211 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3429f8d6-22fe-492d-a798-c42c80ebc05f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:28.442656 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3429f8d6-22fe-492d-a798-c42c80ebc05f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:28.443108 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3429f8d6-22fe-492d-a798-c42c80ebc05f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:28.443914 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3429f8d6-22fe-492d-a798-c42c80ebc05f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:28.444408 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3429f8d6-22fe-492d-a798-c42c80ebc05f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:28.478516 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-853c988d-7ecb-44c8-975b-092a81b870e6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:28.479170 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3429f8d6-22fe-492d-a798-c42c80ebc05f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047353 Oct 15 03:47:28.479842 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 755/1404] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:28 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:47:28.486536 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-853c988d-7ecb-44c8-975b-092a81b870e6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.140892 Oct 15 03:47:28.487093 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 650/1405] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:28 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:28.501341 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-12d6445f-cac4-40d3-95ec-6992dd39f8e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:28.502234 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-12d6445f-cac4-40d3-95ec-6992dd39f8e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:28.507947 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-12d6445f-cac4-40d3-95ec-6992dd39f8e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:28.508388 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-12d6445f-cac4-40d3-95ec-6992dd39f8e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:28.509136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-12d6445f-cac4-40d3-95ec-6992dd39f8e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:28.509564 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-12d6445f-cac4-40d3-95ec-6992dd39f8e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:28.538970 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-12d6445f-cac4-40d3-95ec-6992dd39f8e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041837 Oct 15 03:47:28.539490 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 756/1406] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:28 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:29.490572 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b260d84c-0e5e-4410-917e-52c545896cc1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:29.491466 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b260d84c-0e5e-4410-917e-52c545896cc1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:29.497950 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b260d84c-0e5e-4410-917e-52c545896cc1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:29.498330 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b260d84c-0e5e-4410-917e-52c545896cc1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:29.499166 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b260d84c-0e5e-4410-917e-52c545896cc1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:29.499597 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b260d84c-0e5e-4410-917e-52c545896cc1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:29.503737 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e95244b6-1a1e-425b-bc5b-31652fbc98ac tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:29.504350 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e95244b6-1a1e-425b-bc5b-31652fbc98ac tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:29.510193 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e95244b6-1a1e-425b-bc5b-31652fbc98ac tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:29.510694 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e95244b6-1a1e-425b-bc5b-31652fbc98ac tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:29.511514 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e95244b6-1a1e-425b-bc5b-31652fbc98ac tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:29.511978 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e95244b6-1a1e-425b-bc5b-31652fbc98ac tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:29.528799 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b260d84c-0e5e-4410-917e-52c545896cc1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041490 Oct 15 03:47:29.532229 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 651/1407] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:29 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:29.549415 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-18461bdd-d71b-4af5-848d-d10a71cf8aec tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:29.550312 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-18461bdd-d71b-4af5-848d-d10a71cf8aec tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:29.556025 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18461bdd-d71b-4af5-848d-d10a71cf8aec tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:29.556468 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18461bdd-d71b-4af5-848d-d10a71cf8aec tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:29.557228 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18461bdd-d71b-4af5-848d-d10a71cf8aec tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:29.558241 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18461bdd-d71b-4af5-848d-d10a71cf8aec tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:29.587278 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-18461bdd-d71b-4af5-848d-d10a71cf8aec tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041478 Oct 15 03:47:29.587971 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 652/1408] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:29 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:29.630432 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e95244b6-1a1e-425b-bc5b-31652fbc98ac tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:29.637601 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e95244b6-1a1e-425b-bc5b-31652fbc98ac tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.137487 Oct 15 03:47:29.638137 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 757/1409] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:29 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:47:30.539648 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4e606fa3-c5da-490b-b57d-76bccf2c68b2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:30.540590 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4e606fa3-c5da-490b-b57d-76bccf2c68b2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:30.547037 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4e606fa3-c5da-490b-b57d-76bccf2c68b2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:30.547492 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4e606fa3-c5da-490b-b57d-76bccf2c68b2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:30.548295 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4e606fa3-c5da-490b-b57d-76bccf2c68b2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:30.548733 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4e606fa3-c5da-490b-b57d-76bccf2c68b2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:30.576295 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4e606fa3-c5da-490b-b57d-76bccf2c68b2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040422 Oct 15 03:47:30.576846 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 653/1410] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:30 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:30.598249 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9a6d360f-eb11-4ae8-ad1d-1ce4c8266613 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:30.599160 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9a6d360f-eb11-4ae8-ad1d-1ce4c8266613 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:30.605601 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9a6d360f-eb11-4ae8-ad1d-1ce4c8266613 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:30.606052 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9a6d360f-eb11-4ae8-ad1d-1ce4c8266613 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:30.606816 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9a6d360f-eb11-4ae8-ad1d-1ce4c8266613 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:30.607277 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9a6d360f-eb11-4ae8-ad1d-1ce4c8266613 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:30.635502 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9a6d360f-eb11-4ae8-ad1d-1ce4c8266613 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041071 Oct 15 03:47:30.636117 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 758/1411] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:30 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:30.654482 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e719ea88-2248-4b7b-ae3b-c4af5499da8f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:30.655090 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e719ea88-2248-4b7b-ae3b-c4af5499da8f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:30.660842 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e719ea88-2248-4b7b-ae3b-c4af5499da8f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:30.661293 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e719ea88-2248-4b7b-ae3b-c4af5499da8f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:30.662053 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e719ea88-2248-4b7b-ae3b-c4af5499da8f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:30.662487 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e719ea88-2248-4b7b-ae3b-c4af5499da8f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:30.779434 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e719ea88-2248-4b7b-ae3b-c4af5499da8f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:30.786616 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e719ea88-2248-4b7b-ae3b-c4af5499da8f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.136301 Oct 15 03:47:30.787179 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 654/1412] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:30 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:31.588287 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8c24a972-e3b5-4d02-b79d-8eee5b80634e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:31.589138 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8c24a972-e3b5-4d02-b79d-8eee5b80634e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:31.594941 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8c24a972-e3b5-4d02-b79d-8eee5b80634e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:31.595390 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8c24a972-e3b5-4d02-b79d-8eee5b80634e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:31.596183 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8c24a972-e3b5-4d02-b79d-8eee5b80634e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:31.596616 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8c24a972-e3b5-4d02-b79d-8eee5b80634e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:31.625418 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8c24a972-e3b5-4d02-b79d-8eee5b80634e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040952 Oct 15 03:47:31.629085 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 759/1413] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:31 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:31.646196 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e973b98d-e34a-44fc-84b6-e70bf27f44ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:31.647100 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e973b98d-e34a-44fc-84b6-e70bf27f44ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:31.652691 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e973b98d-e34a-44fc-84b6-e70bf27f44ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:31.653133 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e973b98d-e34a-44fc-84b6-e70bf27f44ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:31.653890 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e973b98d-e34a-44fc-84b6-e70bf27f44ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:31.654317 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e973b98d-e34a-44fc-84b6-e70bf27f44ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:31.684464 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e973b98d-e34a-44fc-84b6-e70bf27f44ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041964 Oct 15 03:47:31.685009 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 655/1414] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:31 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:31.804413 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-374e0343-421c-495a-af71-a0f92969f6d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:31.805012 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-374e0343-421c-495a-af71-a0f92969f6d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:31.811504 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-374e0343-421c-495a-af71-a0f92969f6d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:31.811975 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-374e0343-421c-495a-af71-a0f92969f6d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:31.812722 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-374e0343-421c-495a-af71-a0f92969f6d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:31.813150 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-374e0343-421c-495a-af71-a0f92969f6d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:31.936087 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-374e0343-421c-495a-af71-a0f92969f6d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:31.943194 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-374e0343-421c-495a-af71-a0f92969f6d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.142382 Oct 15 03:47:31.943765 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 760/1415] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:31 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:32.637117 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e775d399-c6d0-4ebc-b182-beaa3e428a53 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:32.638054 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e775d399-c6d0-4ebc-b182-beaa3e428a53 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:32.643863 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e775d399-c6d0-4ebc-b182-beaa3e428a53 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:32.644313 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e775d399-c6d0-4ebc-b182-beaa3e428a53 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:32.645066 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e775d399-c6d0-4ebc-b182-beaa3e428a53 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:32.645499 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e775d399-c6d0-4ebc-b182-beaa3e428a53 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:32.673639 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e775d399-c6d0-4ebc-b182-beaa3e428a53 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040769 Oct 15 03:47:32.674449 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 656/1416] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:32 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:32.695610 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1b607f82-782f-4a95-bb08-8253f25501aa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:32.696539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1b607f82-782f-4a95-bb08-8253f25501aa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:32.702814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b607f82-782f-4a95-bb08-8253f25501aa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:32.703259 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b607f82-782f-4a95-bb08-8253f25501aa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:32.704151 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b607f82-782f-4a95-bb08-8253f25501aa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:32.704571 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b607f82-782f-4a95-bb08-8253f25501aa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:32.733788 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1b607f82-782f-4a95-bb08-8253f25501aa tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041813 Oct 15 03:47:32.734337 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 761/1417] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:32 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:32.960382 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4cddb897-2930-4b70-ae63-a1ba49306a9b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:32.960925 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4cddb897-2930-4b70-ae63-a1ba49306a9b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:32.966523 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4cddb897-2930-4b70-ae63-a1ba49306a9b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:32.966967 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4cddb897-2930-4b70-ae63-a1ba49306a9b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:32.967749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4cddb897-2930-4b70-ae63-a1ba49306a9b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:32.968188 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4cddb897-2930-4b70-ae63-a1ba49306a9b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:33.151936 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4cddb897-2930-4b70-ae63-a1ba49306a9b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:33.159244 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4cddb897-2930-4b70-ae63-a1ba49306a9b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.202886 Oct 15 03:47:33.160017 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 657/1418] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:32 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:33.685523 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-28ac4afc-6f32-41e7-b110-3f356b2ebe2e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:33.686372 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-28ac4afc-6f32-41e7-b110-3f356b2ebe2e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:33.692168 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28ac4afc-6f32-41e7-b110-3f356b2ebe2e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:33.692613 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28ac4afc-6f32-41e7-b110-3f356b2ebe2e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:33.693359 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28ac4afc-6f32-41e7-b110-3f356b2ebe2e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:33.693784 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28ac4afc-6f32-41e7-b110-3f356b2ebe2e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:33.724533 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-28ac4afc-6f32-41e7-b110-3f356b2ebe2e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042781 Oct 15 03:47:33.725412 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 762/1419] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:33 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:33.746343 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f259fcb6-dff9-42ed-b6a7-29ffa2b3a89d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:33.747243 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f259fcb6-dff9-42ed-b6a7-29ffa2b3a89d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:33.752911 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f259fcb6-dff9-42ed-b6a7-29ffa2b3a89d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:33.753358 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f259fcb6-dff9-42ed-b6a7-29ffa2b3a89d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:33.754112 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f259fcb6-dff9-42ed-b6a7-29ffa2b3a89d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:33.754536 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f259fcb6-dff9-42ed-b6a7-29ffa2b3a89d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:33.784729 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f259fcb6-dff9-42ed-b6a7-29ffa2b3a89d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043009 Oct 15 03:47:33.785269 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 658/1420] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:33 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:34.176409 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d6494810-b1ed-4956-b335-c4374a28b40f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:34.177011 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d6494810-b1ed-4956-b335-c4374a28b40f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:34.183062 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6494810-b1ed-4956-b335-c4374a28b40f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:34.183509 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6494810-b1ed-4956-b335-c4374a28b40f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:34.184302 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6494810-b1ed-4956-b335-c4374a28b40f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:34.184737 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6494810-b1ed-4956-b335-c4374a28b40f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:34.305861 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d6494810-b1ed-4956-b335-c4374a28b40f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:34.313649 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d6494810-b1ed-4956-b335-c4374a28b40f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.140866 Oct 15 03:47:34.314198 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 763/1421] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:34 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:34.735849 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-653f17fa-096a-4c76-aa29-ccc45488cc2a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:34.736760 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-653f17fa-096a-4c76-aa29-ccc45488cc2a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:34.742592 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-653f17fa-096a-4c76-aa29-ccc45488cc2a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:34.743079 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-653f17fa-096a-4c76-aa29-ccc45488cc2a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:34.743884 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-653f17fa-096a-4c76-aa29-ccc45488cc2a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:34.744316 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-653f17fa-096a-4c76-aa29-ccc45488cc2a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:34.772458 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-653f17fa-096a-4c76-aa29-ccc45488cc2a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040368 Oct 15 03:47:34.773142 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 659/1422] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:34 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:34.794960 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-27ae4c97-02a2-410e-83a4-3216b447dd45 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:34.796015 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-27ae4c97-02a2-410e-83a4-3216b447dd45 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:34.801637 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-27ae4c97-02a2-410e-83a4-3216b447dd45 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:34.802160 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-27ae4c97-02a2-410e-83a4-3216b447dd45 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:34.802989 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-27ae4c97-02a2-410e-83a4-3216b447dd45 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:34.803568 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-27ae4c97-02a2-410e-83a4-3216b447dd45 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:34.832853 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-27ae4c97-02a2-410e-83a4-3216b447dd45 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041574 Oct 15 03:47:34.833658 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 764/1423] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:34 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:35.330117 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-de06eb7c-54f2-4a6e-bf37-ec1b334ea717 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:35.330723 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-de06eb7c-54f2-4a6e-bf37-ec1b334ea717 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:35.336676 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-de06eb7c-54f2-4a6e-bf37-ec1b334ea717 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:35.337127 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-de06eb7c-54f2-4a6e-bf37-ec1b334ea717 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:35.337900 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-de06eb7c-54f2-4a6e-bf37-ec1b334ea717 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:35.338334 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-de06eb7c-54f2-4a6e-bf37-ec1b334ea717 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:35.453995 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-de06eb7c-54f2-4a6e-bf37-ec1b334ea717 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:35.461489 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-de06eb7c-54f2-4a6e-bf37-ec1b334ea717 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134983 Oct 15 03:47:35.462048 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 660/1424] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:35 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:35.783712 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2c046163-5be9-47c6-95a2-3d727a865bcb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:35.784616 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2c046163-5be9-47c6-95a2-3d727a865bcb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:35.790337 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2c046163-5be9-47c6-95a2-3d727a865bcb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:35.790780 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2c046163-5be9-47c6-95a2-3d727a865bcb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:35.791526 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2c046163-5be9-47c6-95a2-3d727a865bcb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:35.792651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2c046163-5be9-47c6-95a2-3d727a865bcb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:35.819842 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2c046163-5be9-47c6-95a2-3d727a865bcb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039959 Oct 15 03:47:35.823431 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 765/1425] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:35 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:35.844653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-02843238-7b4d-4ed4-bb0c-4712fb38d19a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:35.845556 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-02843238-7b4d-4ed4-bb0c-4712fb38d19a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:35.851516 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-02843238-7b4d-4ed4-bb0c-4712fb38d19a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:35.851975 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-02843238-7b4d-4ed4-bb0c-4712fb38d19a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:35.852729 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-02843238-7b4d-4ed4-bb0c-4712fb38d19a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:35.853158 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-02843238-7b4d-4ed4-bb0c-4712fb38d19a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:35.884903 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-02843238-7b4d-4ed4-bb0c-4712fb38d19a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043932 Oct 15 03:47:35.885452 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 661/1426] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:35 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:36.478243 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0c7e65f0-ffbd-4fde-8421-399cfb36ead2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:36.478839 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0c7e65f0-ffbd-4fde-8421-399cfb36ead2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:36.484552 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0c7e65f0-ffbd-4fde-8421-399cfb36ead2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:36.484934 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0c7e65f0-ffbd-4fde-8421-399cfb36ead2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:36.485680 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0c7e65f0-ffbd-4fde-8421-399cfb36ead2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:36.486105 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0c7e65f0-ffbd-4fde-8421-399cfb36ead2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:36.605886 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0c7e65f0-ffbd-4fde-8421-399cfb36ead2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:36.613110 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0c7e65f0-ffbd-4fde-8421-399cfb36ead2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138675 Oct 15 03:47:36.613662 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 766/1427] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:36 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:36.830383 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-12d749da-e63e-4967-95c5-865773b204a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:36.831285 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-12d749da-e63e-4967-95c5-865773b204a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:36.837735 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-12d749da-e63e-4967-95c5-865773b204a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:36.838176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-12d749da-e63e-4967-95c5-865773b204a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:36.838922 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-12d749da-e63e-4967-95c5-865773b204a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:36.839349 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-12d749da-e63e-4967-95c5-865773b204a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:36.868200 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-12d749da-e63e-4967-95c5-865773b204a7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041490 Oct 15 03:47:36.869356 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 662/1428] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:36 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:36.896184 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f83c35d6-f13d-46be-b9c0-a98c98f6638a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:36.897073 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f83c35d6-f13d-46be-b9c0-a98c98f6638a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:36.902982 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f83c35d6-f13d-46be-b9c0-a98c98f6638a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:36.903423 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f83c35d6-f13d-46be-b9c0-a98c98f6638a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:36.904400 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f83c35d6-f13d-46be-b9c0-a98c98f6638a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:36.904832 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f83c35d6-f13d-46be-b9c0-a98c98f6638a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:36.935052 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f83c35d6-f13d-46be-b9c0-a98c98f6638a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042522 Oct 15 03:47:36.935593 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 767/1429] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:36 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:37.630646 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8002a702-0297-40fe-aca1-d8f05d37052f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:37.631251 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8002a702-0297-40fe-aca1-d8f05d37052f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:37.637520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8002a702-0297-40fe-aca1-d8f05d37052f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:37.637968 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8002a702-0297-40fe-aca1-d8f05d37052f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:37.638733 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8002a702-0297-40fe-aca1-d8f05d37052f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:37.639161 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8002a702-0297-40fe-aca1-d8f05d37052f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:37.761361 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8002a702-0297-40fe-aca1-d8f05d37052f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:37.768474 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8002a702-0297-40fe-aca1-d8f05d37052f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.141490 Oct 15 03:47:37.769008 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 663/1430] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:37 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:37.879956 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-92781a62-4dde-4aa1-b6f9-5ad78cd5c3a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:37.880782 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-92781a62-4dde-4aa1-b6f9-5ad78cd5c3a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:37.886989 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-92781a62-4dde-4aa1-b6f9-5ad78cd5c3a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:37.887425 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-92781a62-4dde-4aa1-b6f9-5ad78cd5c3a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:37.888191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-92781a62-4dde-4aa1-b6f9-5ad78cd5c3a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:37.888615 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-92781a62-4dde-4aa1-b6f9-5ad78cd5c3a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:37.916584 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-92781a62-4dde-4aa1-b6f9-5ad78cd5c3a5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040435 Oct 15 03:47:37.917109 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 768/1431] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:37 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:37.946028 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-04e08698-e6fd-435c-852f-1506aaa788c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:37.946955 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-04e08698-e6fd-435c-852f-1506aaa788c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:37.953202 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-04e08698-e6fd-435c-852f-1506aaa788c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:37.953652 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-04e08698-e6fd-435c-852f-1506aaa788c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:37.954420 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-04e08698-e6fd-435c-852f-1506aaa788c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:37.954855 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-04e08698-e6fd-435c-852f-1506aaa788c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:37.983643 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-04e08698-e6fd-435c-852f-1506aaa788c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041325 Oct 15 03:47:37.984212 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 664/1432] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:37 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:38.785871 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-418e95e7-9a2e-402d-817d-6bf88d71527e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:38.786469 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-418e95e7-9a2e-402d-817d-6bf88d71527e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:38.792911 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-418e95e7-9a2e-402d-817d-6bf88d71527e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:38.793350 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-418e95e7-9a2e-402d-817d-6bf88d71527e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:38.794091 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-418e95e7-9a2e-402d-817d-6bf88d71527e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:38.794516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-418e95e7-9a2e-402d-817d-6bf88d71527e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:38.909418 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-418e95e7-9a2e-402d-817d-6bf88d71527e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:38.916465 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-418e95e7-9a2e-402d-817d-6bf88d71527e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134264 Oct 15 03:47:38.917577 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 769/1433] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:38 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:38.926979 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ac49829f-0a7d-489c-9fc1-f71cabfe7075 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:38.927942 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ac49829f-0a7d-489c-9fc1-f71cabfe7075 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:38.933566 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ac49829f-0a7d-489c-9fc1-f71cabfe7075 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:38.934011 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ac49829f-0a7d-489c-9fc1-f71cabfe7075 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:38.934797 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ac49829f-0a7d-489c-9fc1-f71cabfe7075 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:38.935232 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ac49829f-0a7d-489c-9fc1-f71cabfe7075 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:38.964202 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ac49829f-0a7d-489c-9fc1-f71cabfe7075 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040445 Oct 15 03:47:38.967941 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 665/1434] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:38 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:38.995566 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d1d4eb2d-7ef3-4768-8233-4e3d91ba9119 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:38.996520 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d1d4eb2d-7ef3-4768-8233-4e3d91ba9119 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:39.002459 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1d4eb2d-7ef3-4768-8233-4e3d91ba9119 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:39.002610 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1d4eb2d-7ef3-4768-8233-4e3d91ba9119 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:39.003378 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1d4eb2d-7ef3-4768-8233-4e3d91ba9119 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:39.003839 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1d4eb2d-7ef3-4768-8233-4e3d91ba9119 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:39.031993 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d1d4eb2d-7ef3-4768-8233-4e3d91ba9119 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040867 Oct 15 03:47:39.032533 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 770/1435] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:38 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:39.934490 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-09348e0b-ffd9-4bb5-99da-d473140be958 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:39.935092 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-09348e0b-ffd9-4bb5-99da-d473140be958 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:39.940875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09348e0b-ffd9-4bb5-99da-d473140be958 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:39.941318 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09348e0b-ffd9-4bb5-99da-d473140be958 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:39.942060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09348e0b-ffd9-4bb5-99da-d473140be958 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:39.942483 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09348e0b-ffd9-4bb5-99da-d473140be958 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:39.975436 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-dfb02492-44bf-43c8-aeeb-9ffb76595b99 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:39.976364 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-dfb02492-44bf-43c8-aeeb-9ffb76595b99 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:39.982652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfb02492-44bf-43c8-aeeb-9ffb76595b99 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:39.983100 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfb02492-44bf-43c8-aeeb-9ffb76595b99 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:39.983903 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfb02492-44bf-43c8-aeeb-9ffb76595b99 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:39.984332 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfb02492-44bf-43c8-aeeb-9ffb76595b99 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:40.014336 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-dfb02492-44bf-43c8-aeeb-9ffb76595b99 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042534 Oct 15 03:47:40.017330 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 771/1436] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:39 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:47:40.044224 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-45e9d38b-07c1-41de-80e3-a5aa402dc133 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:40.045179 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-45e9d38b-07c1-41de-80e3-a5aa402dc133 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:40.051233 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45e9d38b-07c1-41de-80e3-a5aa402dc133 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:40.051672 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45e9d38b-07c1-41de-80e3-a5aa402dc133 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:40.052972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45e9d38b-07c1-41de-80e3-a5aa402dc133 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:40.053546 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-45e9d38b-07c1-41de-80e3-a5aa402dc133 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:40.062640 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-09348e0b-ffd9-4bb5-99da-d473140be958 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:40.069899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-09348e0b-ffd9-4bb5-99da-d473140be958 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.139583 Oct 15 03:47:40.070461 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 666/1437] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:39 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:40.082880 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-45e9d38b-07c1-41de-80e3-a5aa402dc133 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043098 Oct 15 03:47:40.083765 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 772/1438] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:40 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:41.024786 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d3233616-1854-4405-abcd-6549802266dd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:41.025694 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d3233616-1854-4405-abcd-6549802266dd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:41.031919 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3233616-1854-4405-abcd-6549802266dd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:41.032369 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3233616-1854-4405-abcd-6549802266dd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:41.033131 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3233616-1854-4405-abcd-6549802266dd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:41.033565 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3233616-1854-4405-abcd-6549802266dd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:41.062725 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d3233616-1854-4405-abcd-6549802266dd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041553 Oct 15 03:47:41.063247 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 667/1439] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:41 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:41.092647 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-749c6a60-6c34-48e6-a487-00a834337a91 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:41.093321 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-749c6a60-6c34-48e6-a487-00a834337a91 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:41.094486 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ce5508e2-f35a-4652-889a-30c9ca6a9093 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:41.095388 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ce5508e2-f35a-4652-889a-30c9ca6a9093 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:41.099143 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-749c6a60-6c34-48e6-a487-00a834337a91 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:41.099739 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-749c6a60-6c34-48e6-a487-00a834337a91 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:41.100505 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-749c6a60-6c34-48e6-a487-00a834337a91 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:41.100932 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-749c6a60-6c34-48e6-a487-00a834337a91 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:41.101091 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce5508e2-f35a-4652-889a-30c9ca6a9093 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:41.101515 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce5508e2-f35a-4652-889a-30c9ca6a9093 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:41.102281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce5508e2-f35a-4652-889a-30c9ca6a9093 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:41.102711 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce5508e2-f35a-4652-889a-30c9ca6a9093 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:41.130970 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ce5508e2-f35a-4652-889a-30c9ca6a9093 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040071 Oct 15 03:47:41.131525 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 668/1440] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:41 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:47:41.227171 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-749c6a60-6c34-48e6-a487-00a834337a91 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:41.235077 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-749c6a60-6c34-48e6-a487-00a834337a91 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.146600 Oct 15 03:47:41.235668 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 773/1441] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:41 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:42.074486 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c4f168f5-a976-4f47-b711-32a4dab4f872 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:42.075431 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c4f168f5-a976-4f47-b711-32a4dab4f872 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:42.081210 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c4f168f5-a976-4f47-b711-32a4dab4f872 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:42.081662 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c4f168f5-a976-4f47-b711-32a4dab4f872 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:42.082454 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c4f168f5-a976-4f47-b711-32a4dab4f872 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:42.082893 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c4f168f5-a976-4f47-b711-32a4dab4f872 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:42.113831 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c4f168f5-a976-4f47-b711-32a4dab4f872 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043652 Oct 15 03:47:42.114386 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 669/1442] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:42 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:42.142293 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-94b21622-7bcf-4a85-b3c7-61e7b2098b5f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:42.143200 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-94b21622-7bcf-4a85-b3c7-61e7b2098b5f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:42.149024 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-94b21622-7bcf-4a85-b3c7-61e7b2098b5f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:42.149473 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-94b21622-7bcf-4a85-b3c7-61e7b2098b5f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:42.150298 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-94b21622-7bcf-4a85-b3c7-61e7b2098b5f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:42.150735 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-94b21622-7bcf-4a85-b3c7-61e7b2098b5f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:42.178803 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-94b21622-7bcf-4a85-b3c7-61e7b2098b5f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040406 Oct 15 03:47:42.179336 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 774/1443] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:42 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:42.252227 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1e89239f-5d5c-48c6-9a7f-ec0ae68e5679 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:42.252837 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1e89239f-5d5c-48c6-9a7f-ec0ae68e5679 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:42.258641 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1e89239f-5d5c-48c6-9a7f-ec0ae68e5679 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:42.259091 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1e89239f-5d5c-48c6-9a7f-ec0ae68e5679 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:42.259884 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1e89239f-5d5c-48c6-9a7f-ec0ae68e5679 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:42.260318 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1e89239f-5d5c-48c6-9a7f-ec0ae68e5679 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:42.376903 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-1e89239f-5d5c-48c6-9a7f-ec0ae68e5679 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:42.384574 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1e89239f-5d5c-48c6-9a7f-ec0ae68e5679 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135958 Oct 15 03:47:42.385127 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 670/1444] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:42 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:43.125634 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7e87b0fd-c88e-4456-a368-41df4a89a849 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:43.126546 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7e87b0fd-c88e-4456-a368-41df4a89a849 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:43.132277 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7e87b0fd-c88e-4456-a368-41df4a89a849 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:43.132723 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7e87b0fd-c88e-4456-a368-41df4a89a849 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:43.133478 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7e87b0fd-c88e-4456-a368-41df4a89a849 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:43.133909 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7e87b0fd-c88e-4456-a368-41df4a89a849 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:43.163010 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7e87b0fd-c88e-4456-a368-41df4a89a849 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041093 Oct 15 03:47:43.163849 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 775/1445] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:43 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:43.190094 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e1d416c8-9326-4d1d-9843-814aff5d06f0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:43.191054 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e1d416c8-9326-4d1d-9843-814aff5d06f0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:43.197246 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e1d416c8-9326-4d1d-9843-814aff5d06f0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:43.197689 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e1d416c8-9326-4d1d-9843-814aff5d06f0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:43.198434 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e1d416c8-9326-4d1d-9843-814aff5d06f0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:43.199362 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e1d416c8-9326-4d1d-9843-814aff5d06f0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:43.227590 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e1d416c8-9326-4d1d-9843-814aff5d06f0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041238 Oct 15 03:47:43.228146 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 671/1446] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:43 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:43.401255 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-56239cb4-d9db-4cc6-8756-353e8474d184 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:43.401807 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-56239cb4-d9db-4cc6-8756-353e8474d184 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:43.407516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-56239cb4-d9db-4cc6-8756-353e8474d184 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:43.407989 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-56239cb4-d9db-4cc6-8756-353e8474d184 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:43.408738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-56239cb4-d9db-4cc6-8756-353e8474d184 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:43.409168 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-56239cb4-d9db-4cc6-8756-353e8474d184 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:43.524643 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-56239cb4-d9db-4cc6-8756-353e8474d184 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:43.531750 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-56239cb4-d9db-4cc6-8756-353e8474d184 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134213 Oct 15 03:47:43.532297 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 776/1447] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:43 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:44.174530 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f478fe7f-afe2-4345-967b-edfc797ded18 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:44.175427 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f478fe7f-afe2-4345-967b-edfc797ded18 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:44.181204 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f478fe7f-afe2-4345-967b-edfc797ded18 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:44.181649 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f478fe7f-afe2-4345-967b-edfc797ded18 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:44.182396 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f478fe7f-afe2-4345-967b-edfc797ded18 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:44.182824 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f478fe7f-afe2-4345-967b-edfc797ded18 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:44.211218 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f478fe7f-afe2-4345-967b-edfc797ded18 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040402 Oct 15 03:47:44.211804 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 672/1448] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:44 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:44.239936 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c8c51dd9-e403-4a10-9a62-4f34f4ad0fad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:44.240848 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c8c51dd9-e403-4a10-9a62-4f34f4ad0fad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:44.246894 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c8c51dd9-e403-4a10-9a62-4f34f4ad0fad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:44.247335 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c8c51dd9-e403-4a10-9a62-4f34f4ad0fad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:44.248132 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c8c51dd9-e403-4a10-9a62-4f34f4ad0fad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:44.248565 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c8c51dd9-e403-4a10-9a62-4f34f4ad0fad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:44.277730 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c8c51dd9-e403-4a10-9a62-4f34f4ad0fad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041702 Oct 15 03:47:44.278302 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 777/1449] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:44 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:44.548327 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-471374d0-3a03-4445-b827-7ba7f6b18789 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:44.548935 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-471374d0-3a03-4445-b827-7ba7f6b18789 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:44.555073 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-471374d0-3a03-4445-b827-7ba7f6b18789 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:44.555618 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-471374d0-3a03-4445-b827-7ba7f6b18789 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:44.556408 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-471374d0-3a03-4445-b827-7ba7f6b18789 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:44.556892 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-471374d0-3a03-4445-b827-7ba7f6b18789 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:44.685966 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-471374d0-3a03-4445-b827-7ba7f6b18789 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:44.697633 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-471374d0-3a03-4445-b827-7ba7f6b18789 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.148417 Oct 15 03:47:44.697633 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 673/1450] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:44 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:45.226964 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e7ed1285-cf6c-4bf4-819c-2cdd0040f98a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:45.227891 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e7ed1285-cf6c-4bf4-819c-2cdd0040f98a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:45.235279 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e7ed1285-cf6c-4bf4-819c-2cdd0040f98a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:45.235747 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e7ed1285-cf6c-4bf4-819c-2cdd0040f98a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:45.236660 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e7ed1285-cf6c-4bf4-819c-2cdd0040f98a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:45.237091 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e7ed1285-cf6c-4bf4-819c-2cdd0040f98a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:45.265999 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e7ed1285-cf6c-4bf4-819c-2cdd0040f98a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046657 Oct 15 03:47:45.266553 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 778/1451] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:45 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:45.289015 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-44136f66-cac0-4019-ae2d-eb42521dd6bc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:45.289924 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-44136f66-cac0-4019-ae2d-eb42521dd6bc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:45.296134 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-44136f66-cac0-4019-ae2d-eb42521dd6bc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:45.296581 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-44136f66-cac0-4019-ae2d-eb42521dd6bc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:45.297335 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-44136f66-cac0-4019-ae2d-eb42521dd6bc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:45.297769 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-44136f66-cac0-4019-ae2d-eb42521dd6bc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:45.326479 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-44136f66-cac0-4019-ae2d-eb42521dd6bc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041181 Oct 15 03:47:45.327014 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 674/1452] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:45 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:47:45.710443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7566c938-91fd-4eb1-9c1b-d76ae6668e05 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:45.711055 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7566c938-91fd-4eb1-9c1b-d76ae6668e05 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:45.717177 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7566c938-91fd-4eb1-9c1b-d76ae6668e05 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:45.717631 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7566c938-91fd-4eb1-9c1b-d76ae6668e05 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:45.718388 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7566c938-91fd-4eb1-9c1b-d76ae6668e05 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:45.718820 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7566c938-91fd-4eb1-9c1b-d76ae6668e05 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:45.840307 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7566c938-91fd-4eb1-9c1b-d76ae6668e05 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:45.847340 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7566c938-91fd-4eb1-9c1b-d76ae6668e05 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.140802 Oct 15 03:47:45.847915 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 779/1453] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:45 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:46.276010 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9472d002-f150-42c8-b238-e8c01a6d855a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:46.276944 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9472d002-f150-42c8-b238-e8c01a6d855a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:46.282716 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9472d002-f150-42c8-b238-e8c01a6d855a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:46.283165 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9472d002-f150-42c8-b238-e8c01a6d855a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:46.283951 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9472d002-f150-42c8-b238-e8c01a6d855a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:46.284382 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9472d002-f150-42c8-b238-e8c01a6d855a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:46.312371 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9472d002-f150-42c8-b238-e8c01a6d855a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039994 Oct 15 03:47:46.312940 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 675/1454] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:46 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:46.338335 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4cd841d0-e015-4b8d-b9d5-4ea38f782a59 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:46.339289 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4cd841d0-e015-4b8d-b9d5-4ea38f782a59 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:46.345707 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4cd841d0-e015-4b8d-b9d5-4ea38f782a59 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:46.346213 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4cd841d0-e015-4b8d-b9d5-4ea38f782a59 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:46.347052 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4cd841d0-e015-4b8d-b9d5-4ea38f782a59 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:46.347504 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4cd841d0-e015-4b8d-b9d5-4ea38f782a59 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:46.377016 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4cd841d0-e015-4b8d-b9d5-4ea38f782a59 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042338 Oct 15 03:47:46.377560 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 780/1455] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:46 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:46.869480 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-04f5e0e5-71b5-46a0-849f-4da069e797b1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:46.870205 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-04f5e0e5-71b5-46a0-849f-4da069e797b1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:46.876933 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-04f5e0e5-71b5-46a0-849f-4da069e797b1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:46.877465 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-04f5e0e5-71b5-46a0-849f-4da069e797b1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:46.878333 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-04f5e0e5-71b5-46a0-849f-4da069e797b1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:46.879222 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-04f5e0e5-71b5-46a0-849f-4da069e797b1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:47.001403 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-04f5e0e5-71b5-46a0-849f-4da069e797b1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:47.011289 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-04f5e0e5-71b5-46a0-849f-4da069e797b1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.145642 Oct 15 03:47:47.011828 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 676/1456] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:46 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:47.315211 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0e266d85-e534-4710-afb0-692046f7d908 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:47.315717 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0e266d85-e534-4710-afb0-692046f7d908 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:47.321579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0e266d85-e534-4710-afb0-692046f7d908 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:47.322021 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0e266d85-e534-4710-afb0-692046f7d908 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:47.322774 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0e266d85-e534-4710-afb0-692046f7d908 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:47.323070 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-92c5959d-30dc-4126-8e6d-d4d5002c5e76 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:47.323538 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0e266d85-e534-4710-afb0-692046f7d908 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:47.324046 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-92c5959d-30dc-4126-8e6d-d4d5002c5e76 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:47.329648 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-92c5959d-30dc-4126-8e6d-d4d5002c5e76 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:47.330094 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-92c5959d-30dc-4126-8e6d-d4d5002c5e76 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:47.330849 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-92c5959d-30dc-4126-8e6d-d4d5002c5e76 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:47.331279 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-92c5959d-30dc-4126-8e6d-d4d5002c5e76 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:47.360872 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-92c5959d-30dc-4126-8e6d-d4d5002c5e76 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041384 Oct 15 03:47:47.361430 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 677/1457] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:47 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:47:47.389274 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-09bc8c34-83aa-4ed2-83c8-e4192393e92b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:47.390212 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-09bc8c34-83aa-4ed2-83c8-e4192393e92b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:47.395841 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09bc8c34-83aa-4ed2-83c8-e4192393e92b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:47.396292 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09bc8c34-83aa-4ed2-83c8-e4192393e92b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:47.397150 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09bc8c34-83aa-4ed2-83c8-e4192393e92b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:47.397589 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09bc8c34-83aa-4ed2-83c8-e4192393e92b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:47.404412 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.objects.instance [None req-0e266d85-e534-4710-afb0-692046f7d908 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lazy-loading 'services' on Instance uuid 828d646d-36c6-41b2-9e74-56a8ac3c1a73 {{(pid=120897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 03:47:47.426075 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-09bc8c34-83aa-4ed2-83c8-e4192393e92b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041148 Oct 15 03:47:47.426559 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 678/1458] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:47 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:47:47.475919 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0e266d85-e534-4710-afb0-692046f7d908 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "DELETE /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73/os-volume_attachments/6b19e4dd-22f3-4c5c-b826-a4abba8952e1" status: 202 len: 0 microversion: 2.1 time: 0.164181 Oct 15 03:47:47.476479 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 781/1459] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Oct 15 03:47:47 2021] DELETE /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73/os-volume_attachments/6b19e4dd-22f3-4c5c-b826-a4abba8952e1 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:47:48.028063 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f5710ca1-7e9f-48a8-a5b9-81de6b7e9faa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:48.028670 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f5710ca1-7e9f-48a8-a5b9-81de6b7e9faa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:48.034502 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f5710ca1-7e9f-48a8-a5b9-81de6b7e9faa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:48.034952 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f5710ca1-7e9f-48a8-a5b9-81de6b7e9faa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:48.035745 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f5710ca1-7e9f-48a8-a5b9-81de6b7e9faa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:48.036186 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f5710ca1-7e9f-48a8-a5b9-81de6b7e9faa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:48.156143 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f5710ca1-7e9f-48a8-a5b9-81de6b7e9faa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:48.163308 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f5710ca1-7e9f-48a8-a5b9-81de6b7e9faa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138884 Oct 15 03:47:48.163904 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 679/1460] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:48 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:48.373551 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8e05c9c8-fcd4-40a8-ba0d-3a93d9ad25a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:48.374547 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8e05c9c8-fcd4-40a8-ba0d-3a93d9ad25a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:48.380611 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8e05c9c8-fcd4-40a8-ba0d-3a93d9ad25a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:48.381056 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8e05c9c8-fcd4-40a8-ba0d-3a93d9ad25a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:48.381811 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8e05c9c8-fcd4-40a8-ba0d-3a93d9ad25a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:48.382245 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8e05c9c8-fcd4-40a8-ba0d-3a93d9ad25a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:48.409702 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8e05c9c8-fcd4-40a8-ba0d-3a93d9ad25a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041047 Oct 15 03:47:48.410295 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 782/1461] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:48 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:48.438060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b9dc456f-d2dc-4438-8da5-1a2df7d42cad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:48.438960 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b9dc456f-d2dc-4438-8da5-1a2df7d42cad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:48.444819 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b9dc456f-d2dc-4438-8da5-1a2df7d42cad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:48.445269 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b9dc456f-d2dc-4438-8da5-1a2df7d42cad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:48.446024 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b9dc456f-d2dc-4438-8da5-1a2df7d42cad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:48.446457 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b9dc456f-d2dc-4438-8da5-1a2df7d42cad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:48.474577 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b9dc456f-d2dc-4438-8da5-1a2df7d42cad tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040271 Oct 15 03:47:48.475104 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 680/1462] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:48 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:49.182197 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-64bb2a5a-ddd1-4c5e-903d-ddacd55bd47a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:49.182725 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-64bb2a5a-ddd1-4c5e-903d-ddacd55bd47a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:49.188576 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64bb2a5a-ddd1-4c5e-903d-ddacd55bd47a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:49.189027 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64bb2a5a-ddd1-4c5e-903d-ddacd55bd47a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:49.189783 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64bb2a5a-ddd1-4c5e-903d-ddacd55bd47a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:49.190220 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64bb2a5a-ddd1-4c5e-903d-ddacd55bd47a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:49.309199 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-64bb2a5a-ddd1-4c5e-903d-ddacd55bd47a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:49.318440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-64bb2a5a-ddd1-4c5e-903d-ddacd55bd47a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.139976 Oct 15 03:47:49.319163 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 783/1463] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:49 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:49.421149 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-baecc318-9c02-4187-87c8-c8cde9919775 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:49.422055 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-baecc318-9c02-4187-87c8-c8cde9919775 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:49.428151 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baecc318-9c02-4187-87c8-c8cde9919775 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:49.428600 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baecc318-9c02-4187-87c8-c8cde9919775 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:49.429379 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baecc318-9c02-4187-87c8-c8cde9919775 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:49.429807 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baecc318-9c02-4187-87c8-c8cde9919775 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:49.459933 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-baecc318-9c02-4187-87c8-c8cde9919775 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042484 Oct 15 03:47:49.460540 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 681/1464] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:49 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:47:49.486067 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8555aef0-33fe-4593-87cb-2df131d08466 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:49.486966 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8555aef0-33fe-4593-87cb-2df131d08466 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:49.492678 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8555aef0-33fe-4593-87cb-2df131d08466 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:49.493123 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8555aef0-33fe-4593-87cb-2df131d08466 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:49.493869 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8555aef0-33fe-4593-87cb-2df131d08466 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:49.494297 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8555aef0-33fe-4593-87cb-2df131d08466 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:49.523114 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8555aef0-33fe-4593-87cb-2df131d08466 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040683 Oct 15 03:47:49.523877 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 784/1465] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:49 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:50.336585 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c2023b46-b785-420c-8852-a64f3f6750de tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:50.337196 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c2023b46-b785-420c-8852-a64f3f6750de tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:50.343439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c2023b46-b785-420c-8852-a64f3f6750de tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:50.343935 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c2023b46-b785-420c-8852-a64f3f6750de tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:50.344709 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c2023b46-b785-420c-8852-a64f3f6750de tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:50.345145 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c2023b46-b785-420c-8852-a64f3f6750de tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:50.468322 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c2023b46-b785-420c-8852-a64f3f6750de tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:50.472081 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bfb0d80d-4487-4ea3-887a-27e946996ce7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:50.472998 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bfb0d80d-4487-4ea3-887a-27e946996ce7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:50.476088 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c2023b46-b785-420c-8852-a64f3f6750de tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.143417 Oct 15 03:47:50.476650 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 682/1466] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:50 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:50.478563 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bfb0d80d-4487-4ea3-887a-27e946996ce7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:50.479070 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bfb0d80d-4487-4ea3-887a-27e946996ce7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:50.479865 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bfb0d80d-4487-4ea3-887a-27e946996ce7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:50.480295 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bfb0d80d-4487-4ea3-887a-27e946996ce7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:50.507598 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bfb0d80d-4487-4ea3-887a-27e946996ce7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039163 Oct 15 03:47:50.508299 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 785/1467] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:50 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:47:50.536416 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c319c710-f255-486a-b31b-3af52e6fbf90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:50.537314 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c319c710-f255-486a-b31b-3af52e6fbf90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:50.543009 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c319c710-f255-486a-b31b-3af52e6fbf90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:50.543454 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c319c710-f255-486a-b31b-3af52e6fbf90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:50.544242 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c319c710-f255-486a-b31b-3af52e6fbf90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:50.544680 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c319c710-f255-486a-b31b-3af52e6fbf90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:50.573408 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c319c710-f255-486a-b31b-3af52e6fbf90 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040565 Oct 15 03:47:50.574567 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 683/1468] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:50 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:51.493018 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-facbd176-0626-4c6e-bc83-9b2492a6de81 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:51.493682 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-facbd176-0626-4c6e-bc83-9b2492a6de81 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:51.499528 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-facbd176-0626-4c6e-bc83-9b2492a6de81 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:51.500008 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-facbd176-0626-4c6e-bc83-9b2492a6de81 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:51.500766 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-facbd176-0626-4c6e-bc83-9b2492a6de81 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:51.501201 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-facbd176-0626-4c6e-bc83-9b2492a6de81 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:51.519199 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-04e4fde8-14af-4f9e-8207-8da50c8daf4b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:51.520135 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-04e4fde8-14af-4f9e-8207-8da50c8daf4b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:51.525739 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-04e4fde8-14af-4f9e-8207-8da50c8daf4b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:51.526188 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-04e4fde8-14af-4f9e-8207-8da50c8daf4b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:51.527452 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-04e4fde8-14af-4f9e-8207-8da50c8daf4b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:51.527911 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-04e4fde8-14af-4f9e-8207-8da50c8daf4b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:51.556847 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-04e4fde8-14af-4f9e-8207-8da50c8daf4b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041299 Oct 15 03:47:51.557401 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 684/1469] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:51 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:47:51.585930 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fd5f3464-6c81-40d3-a833-fd7308756c03 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:51.586837 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fd5f3464-6c81-40d3-a833-fd7308756c03 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:51.593175 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd5f3464-6c81-40d3-a833-fd7308756c03 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:51.593653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd5f3464-6c81-40d3-a833-fd7308756c03 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:51.594409 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd5f3464-6c81-40d3-a833-fd7308756c03 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:51.594843 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd5f3464-6c81-40d3-a833-fd7308756c03 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:51.623442 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-facbd176-0626-4c6e-bc83-9b2492a6de81 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:51.623949 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fd5f3464-6c81-40d3-a833-fd7308756c03 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041595 Oct 15 03:47:51.624133 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 685/1470] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:51 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:47:51.631077 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-facbd176-0626-4c6e-bc83-9b2492a6de81 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.141746 Oct 15 03:47:51.631619 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 786/1471] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:51 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:52.567387 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0d712cb7-8b69-465c-bb45-c4993c86aa63 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:52.568325 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0d712cb7-8b69-465c-bb45-c4993c86aa63 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:52.575041 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0d712cb7-8b69-465c-bb45-c4993c86aa63 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:52.575487 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0d712cb7-8b69-465c-bb45-c4993c86aa63 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:52.576268 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0d712cb7-8b69-465c-bb45-c4993c86aa63 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:52.576699 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0d712cb7-8b69-465c-bb45-c4993c86aa63 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:52.605962 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0d712cb7-8b69-465c-bb45-c4993c86aa63 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042291 Oct 15 03:47:52.606482 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 686/1472] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:52 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:52.634363 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-acefe98d-cd49-49c4-841e-65601c4c2aa5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:52.635316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-acefe98d-cd49-49c4-841e-65601c4c2aa5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:52.641279 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-acefe98d-cd49-49c4-841e-65601c4c2aa5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:52.641731 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-acefe98d-cd49-49c4-841e-65601c4c2aa5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:52.642573 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-acefe98d-cd49-49c4-841e-65601c4c2aa5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:52.642955 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-acefe98d-cd49-49c4-841e-65601c4c2aa5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:52.647488 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-95f04957-f9fa-4d2f-bba1-69fec411b940 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:52.648114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-95f04957-f9fa-4d2f-bba1-69fec411b940 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:52.653672 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-95f04957-f9fa-4d2f-bba1-69fec411b940 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:52.654111 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-95f04957-f9fa-4d2f-bba1-69fec411b940 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:52.654887 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-95f04957-f9fa-4d2f-bba1-69fec411b940 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:52.655311 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-95f04957-f9fa-4d2f-bba1-69fec411b940 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:52.671952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-acefe98d-cd49-49c4-841e-65601c4c2aa5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041420 Oct 15 03:47:52.672502 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 787/1473] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:52 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:52.778261 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-95f04957-f9fa-4d2f-bba1-69fec411b940 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:52.786615 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-95f04957-f9fa-4d2f-bba1-69fec411b940 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.142633 Oct 15 03:47:52.787175 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 687/1474] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:52 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:47:53.617508 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bf60e362-5972-4d5d-9435-17e9fb2ec587 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:53.618408 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bf60e362-5972-4d5d-9435-17e9fb2ec587 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:53.624148 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf60e362-5972-4d5d-9435-17e9fb2ec587 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:53.624590 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf60e362-5972-4d5d-9435-17e9fb2ec587 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:53.625337 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf60e362-5972-4d5d-9435-17e9fb2ec587 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:53.625766 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bf60e362-5972-4d5d-9435-17e9fb2ec587 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:53.656852 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bf60e362-5972-4d5d-9435-17e9fb2ec587 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043002 Oct 15 03:47:53.657503 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 788/1475] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:53 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:53.682311 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f5f20fc0-fa14-47ce-8d1a-0358ff5796b0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:53.683236 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f5f20fc0-fa14-47ce-8d1a-0358ff5796b0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:53.689207 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f5f20fc0-fa14-47ce-8d1a-0358ff5796b0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:53.689653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f5f20fc0-fa14-47ce-8d1a-0358ff5796b0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:53.690412 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f5f20fc0-fa14-47ce-8d1a-0358ff5796b0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:53.690844 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f5f20fc0-fa14-47ce-8d1a-0358ff5796b0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:53.719826 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f5f20fc0-fa14-47ce-8d1a-0358ff5796b0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041182 Oct 15 03:47:53.720376 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 688/1476] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:53 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:53.804211 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-362df00c-8f2f-4b0a-a4c4-af4197b29200 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:53.804813 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-362df00c-8f2f-4b0a-a4c4-af4197b29200 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:53.811206 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-362df00c-8f2f-4b0a-a4c4-af4197b29200 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:53.811653 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-362df00c-8f2f-4b0a-a4c4-af4197b29200 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:53.812436 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-362df00c-8f2f-4b0a-a4c4-af4197b29200 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:53.812864 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-362df00c-8f2f-4b0a-a4c4-af4197b29200 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:53.930910 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-362df00c-8f2f-4b0a-a4c4-af4197b29200 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:53.938556 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-362df00c-8f2f-4b0a-a4c4-af4197b29200 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138174 Oct 15 03:47:53.939140 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 789/1477] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:53 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:54.669285 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4f38404d-1e26-4bf3-9e46-15419b6701c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:54.670276 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4f38404d-1e26-4bf3-9e46-15419b6701c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:54.676462 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4f38404d-1e26-4bf3-9e46-15419b6701c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:54.676902 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4f38404d-1e26-4bf3-9e46-15419b6701c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:54.677649 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4f38404d-1e26-4bf3-9e46-15419b6701c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:54.678070 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4f38404d-1e26-4bf3-9e46-15419b6701c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:54.712779 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4f38404d-1e26-4bf3-9e46-15419b6701c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048198 Oct 15 03:47:54.713480 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 689/1478] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:54 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:54.730837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7555844b-48ff-4196-bfd4-62f844abd9d4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:54.731775 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7555844b-48ff-4196-bfd4-62f844abd9d4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:54.737459 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7555844b-48ff-4196-bfd4-62f844abd9d4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:54.737900 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7555844b-48ff-4196-bfd4-62f844abd9d4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:54.738649 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7555844b-48ff-4196-bfd4-62f844abd9d4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:54.739082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7555844b-48ff-4196-bfd4-62f844abd9d4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:54.768928 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7555844b-48ff-4196-bfd4-62f844abd9d4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042430 Oct 15 03:47:54.769470 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 790/1479] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:54 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:54.955231 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-35580732-4c04-4a52-951b-a84189657bbf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:54.955780 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-35580732-4c04-4a52-951b-a84189657bbf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:54.961770 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-35580732-4c04-4a52-951b-a84189657bbf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:54.962208 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-35580732-4c04-4a52-951b-a84189657bbf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:54.962958 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-35580732-4c04-4a52-951b-a84189657bbf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:54.963385 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-35580732-4c04-4a52-951b-a84189657bbf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:55.090097 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-35580732-4c04-4a52-951b-a84189657bbf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:55.097467 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-35580732-4c04-4a52-951b-a84189657bbf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.145887 Oct 15 03:47:55.098028 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 690/1480] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:54 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:55.724481 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cdfe95d5-114e-47f8-92a8-d3c1aaa2a46a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:55.725392 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cdfe95d5-114e-47f8-92a8-d3c1aaa2a46a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:55.731584 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cdfe95d5-114e-47f8-92a8-d3c1aaa2a46a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:55.732171 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cdfe95d5-114e-47f8-92a8-d3c1aaa2a46a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:55.732808 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cdfe95d5-114e-47f8-92a8-d3c1aaa2a46a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:55.733238 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cdfe95d5-114e-47f8-92a8-d3c1aaa2a46a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:55.762078 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cdfe95d5-114e-47f8-92a8-d3c1aaa2a46a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041250 Oct 15 03:47:55.762611 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 791/1481] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:55 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:55.780576 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-80f635a0-4bec-4e15-9cd8-1e7a73882b5c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:55.781496 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-80f635a0-4bec-4e15-9cd8-1e7a73882b5c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:55.787289 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-80f635a0-4bec-4e15-9cd8-1e7a73882b5c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:55.787780 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-80f635a0-4bec-4e15-9cd8-1e7a73882b5c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:55.788547 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-80f635a0-4bec-4e15-9cd8-1e7a73882b5c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:55.788984 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-80f635a0-4bec-4e15-9cd8-1e7a73882b5c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:55.817715 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-80f635a0-4bec-4e15-9cd8-1e7a73882b5c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041023 Oct 15 03:47:55.818304 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 691/1482] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:55 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:56.114135 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-edbf83a9-6e45-4ecc-bc54-08d9b398197d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:56.114670 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-edbf83a9-6e45-4ecc-bc54-08d9b398197d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:56.120324 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edbf83a9-6e45-4ecc-bc54-08d9b398197d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:56.120763 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edbf83a9-6e45-4ecc-bc54-08d9b398197d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:56.121515 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edbf83a9-6e45-4ecc-bc54-08d9b398197d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:56.121943 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edbf83a9-6e45-4ecc-bc54-08d9b398197d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:56.239694 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-edbf83a9-6e45-4ecc-bc54-08d9b398197d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:56.247760 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-edbf83a9-6e45-4ecc-bc54-08d9b398197d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.137273 Oct 15 03:47:56.248321 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 792/1483] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:56 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:56.773493 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4998c2d3-fb1d-48e9-a23c-4724b0c9eab5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:56.774392 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4998c2d3-fb1d-48e9-a23c-4724b0c9eab5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:56.780115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4998c2d3-fb1d-48e9-a23c-4724b0c9eab5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:56.780559 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4998c2d3-fb1d-48e9-a23c-4724b0c9eab5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:56.781308 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4998c2d3-fb1d-48e9-a23c-4724b0c9eab5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:56.781868 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4998c2d3-fb1d-48e9-a23c-4724b0c9eab5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:56.809329 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4998c2d3-fb1d-48e9-a23c-4724b0c9eab5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039670 Oct 15 03:47:56.809854 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 692/1484] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:56 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:56.829244 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6e928b90-3484-4ddd-a966-780834c27bbc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:56.830148 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6e928b90-3484-4ddd-a966-780834c27bbc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:56.836043 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6e928b90-3484-4ddd-a966-780834c27bbc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:56.836489 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6e928b90-3484-4ddd-a966-780834c27bbc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:56.837239 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6e928b90-3484-4ddd-a966-780834c27bbc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:56.837674 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6e928b90-3484-4ddd-a966-780834c27bbc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:56.865142 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6e928b90-3484-4ddd-a966-780834c27bbc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039674 Oct 15 03:47:56.865664 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 793/1485] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:56 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:57.264137 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-234e0341-6048-479c-a49c-f22abb2e32e7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:57.264741 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-234e0341-6048-479c-a49c-f22abb2e32e7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:57.270350 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-234e0341-6048-479c-a49c-f22abb2e32e7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:57.270792 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-234e0341-6048-479c-a49c-f22abb2e32e7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:57.271546 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-234e0341-6048-479c-a49c-f22abb2e32e7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:57.272000 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-234e0341-6048-479c-a49c-f22abb2e32e7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:57.388238 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-234e0341-6048-479c-a49c-f22abb2e32e7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:57.395593 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-234e0341-6048-479c-a49c-f22abb2e32e7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134985 Oct 15 03:47:57.396205 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 693/1486] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:57 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:57.820555 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-84481fe4-4171-4ad4-93be-46fdf08c307f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:57.821435 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-84481fe4-4171-4ad4-93be-46fdf08c307f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:57.827149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84481fe4-4171-4ad4-93be-46fdf08c307f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:57.827596 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84481fe4-4171-4ad4-93be-46fdf08c307f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:57.828382 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84481fe4-4171-4ad4-93be-46fdf08c307f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:57.828812 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84481fe4-4171-4ad4-93be-46fdf08c307f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:57.858827 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-84481fe4-4171-4ad4-93be-46fdf08c307f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042083 Oct 15 03:47:57.859490 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 794/1487] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:57 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:57.876233 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f812dfc3-c84d-4889-8f76-92471521bbf4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:57.877137 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f812dfc3-c84d-4889-8f76-92471521bbf4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:57.882753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f812dfc3-c84d-4889-8f76-92471521bbf4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:57.883201 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f812dfc3-c84d-4889-8f76-92471521bbf4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:57.883988 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f812dfc3-c84d-4889-8f76-92471521bbf4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:57.884426 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f812dfc3-c84d-4889-8f76-92471521bbf4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:57.913124 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f812dfc3-c84d-4889-8f76-92471521bbf4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040599 Oct 15 03:47:57.913655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 694/1488] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:57 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:58.412308 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6897fe6b-0ea9-4ac8-ad61-452fbe31e6f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:58.412906 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6897fe6b-0ea9-4ac8-ad61-452fbe31e6f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:58.419176 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6897fe6b-0ea9-4ac8-ad61-452fbe31e6f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:58.419614 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6897fe6b-0ea9-4ac8-ad61-452fbe31e6f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:58.420389 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6897fe6b-0ea9-4ac8-ad61-452fbe31e6f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:58.420843 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6897fe6b-0ea9-4ac8-ad61-452fbe31e6f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:58.539169 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6897fe6b-0ea9-4ac8-ad61-452fbe31e6f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:58.546848 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6897fe6b-0ea9-4ac8-ad61-452fbe31e6f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138114 Oct 15 03:47:58.547396 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 795/1489] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:58 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:58.870114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-975a65b6-27d5-4384-9c77-6b04306d928d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:58.870978 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-975a65b6-27d5-4384-9c77-6b04306d928d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:58.876805 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-975a65b6-27d5-4384-9c77-6b04306d928d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:58.877356 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-975a65b6-27d5-4384-9c77-6b04306d928d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:58.877997 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-975a65b6-27d5-4384-9c77-6b04306d928d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:58.878427 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-975a65b6-27d5-4384-9c77-6b04306d928d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:58.907114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-975a65b6-27d5-4384-9c77-6b04306d928d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040863 Oct 15 03:47:58.907645 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 695/1490] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:58 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:58.924117 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d4ca1f1d-0463-425d-9019-ddf1185b3351 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:58.925044 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d4ca1f1d-0463-425d-9019-ddf1185b3351 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:58.930638 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4ca1f1d-0463-425d-9019-ddf1185b3351 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:58.931082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4ca1f1d-0463-425d-9019-ddf1185b3351 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:58.932016 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4ca1f1d-0463-425d-9019-ddf1185b3351 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:58.932446 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4ca1f1d-0463-425d-9019-ddf1185b3351 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:58.960583 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d4ca1f1d-0463-425d-9019-ddf1185b3351 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040113 Oct 15 03:47:58.961104 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 796/1491] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:58 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:47:59.563547 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c5295202-ef50-4d95-881c-2f992d96d41e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:59.564129 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c5295202-ef50-4d95-881c-2f992d96d41e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:59.569834 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c5295202-ef50-4d95-881c-2f992d96d41e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:59.570271 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c5295202-ef50-4d95-881c-2f992d96d41e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:59.571016 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c5295202-ef50-4d95-881c-2f992d96d41e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:59.571445 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c5295202-ef50-4d95-881c-2f992d96d41e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:59.689137 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c5295202-ef50-4d95-881c-2f992d96d41e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:47:59.696179 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c5295202-ef50-4d95-881c-2f992d96d41e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.136281 Oct 15 03:47:59.696731 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 696/1492] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:47:59 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:47:59.918056 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e113cbab-bd55-47c9-8dc3-b4920ef9a0cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:59.918903 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e113cbab-bd55-47c9-8dc3-b4920ef9a0cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:59.924743 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e113cbab-bd55-47c9-8dc3-b4920ef9a0cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:59.925317 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e113cbab-bd55-47c9-8dc3-b4920ef9a0cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:59.925944 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e113cbab-bd55-47c9-8dc3-b4920ef9a0cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:59.926376 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e113cbab-bd55-47c9-8dc3-b4920ef9a0cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:59.954790 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e113cbab-bd55-47c9-8dc3-b4920ef9a0cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040911 Oct 15 03:47:59.955318 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 797/1493] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:47:59 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:47:59.972674 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3664f702-a3be-467b-b2a5-117a187a3dca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:47:59.973593 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3664f702-a3be-467b-b2a5-117a187a3dca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:47:59.979173 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3664f702-a3be-467b-b2a5-117a187a3dca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:59.979624 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3664f702-a3be-467b-b2a5-117a187a3dca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:47:59.980461 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3664f702-a3be-467b-b2a5-117a187a3dca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:47:59.980891 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3664f702-a3be-467b-b2a5-117a187a3dca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:00.009198 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3664f702-a3be-467b-b2a5-117a187a3dca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040536 Oct 15 03:48:00.009741 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 697/1494] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:47:59 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:00.713712 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1ec5cbc9-1ff2-46fd-b62c-03514c79650b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:00.714810 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1ec5cbc9-1ff2-46fd-b62c-03514c79650b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:00.720595 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1ec5cbc9-1ff2-46fd-b62c-03514c79650b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:00.721041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1ec5cbc9-1ff2-46fd-b62c-03514c79650b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:00.721780 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1ec5cbc9-1ff2-46fd-b62c-03514c79650b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:00.722204 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1ec5cbc9-1ff2-46fd-b62c-03514c79650b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:00.837678 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1ec5cbc9-1ff2-46fd-b62c-03514c79650b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:00.845258 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1ec5cbc9-1ff2-46fd-b62c-03514c79650b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135180 Oct 15 03:48:00.845805 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 798/1495] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:00 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:00.966826 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c73e64d3-81b9-464e-97d2-55d42e6461a9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:00.967959 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c73e64d3-81b9-464e-97d2-55d42e6461a9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:00.973605 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c73e64d3-81b9-464e-97d2-55d42e6461a9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:00.974176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c73e64d3-81b9-464e-97d2-55d42e6461a9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:00.974835 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c73e64d3-81b9-464e-97d2-55d42e6461a9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:00.975273 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c73e64d3-81b9-464e-97d2-55d42e6461a9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:01.003912 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c73e64d3-81b9-464e-97d2-55d42e6461a9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041463 Oct 15 03:48:01.004467 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 698/1496] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:00 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:01.021099 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3fbbd2a1-e315-4f12-be59-eb3fb75d4edd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:01.022016 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3fbbd2a1-e315-4f12-be59-eb3fb75d4edd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:01.028395 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3fbbd2a1-e315-4f12-be59-eb3fb75d4edd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:01.028833 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3fbbd2a1-e315-4f12-be59-eb3fb75d4edd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:01.029579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3fbbd2a1-e315-4f12-be59-eb3fb75d4edd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:01.030007 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3fbbd2a1-e315-4f12-be59-eb3fb75d4edd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:01.057385 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3fbbd2a1-e315-4f12-be59-eb3fb75d4edd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040004 Oct 15 03:48:01.057844 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 799/1497] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:01 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:01.863397 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9ba72f7e-748a-4523-8356-ac07997954f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:01.864041 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9ba72f7e-748a-4523-8356-ac07997954f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:01.869940 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ba72f7e-748a-4523-8356-ac07997954f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:01.870972 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ba72f7e-748a-4523-8356-ac07997954f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:01.871766 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ba72f7e-748a-4523-8356-ac07997954f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:01.872207 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ba72f7e-748a-4523-8356-ac07997954f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:01.992028 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-9ba72f7e-748a-4523-8356-ac07997954f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:01.999111 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9ba72f7e-748a-4523-8356-ac07997954f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.140401 Oct 15 03:48:01.999671 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 699/1498] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:01 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:48:02.014169 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5633633f-9229-4e23-b3ac-25aa3c2d43bc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:02.015079 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5633633f-9229-4e23-b3ac-25aa3c2d43bc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:02.020921 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5633633f-9229-4e23-b3ac-25aa3c2d43bc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:02.021378 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5633633f-9229-4e23-b3ac-25aa3c2d43bc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:02.022138 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5633633f-9229-4e23-b3ac-25aa3c2d43bc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:02.022572 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5633633f-9229-4e23-b3ac-25aa3c2d43bc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:02.050775 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5633633f-9229-4e23-b3ac-25aa3c2d43bc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040447 Oct 15 03:48:02.051313 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 800/1499] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:02 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:02.068020 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6be3a9f2-0ef7-4ee1-b7e9-d57c941dc7c5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:02.069034 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6be3a9f2-0ef7-4ee1-b7e9-d57c941dc7c5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:02.075287 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6be3a9f2-0ef7-4ee1-b7e9-d57c941dc7c5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:02.075799 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6be3a9f2-0ef7-4ee1-b7e9-d57c941dc7c5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:02.076548 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6be3a9f2-0ef7-4ee1-b7e9-d57c941dc7c5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:02.076973 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6be3a9f2-0ef7-4ee1-b7e9-d57c941dc7c5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:02.110151 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6be3a9f2-0ef7-4ee1-b7e9-d57c941dc7c5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045733 Oct 15 03:48:02.110594 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 700/1500] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:02 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:03.016321 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ff05e76d-a8dd-49d6-97ea-759f5c7220aa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:03.016928 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ff05e76d-a8dd-49d6-97ea-759f5c7220aa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:03.022614 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff05e76d-a8dd-49d6-97ea-759f5c7220aa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:03.023178 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff05e76d-a8dd-49d6-97ea-759f5c7220aa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:03.024075 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff05e76d-a8dd-49d6-97ea-759f5c7220aa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:03.024503 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff05e76d-a8dd-49d6-97ea-759f5c7220aa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:03.062322 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b09667ef-35c8-4d59-9682-29635dd00a01 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:03.063218 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b09667ef-35c8-4d59-9682-29635dd00a01 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:03.068860 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b09667ef-35c8-4d59-9682-29635dd00a01 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:03.069303 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b09667ef-35c8-4d59-9682-29635dd00a01 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:03.070062 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b09667ef-35c8-4d59-9682-29635dd00a01 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:03.070488 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b09667ef-35c8-4d59-9682-29635dd00a01 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:03.099276 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b09667ef-35c8-4d59-9682-29635dd00a01 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040532 Oct 15 03:48:03.100139 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 701/1501] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:03 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:48:03.121641 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8fafa9fc-ce9f-4e77-85dc-4c011ffa5144 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:03.122577 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8fafa9fc-ce9f-4e77-85dc-4c011ffa5144 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:03.128111 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8fafa9fc-ce9f-4e77-85dc-4c011ffa5144 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:03.128559 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8fafa9fc-ce9f-4e77-85dc-4c011ffa5144 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:03.129313 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8fafa9fc-ce9f-4e77-85dc-4c011ffa5144 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:03.129740 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8fafa9fc-ce9f-4e77-85dc-4c011ffa5144 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:03.143023 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ff05e76d-a8dd-49d6-97ea-759f5c7220aa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:03.150162 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ff05e76d-a8dd-49d6-97ea-759f5c7220aa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.137396 Oct 15 03:48:03.150716 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 801/1502] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:03 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:03.157503 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8fafa9fc-ce9f-4e77-85dc-4c011ffa5144 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040027 Oct 15 03:48:03.158030 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 702/1503] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:03 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:48:04.110888 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4ed7bdf7-07a1-48d8-8618-61e4dfcfa032 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:04.115008 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4ed7bdf7-07a1-48d8-8618-61e4dfcfa032 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:04.118240 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4ed7bdf7-07a1-48d8-8618-61e4dfcfa032 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:04.118690 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4ed7bdf7-07a1-48d8-8618-61e4dfcfa032 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:04.119467 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4ed7bdf7-07a1-48d8-8618-61e4dfcfa032 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:04.120051 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4ed7bdf7-07a1-48d8-8618-61e4dfcfa032 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:04.149022 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4ed7bdf7-07a1-48d8-8618-61e4dfcfa032 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041993 Oct 15 03:48:04.149558 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 802/1504] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:04 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:04.165855 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e7e60d84-0876-453e-a17c-ba9cb06962fc tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:04.166488 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e7e60d84-0876-453e-a17c-ba9cb06962fc tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:04.168655 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5918b3d8-e222-4586-b333-f8fe97061a5d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:04.169544 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5918b3d8-e222-4586-b333-f8fe97061a5d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:04.172749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7e60d84-0876-453e-a17c-ba9cb06962fc tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:04.173192 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7e60d84-0876-453e-a17c-ba9cb06962fc tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:04.173951 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7e60d84-0876-453e-a17c-ba9cb06962fc tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:04.174373 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7e60d84-0876-453e-a17c-ba9cb06962fc tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:04.175026 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5918b3d8-e222-4586-b333-f8fe97061a5d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:04.175476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5918b3d8-e222-4586-b333-f8fe97061a5d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:04.176258 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5918b3d8-e222-4586-b333-f8fe97061a5d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:04.176693 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5918b3d8-e222-4586-b333-f8fe97061a5d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:04.207268 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5918b3d8-e222-4586-b333-f8fe97061a5d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042492 Oct 15 03:48:04.208127 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 803/1505] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:04 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:48:04.293961 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e7e60d84-0876-453e-a17c-ba9cb06962fc tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:04.301243 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e7e60d84-0876-453e-a17c-ba9cb06962fc tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138981 Oct 15 03:48:04.302107 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 703/1506] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:04 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:05.160477 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3bf83bd6-45f7-4ca8-899f-8601009be60c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:05.161314 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3bf83bd6-45f7-4ca8-899f-8601009be60c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:05.167094 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3bf83bd6-45f7-4ca8-899f-8601009be60c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:05.167546 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3bf83bd6-45f7-4ca8-899f-8601009be60c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:05.168338 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3bf83bd6-45f7-4ca8-899f-8601009be60c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:05.168773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3bf83bd6-45f7-4ca8-899f-8601009be60c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:05.196876 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3bf83bd6-45f7-4ca8-899f-8601009be60c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040342 Oct 15 03:48:05.197407 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 804/1507] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:05 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:05.219530 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c48a880a-3d64-40d6-8980-780248b6b3f0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:05.220455 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c48a880a-3d64-40d6-8980-780248b6b3f0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:05.226283 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c48a880a-3d64-40d6-8980-780248b6b3f0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:05.226729 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c48a880a-3d64-40d6-8980-780248b6b3f0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:05.227485 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c48a880a-3d64-40d6-8980-780248b6b3f0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:05.227943 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c48a880a-3d64-40d6-8980-780248b6b3f0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:05.256330 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c48a880a-3d64-40d6-8980-780248b6b3f0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040471 Oct 15 03:48:05.256878 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 704/1508] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:05 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:05.317975 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fbb86d7e-2763-4860-b453-6092a9c6ed4e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:05.318586 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fbb86d7e-2763-4860-b453-6092a9c6ed4e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:05.325057 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fbb86d7e-2763-4860-b453-6092a9c6ed4e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:05.325505 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fbb86d7e-2763-4860-b453-6092a9c6ed4e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:05.326264 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fbb86d7e-2763-4860-b453-6092a9c6ed4e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:05.326701 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fbb86d7e-2763-4860-b453-6092a9c6ed4e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:05.445954 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fbb86d7e-2763-4860-b453-6092a9c6ed4e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:05.453081 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fbb86d7e-2763-4860-b453-6092a9c6ed4e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138809 Oct 15 03:48:05.453635 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 805/1509] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:05 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:06.209169 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f6ef1304-e9a4-4349-ad5c-d8bd9f3b0166 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:06.210089 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f6ef1304-e9a4-4349-ad5c-d8bd9f3b0166 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:06.216479 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f6ef1304-e9a4-4349-ad5c-d8bd9f3b0166 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:06.216931 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f6ef1304-e9a4-4349-ad5c-d8bd9f3b0166 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:06.217686 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f6ef1304-e9a4-4349-ad5c-d8bd9f3b0166 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:06.218120 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f6ef1304-e9a4-4349-ad5c-d8bd9f3b0166 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:06.246837 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f6ef1304-e9a4-4349-ad5c-d8bd9f3b0166 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041792 Oct 15 03:48:06.247799 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 705/1510] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:06 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:06.267377 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0eaaa1af-ecb3-4ee3-8bbc-35e289eb4f52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:06.268324 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0eaaa1af-ecb3-4ee3-8bbc-35e289eb4f52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:06.274007 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0eaaa1af-ecb3-4ee3-8bbc-35e289eb4f52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:06.274451 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0eaaa1af-ecb3-4ee3-8bbc-35e289eb4f52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:06.275202 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0eaaa1af-ecb3-4ee3-8bbc-35e289eb4f52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:06.275636 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0eaaa1af-ecb3-4ee3-8bbc-35e289eb4f52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:06.303593 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0eaaa1af-ecb3-4ee3-8bbc-35e289eb4f52 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039922 Oct 15 03:48:06.304149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 806/1511] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:06 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:06.470067 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ae94e67d-af72-4773-a47c-25d9c6ebfd47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:06.470673 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ae94e67d-af72-4773-a47c-25d9c6ebfd47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:06.476321 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae94e67d-af72-4773-a47c-25d9c6ebfd47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:06.476772 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae94e67d-af72-4773-a47c-25d9c6ebfd47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:06.477537 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae94e67d-af72-4773-a47c-25d9c6ebfd47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:06.477976 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae94e67d-af72-4773-a47c-25d9c6ebfd47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:06.596710 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ae94e67d-af72-4773-a47c-25d9c6ebfd47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:06.605796 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ae94e67d-af72-4773-a47c-25d9c6ebfd47 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.139275 Oct 15 03:48:06.606358 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 706/1512] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:06 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:07.258140 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d5a18e17-6595-4a0f-9f5d-875fb931c276 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:07.259069 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d5a18e17-6595-4a0f-9f5d-875fb931c276 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:07.264798 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d5a18e17-6595-4a0f-9f5d-875fb931c276 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:07.265251 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d5a18e17-6595-4a0f-9f5d-875fb931c276 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:07.266019 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d5a18e17-6595-4a0f-9f5d-875fb931c276 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:07.266458 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d5a18e17-6595-4a0f-9f5d-875fb931c276 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:07.295383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d5a18e17-6595-4a0f-9f5d-875fb931c276 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041077 Oct 15 03:48:07.296012 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 807/1513] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:07 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:07.314098 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8a61ee2a-c97a-4b9c-b129-75cfe3d8844f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:07.314996 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8a61ee2a-c97a-4b9c-b129-75cfe3d8844f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:07.320664 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8a61ee2a-c97a-4b9c-b129-75cfe3d8844f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:07.321114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8a61ee2a-c97a-4b9c-b129-75cfe3d8844f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:07.321858 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8a61ee2a-c97a-4b9c-b129-75cfe3d8844f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:07.322285 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8a61ee2a-c97a-4b9c-b129-75cfe3d8844f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:07.350414 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8a61ee2a-c97a-4b9c-b129-75cfe3d8844f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040070 Oct 15 03:48:07.350938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 707/1514] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:07 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:07.623266 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5295e1ca-021d-418a-9397-d9bd928b9d97 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:07.623822 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5295e1ca-021d-418a-9397-d9bd928b9d97 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:07.629424 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5295e1ca-021d-418a-9397-d9bd928b9d97 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:07.629869 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5295e1ca-021d-418a-9397-d9bd928b9d97 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:07.630617 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5295e1ca-021d-418a-9397-d9bd928b9d97 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:07.631044 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5295e1ca-021d-418a-9397-d9bd928b9d97 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:07.747644 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5295e1ca-021d-418a-9397-d9bd928b9d97 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:07.754782 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5295e1ca-021d-418a-9397-d9bd928b9d97 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135507 Oct 15 03:48:07.755326 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 808/1515] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:07 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:08.306395 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-550a2d53-c6b6-49be-bd08-937de7e64625 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:08.307822 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-550a2d53-c6b6-49be-bd08-937de7e64625 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:08.313612 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-550a2d53-c6b6-49be-bd08-937de7e64625 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:08.314057 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-550a2d53-c6b6-49be-bd08-937de7e64625 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:08.314818 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-550a2d53-c6b6-49be-bd08-937de7e64625 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:08.315350 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-550a2d53-c6b6-49be-bd08-937de7e64625 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:08.343909 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-550a2d53-c6b6-49be-bd08-937de7e64625 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041230 Oct 15 03:48:08.344445 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 708/1516] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:08 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:08.361514 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-547ff685-f4fc-4c4f-8856-87296ef5472c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:08.362545 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-547ff685-f4fc-4c4f-8856-87296ef5472c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:08.368237 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-547ff685-f4fc-4c4f-8856-87296ef5472c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:08.368686 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-547ff685-f4fc-4c4f-8856-87296ef5472c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:08.369437 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-547ff685-f4fc-4c4f-8856-87296ef5472c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:08.370506 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-547ff685-f4fc-4c4f-8856-87296ef5472c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:08.398435 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-547ff685-f4fc-4c4f-8856-87296ef5472c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040642 Oct 15 03:48:08.398967 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 809/1517] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:08 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:08.773254 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6322b72f-55d1-4bce-935c-767d62d19d97 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:08.774124 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6322b72f-55d1-4bce-935c-767d62d19d97 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:08.782538 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6322b72f-55d1-4bce-935c-767d62d19d97 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:08.782984 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6322b72f-55d1-4bce-935c-767d62d19d97 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:08.783763 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6322b72f-55d1-4bce-935c-767d62d19d97 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:08.784195 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6322b72f-55d1-4bce-935c-767d62d19d97 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:08.904493 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6322b72f-55d1-4bce-935c-767d62d19d97 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:08.911717 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6322b72f-55d1-4bce-935c-767d62d19d97 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.142800 Oct 15 03:48:08.912275 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 709/1518] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:08 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:09.355034 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c7d73f82-1d96-4b0d-be3d-60fc94138507 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:09.355958 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c7d73f82-1d96-4b0d-be3d-60fc94138507 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:09.361841 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c7d73f82-1d96-4b0d-be3d-60fc94138507 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:09.362394 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c7d73f82-1d96-4b0d-be3d-60fc94138507 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:09.363104 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c7d73f82-1d96-4b0d-be3d-60fc94138507 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:09.363537 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c7d73f82-1d96-4b0d-be3d-60fc94138507 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:09.391592 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c7d73f82-1d96-4b0d-be3d-60fc94138507 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040314 Oct 15 03:48:09.392147 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 810/1519] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:09 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:09.409590 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-bc5b0a41-c329-4176-b69e-51342e426cf4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:09.410491 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-bc5b0a41-c329-4176-b69e-51342e426cf4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:09.416175 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bc5b0a41-c329-4176-b69e-51342e426cf4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:09.416622 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bc5b0a41-c329-4176-b69e-51342e426cf4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:09.417414 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bc5b0a41-c329-4176-b69e-51342e426cf4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:09.417847 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bc5b0a41-c329-4176-b69e-51342e426cf4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:09.446149 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-bc5b0a41-c329-4176-b69e-51342e426cf4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040309 Oct 15 03:48:09.446687 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 710/1520] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:09 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:09.928658 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-85d54bac-3aa6-4eac-ac31-8bcb4b10fc2e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:09.929260 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-85d54bac-3aa6-4eac-ac31-8bcb4b10fc2e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:09.935595 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-85d54bac-3aa6-4eac-ac31-8bcb4b10fc2e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:09.936079 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-85d54bac-3aa6-4eac-ac31-8bcb4b10fc2e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:09.936870 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-85d54bac-3aa6-4eac-ac31-8bcb4b10fc2e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:09.937305 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-85d54bac-3aa6-4eac-ac31-8bcb4b10fc2e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:10.052506 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-85d54bac-3aa6-4eac-ac31-8bcb4b10fc2e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:10.060265 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-85d54bac-3aa6-4eac-ac31-8bcb4b10fc2e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135162 Oct 15 03:48:10.060818 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 811/1521] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:09 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:10.403216 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-dbb54659-db7a-4672-81ee-6a108141f3c0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:10.404144 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-dbb54659-db7a-4672-81ee-6a108141f3c0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:10.409947 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dbb54659-db7a-4672-81ee-6a108141f3c0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:10.410508 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dbb54659-db7a-4672-81ee-6a108141f3c0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:10.411138 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dbb54659-db7a-4672-81ee-6a108141f3c0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:10.411569 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dbb54659-db7a-4672-81ee-6a108141f3c0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:10.439510 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-dbb54659-db7a-4672-81ee-6a108141f3c0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040599 Oct 15 03:48:10.440083 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 711/1522] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:10 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:48:10.457996 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-531239ee-82ef-4bc9-abd8-0afbe73251ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:10.458901 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-531239ee-82ef-4bc9-abd8-0afbe73251ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:10.465098 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-531239ee-82ef-4bc9-abd8-0afbe73251ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:10.465536 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-531239ee-82ef-4bc9-abd8-0afbe73251ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:10.466284 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-531239ee-82ef-4bc9-abd8-0afbe73251ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:10.466713 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-531239ee-82ef-4bc9-abd8-0afbe73251ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:10.494602 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-531239ee-82ef-4bc9-abd8-0afbe73251ee tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040514 Oct 15 03:48:10.495090 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 812/1523] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:10 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:11.077520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-afd7c5f2-74e8-439b-b378-508870ef0f8a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:11.078064 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-afd7c5f2-74e8-439b-b378-508870ef0f8a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:11.084120 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-afd7c5f2-74e8-439b-b378-508870ef0f8a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:11.084576 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-afd7c5f2-74e8-439b-b378-508870ef0f8a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:11.085363 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-afd7c5f2-74e8-439b-b378-508870ef0f8a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:11.085800 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-afd7c5f2-74e8-439b-b378-508870ef0f8a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:11.200775 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-afd7c5f2-74e8-439b-b378-508870ef0f8a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:11.208273 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-afd7c5f2-74e8-439b-b378-508870ef0f8a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134826 Oct 15 03:48:11.209019 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 712/1524] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:11 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:11.450706 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-994c7b34-41d5-4ee1-b969-5f1952eced80 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:11.451549 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-994c7b34-41d5-4ee1-b969-5f1952eced80 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:11.457338 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-994c7b34-41d5-4ee1-b969-5f1952eced80 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:11.458045 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-994c7b34-41d5-4ee1-b969-5f1952eced80 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:11.458795 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-994c7b34-41d5-4ee1-b969-5f1952eced80 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:11.459224 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-994c7b34-41d5-4ee1-b969-5f1952eced80 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:11.487104 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-994c7b34-41d5-4ee1-b969-5f1952eced80 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040252 Oct 15 03:48:11.487632 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 813/1525] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:11 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:48:11.505986 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9a3d21c8-1077-4fd5-86c9-d9d3bf6c8d0e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:11.506888 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9a3d21c8-1077-4fd5-86c9-d9d3bf6c8d0e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:11.512592 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9a3d21c8-1077-4fd5-86c9-d9d3bf6c8d0e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:11.513037 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9a3d21c8-1077-4fd5-86c9-d9d3bf6c8d0e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:11.513791 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9a3d21c8-1077-4fd5-86c9-d9d3bf6c8d0e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:11.514220 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9a3d21c8-1077-4fd5-86c9-d9d3bf6c8d0e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:11.542040 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9a3d21c8-1077-4fd5-86c9-d9d3bf6c8d0e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039297 Oct 15 03:48:11.542578 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 713/1526] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:11 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:12.225084 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f0c97445-df16-4d3d-a497-7cc0788fd03a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:12.225624 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f0c97445-df16-4d3d-a497-7cc0788fd03a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:12.231919 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f0c97445-df16-4d3d-a497-7cc0788fd03a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:12.232371 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f0c97445-df16-4d3d-a497-7cc0788fd03a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:12.233133 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f0c97445-df16-4d3d-a497-7cc0788fd03a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:12.233572 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f0c97445-df16-4d3d-a497-7cc0788fd03a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:12.352034 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f0c97445-df16-4d3d-a497-7cc0788fd03a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:12.360760 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f0c97445-df16-4d3d-a497-7cc0788fd03a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.139359 Oct 15 03:48:12.361314 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 814/1527] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:12 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:12.497733 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e50bd361-5638-48cf-9cba-7af1727f8ed9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:12.498956 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e50bd361-5638-48cf-9cba-7af1727f8ed9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:12.504602 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e50bd361-5638-48cf-9cba-7af1727f8ed9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:12.505047 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e50bd361-5638-48cf-9cba-7af1727f8ed9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:12.505801 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e50bd361-5638-48cf-9cba-7af1727f8ed9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:12.506227 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e50bd361-5638-48cf-9cba-7af1727f8ed9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:12.534033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e50bd361-5638-48cf-9cba-7af1727f8ed9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040154 Oct 15 03:48:12.534560 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 714/1528] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:12 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:12.553055 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2dba2db4-54d0-4e5e-9f8a-152efb32594c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:12.553954 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2dba2db4-54d0-4e5e-9f8a-152efb32594c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:12.559564 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2dba2db4-54d0-4e5e-9f8a-152efb32594c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:12.560038 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2dba2db4-54d0-4e5e-9f8a-152efb32594c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:12.560785 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2dba2db4-54d0-4e5e-9f8a-152efb32594c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:12.561213 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2dba2db4-54d0-4e5e-9f8a-152efb32594c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:12.589222 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2dba2db4-54d0-4e5e-9f8a-152efb32594c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039381 Oct 15 03:48:12.589739 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 815/1529] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:12 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:13.377994 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1a0622b0-4882-4636-ba68-d3ef9b387a1f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:13.378629 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1a0622b0-4882-4636-ba68-d3ef9b387a1f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:13.384433 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1a0622b0-4882-4636-ba68-d3ef9b387a1f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:13.384875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1a0622b0-4882-4636-ba68-d3ef9b387a1f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:13.386233 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1a0622b0-4882-4636-ba68-d3ef9b387a1f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:13.386662 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1a0622b0-4882-4636-ba68-d3ef9b387a1f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:13.500989 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-1a0622b0-4882-4636-ba68-d3ef9b387a1f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:13.508054 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1a0622b0-4882-4636-ba68-d3ef9b387a1f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.133670 Oct 15 03:48:13.508625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 715/1530] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:13 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:13.545255 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a05135b1-dc95-40dc-9777-982b918f6f1a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:13.546170 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a05135b1-dc95-40dc-9777-982b918f6f1a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:13.551884 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a05135b1-dc95-40dc-9777-982b918f6f1a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:13.552337 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a05135b1-dc95-40dc-9777-982b918f6f1a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:13.553095 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a05135b1-dc95-40dc-9777-982b918f6f1a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:13.553609 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a05135b1-dc95-40dc-9777-982b918f6f1a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:13.582253 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a05135b1-dc95-40dc-9777-982b918f6f1a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040843 Oct 15 03:48:13.583047 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 816/1531] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:13 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:13.600231 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-977c2846-d6fc-4d09-ad52-c23374517458 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:13.601137 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-977c2846-d6fc-4d09-ad52-c23374517458 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:13.607256 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-977c2846-d6fc-4d09-ad52-c23374517458 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:13.607731 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-977c2846-d6fc-4d09-ad52-c23374517458 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:13.608568 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-977c2846-d6fc-4d09-ad52-c23374517458 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:13.609006 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-977c2846-d6fc-4d09-ad52-c23374517458 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:13.637318 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-977c2846-d6fc-4d09-ad52-c23374517458 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040764 Oct 15 03:48:13.637851 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 716/1532] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:13 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:14.524745 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e0a6ec57-f72e-45cd-bafc-933ce4012252 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:14.525346 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e0a6ec57-f72e-45cd-bafc-933ce4012252 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:14.531631 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0a6ec57-f72e-45cd-bafc-933ce4012252 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:14.532094 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0a6ec57-f72e-45cd-bafc-933ce4012252 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:14.532884 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0a6ec57-f72e-45cd-bafc-933ce4012252 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:14.533311 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0a6ec57-f72e-45cd-bafc-933ce4012252 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:14.594251 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4e0144ec-6e45-4fd7-8e2c-b8d9269f750e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:14.595342 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4e0144ec-6e45-4fd7-8e2c-b8d9269f750e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:14.600927 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4e0144ec-6e45-4fd7-8e2c-b8d9269f750e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:14.601365 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4e0144ec-6e45-4fd7-8e2c-b8d9269f750e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:14.602114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4e0144ec-6e45-4fd7-8e2c-b8d9269f750e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:14.602541 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4e0144ec-6e45-4fd7-8e2c-b8d9269f750e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:14.631111 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4e0144ec-6e45-4fd7-8e2c-b8d9269f750e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040536 Oct 15 03:48:14.631662 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 717/1533] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:14 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:48:14.648239 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3735c886-961e-4e6c-a8fa-ca71e50d6484 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:14.649134 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3735c886-961e-4e6c-a8fa-ca71e50d6484 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:14.652984 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e0a6ec57-f72e-45cd-bafc-933ce4012252 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:14.655419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3735c886-961e-4e6c-a8fa-ca71e50d6484 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:14.655896 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3735c886-961e-4e6c-a8fa-ca71e50d6484 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:14.656655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3735c886-961e-4e6c-a8fa-ca71e50d6484 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:14.657084 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3735c886-961e-4e6c-a8fa-ca71e50d6484 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:14.660191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e0a6ec57-f72e-45cd-bafc-933ce4012252 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.139081 Oct 15 03:48:14.660747 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 817/1534] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:14 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:14.685649 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3735c886-961e-4e6c-a8fa-ca71e50d6484 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040948 Oct 15 03:48:14.686197 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 718/1535] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:14 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:48:15.642054 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a37cad9a-aa25-4cc4-bd6b-1c5ad2cbf0a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:15.642963 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a37cad9a-aa25-4cc4-bd6b-1c5ad2cbf0a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:15.648890 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a37cad9a-aa25-4cc4-bd6b-1c5ad2cbf0a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:15.649341 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a37cad9a-aa25-4cc4-bd6b-1c5ad2cbf0a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:15.650096 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a37cad9a-aa25-4cc4-bd6b-1c5ad2cbf0a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:15.650532 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a37cad9a-aa25-4cc4-bd6b-1c5ad2cbf0a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:15.676809 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6e4e8753-df73-4377-92c1-5451c3909eae tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:15.677505 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6e4e8753-df73-4377-92c1-5451c3909eae tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:15.679375 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a37cad9a-aa25-4cc4-bd6b-1c5ad2cbf0a6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041093 Oct 15 03:48:15.679972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 818/1536] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:15 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:15.683201 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6e4e8753-df73-4377-92c1-5451c3909eae tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:15.683698 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6e4e8753-df73-4377-92c1-5451c3909eae tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:15.684467 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6e4e8753-df73-4377-92c1-5451c3909eae tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:15.684903 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6e4e8753-df73-4377-92c1-5451c3909eae tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:15.696514 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1f59e703-da52-410c-802f-410a686e74ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:15.697408 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1f59e703-da52-410c-802f-410a686e74ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:15.702891 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1f59e703-da52-410c-802f-410a686e74ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:15.703339 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1f59e703-da52-410c-802f-410a686e74ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:15.704137 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1f59e703-da52-410c-802f-410a686e74ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:15.704573 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1f59e703-da52-410c-802f-410a686e74ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:15.734087 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1f59e703-da52-410c-802f-410a686e74ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041101 Oct 15 03:48:15.734638 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 819/1537] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:15 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:48:15.804085 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6e4e8753-df73-4377-92c1-5451c3909eae tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:15.811272 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6e4e8753-df73-4377-92c1-5451c3909eae tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138011 Oct 15 03:48:15.811870 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 719/1538] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:15 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:48:16.690720 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2150fa7a-2672-4c82-96a1-e01dfd920225 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:16.691623 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2150fa7a-2672-4c82-96a1-e01dfd920225 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:16.698098 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2150fa7a-2672-4c82-96a1-e01dfd920225 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:16.698540 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2150fa7a-2672-4c82-96a1-e01dfd920225 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:16.699290 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2150fa7a-2672-4c82-96a1-e01dfd920225 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:16.699741 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2150fa7a-2672-4c82-96a1-e01dfd920225 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:16.727289 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2150fa7a-2672-4c82-96a1-e01dfd920225 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040452 Oct 15 03:48:16.727850 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 820/1539] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:16 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:16.745903 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-99c22b26-2485-4c16-bbd9-9704a22c379c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:16.746808 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-99c22b26-2485-4c16-bbd9-9704a22c379c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:16.752517 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-99c22b26-2485-4c16-bbd9-9704a22c379c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:16.752962 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-99c22b26-2485-4c16-bbd9-9704a22c379c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:16.753703 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-99c22b26-2485-4c16-bbd9-9704a22c379c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:16.754129 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-99c22b26-2485-4c16-bbd9-9704a22c379c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:16.781405 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-99c22b26-2485-4c16-bbd9-9704a22c379c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040000 Oct 15 03:48:16.781930 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 720/1540] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:16 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:16.827435 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ff6519b6-4103-4a75-ab36-cb6662b8892c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:16.828074 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ff6519b6-4103-4a75-ab36-cb6662b8892c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:16.834021 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff6519b6-4103-4a75-ab36-cb6662b8892c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:16.834466 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff6519b6-4103-4a75-ab36-cb6662b8892c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:16.835222 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff6519b6-4103-4a75-ab36-cb6662b8892c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:16.835653 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff6519b6-4103-4a75-ab36-cb6662b8892c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:16.952295 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ff6519b6-4103-4a75-ab36-cb6662b8892c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:16.959556 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ff6519b6-4103-4a75-ab36-cb6662b8892c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135776 Oct 15 03:48:16.960120 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 821/1541] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:16 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:17.740456 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0c407372-f5f6-41a4-b228-3934b7cb681b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:17.741301 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0c407372-f5f6-41a4-b228-3934b7cb681b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:17.747501 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0c407372-f5f6-41a4-b228-3934b7cb681b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:17.748089 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0c407372-f5f6-41a4-b228-3934b7cb681b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:17.748728 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0c407372-f5f6-41a4-b228-3934b7cb681b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:17.749162 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0c407372-f5f6-41a4-b228-3934b7cb681b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:17.777263 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0c407372-f5f6-41a4-b228-3934b7cb681b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040662 Oct 15 03:48:17.777791 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 721/1542] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:17 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:17.792470 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-66e44f92-bbb1-4c35-b861-35d3f90c165e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:17.793379 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-66e44f92-bbb1-4c35-b861-35d3f90c165e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:17.798973 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-66e44f92-bbb1-4c35-b861-35d3f90c165e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:17.799419 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-66e44f92-bbb1-4c35-b861-35d3f90c165e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:17.800225 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-66e44f92-bbb1-4c35-b861-35d3f90c165e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:17.800659 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-66e44f92-bbb1-4c35-b861-35d3f90c165e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:17.830328 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-66e44f92-bbb1-4c35-b861-35d3f90c165e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041677 Oct 15 03:48:17.830860 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 822/1543] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:17 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:17.976513 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-939748ec-d6c7-41d5-9409-46807d4acb6d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:17.977115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-939748ec-d6c7-41d5-9409-46807d4acb6d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:17.982655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-939748ec-d6c7-41d5-9409-46807d4acb6d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:17.983093 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-939748ec-d6c7-41d5-9409-46807d4acb6d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:17.983868 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-939748ec-d6c7-41d5-9409-46807d4acb6d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:17.984299 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-939748ec-d6c7-41d5-9409-46807d4acb6d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:18.100144 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-939748ec-d6c7-41d5-9409-46807d4acb6d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:18.107831 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-939748ec-d6c7-41d5-9409-46807d4acb6d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134835 Oct 15 03:48:18.108545 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 722/1544] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:17 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:18.788423 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7b60bea5-cf6a-422a-aa3b-6d30410d2869 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:18.789331 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7b60bea5-cf6a-422a-aa3b-6d30410d2869 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:18.795747 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7b60bea5-cf6a-422a-aa3b-6d30410d2869 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:18.796289 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7b60bea5-cf6a-422a-aa3b-6d30410d2869 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:18.796921 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7b60bea5-cf6a-422a-aa3b-6d30410d2869 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:18.797350 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7b60bea5-cf6a-422a-aa3b-6d30410d2869 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:18.824584 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7b60bea5-cf6a-422a-aa3b-6d30410d2869 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039996 Oct 15 03:48:18.825107 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 823/1545] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:18 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:18.842357 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d5a5fa1b-c041-4c56-9814-e220273413ca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:18.843268 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d5a5fa1b-c041-4c56-9814-e220273413ca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:18.849019 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d5a5fa1b-c041-4c56-9814-e220273413ca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:18.849469 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d5a5fa1b-c041-4c56-9814-e220273413ca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:18.850230 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d5a5fa1b-c041-4c56-9814-e220273413ca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:18.850664 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d5a5fa1b-c041-4c56-9814-e220273413ca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:18.879258 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d5a5fa1b-c041-4c56-9814-e220273413ca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041212 Oct 15 03:48:18.879814 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 723/1546] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:18 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:18.995999 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:48:18.996186 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 03:48:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:48:19.124077 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e1185467-3147-4a96-bd3e-3e042080d0ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:19.124617 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e1185467-3147-4a96-bd3e-3e042080d0ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:19.130255 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1185467-3147-4a96-bd3e-3e042080d0ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:19.130697 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1185467-3147-4a96-bd3e-3e042080d0ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:19.131439 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1185467-3147-4a96-bd3e-3e042080d0ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:19.131898 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1185467-3147-4a96-bd3e-3e042080d0ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:19.252507 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e1185467-3147-4a96-bd3e-3e042080d0ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:19.259597 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e1185467-3147-4a96-bd3e-3e042080d0ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.139178 Oct 15 03:48:19.260826 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 824/1547] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:19 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:19.836128 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2b9317d7-8cb8-4916-809c-1a8d3a91b6ca tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:19.837069 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2b9317d7-8cb8-4916-809c-1a8d3a91b6ca tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:19.842896 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b9317d7-8cb8-4916-809c-1a8d3a91b6ca tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:19.843485 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b9317d7-8cb8-4916-809c-1a8d3a91b6ca tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:19.844151 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b9317d7-8cb8-4916-809c-1a8d3a91b6ca tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:19.844579 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b9317d7-8cb8-4916-809c-1a8d3a91b6ca tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:19.873058 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2b9317d7-8cb8-4916-809c-1a8d3a91b6ca tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040953 Oct 15 03:48:19.873591 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 724/1548] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:19 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:19.891497 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1e05d392-68b6-4fc1-acd2-59719d8453cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:19.892429 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1e05d392-68b6-4fc1-acd2-59719d8453cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:19.898750 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e05d392-68b6-4fc1-acd2-59719d8453cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:19.899190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e05d392-68b6-4fc1-acd2-59719d8453cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:19.899998 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e05d392-68b6-4fc1-acd2-59719d8453cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:19.900422 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1e05d392-68b6-4fc1-acd2-59719d8453cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:19.928547 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1e05d392-68b6-4fc1-acd2-59719d8453cf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041796 Oct 15 03:48:19.929086 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 825/1549] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:19 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:48:20.277459 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0c7484d2-cb54-4873-87a1-4f04f78e62f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:20.278062 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0c7484d2-cb54-4873-87a1-4f04f78e62f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:20.283853 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0c7484d2-cb54-4873-87a1-4f04f78e62f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:20.284301 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0c7484d2-cb54-4873-87a1-4f04f78e62f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:20.285052 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0c7484d2-cb54-4873-87a1-4f04f78e62f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:20.285482 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0c7484d2-cb54-4873-87a1-4f04f78e62f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:20.401969 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0c7484d2-cb54-4873-87a1-4f04f78e62f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:20.409132 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0c7484d2-cb54-4873-87a1-4f04f78e62f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135849 Oct 15 03:48:20.409690 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 725/1550] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:20 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:20.884398 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ff614541-79ba-4a5f-97c2-2bb4be3d6374 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:20.885942 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ff614541-79ba-4a5f-97c2-2bb4be3d6374 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:20.891697 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff614541-79ba-4a5f-97c2-2bb4be3d6374 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:20.892278 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff614541-79ba-4a5f-97c2-2bb4be3d6374 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:20.892915 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff614541-79ba-4a5f-97c2-2bb4be3d6374 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:20.893337 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff614541-79ba-4a5f-97c2-2bb4be3d6374 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:20.921684 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ff614541-79ba-4a5f-97c2-2bb4be3d6374 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041046 Oct 15 03:48:20.922204 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 826/1551] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:20 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:20.940387 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-77f3b1f2-624c-415b-b160-a4a3fd8925a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:20.941295 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-77f3b1f2-624c-415b-b160-a4a3fd8925a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:20.946949 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-77f3b1f2-624c-415b-b160-a4a3fd8925a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:20.947395 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-77f3b1f2-624c-415b-b160-a4a3fd8925a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:20.948823 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-77f3b1f2-624c-415b-b160-a4a3fd8925a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:20.949255 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-77f3b1f2-624c-415b-b160-a4a3fd8925a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:20.976950 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-77f3b1f2-624c-415b-b160-a4a3fd8925a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040313 Oct 15 03:48:20.977479 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 726/1552] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:20 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:21.424905 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-642af978-3eb8-4d0d-804b-41204754ae6f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:21.425541 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-642af978-3eb8-4d0d-804b-41204754ae6f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:21.431339 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-642af978-3eb8-4d0d-804b-41204754ae6f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:21.431823 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-642af978-3eb8-4d0d-804b-41204754ae6f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:21.433171 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-642af978-3eb8-4d0d-804b-41204754ae6f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:21.433601 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-642af978-3eb8-4d0d-804b-41204754ae6f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:21.548806 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-642af978-3eb8-4d0d-804b-41204754ae6f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:21.555950 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-642af978-3eb8-4d0d-804b-41204754ae6f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134656 Oct 15 03:48:21.556499 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 827/1553] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:21 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:21.933446 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1bb2eff8-8cc0-4357-b8c9-c5a80ed146e9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:21.934269 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1bb2eff8-8cc0-4357-b8c9-c5a80ed146e9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:21.940234 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1bb2eff8-8cc0-4357-b8c9-c5a80ed146e9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:21.940674 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1bb2eff8-8cc0-4357-b8c9-c5a80ed146e9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:21.941423 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1bb2eff8-8cc0-4357-b8c9-c5a80ed146e9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:21.941848 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1bb2eff8-8cc0-4357-b8c9-c5a80ed146e9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:21.969058 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1bb2eff8-8cc0-4357-b8c9-c5a80ed146e9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040027 Oct 15 03:48:21.969590 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 727/1554] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:21 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:21.988123 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2b17c504-9b31-4aa1-bdd9-e512c349c28b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:21.989067 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2b17c504-9b31-4aa1-bdd9-e512c349c28b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:21.995631 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2b17c504-9b31-4aa1-bdd9-e512c349c28b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:21.996106 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2b17c504-9b31-4aa1-bdd9-e512c349c28b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:21.996870 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2b17c504-9b31-4aa1-bdd9-e512c349c28b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:21.997306 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2b17c504-9b31-4aa1-bdd9-e512c349c28b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:22.025105 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2b17c504-9b31-4aa1-bdd9-e512c349c28b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040714 Oct 15 03:48:22.025652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 828/1555] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:21 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:22.573151 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9612f572-111f-4165-ae6b-7166488bd51a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:22.573750 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9612f572-111f-4165-ae6b-7166488bd51a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:22.579387 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9612f572-111f-4165-ae6b-7166488bd51a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:22.579871 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9612f572-111f-4165-ae6b-7166488bd51a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:22.580621 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9612f572-111f-4165-ae6b-7166488bd51a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:22.581046 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9612f572-111f-4165-ae6b-7166488bd51a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:22.700255 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-9612f572-111f-4165-ae6b-7166488bd51a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:22.707778 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9612f572-111f-4165-ae6b-7166488bd51a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138062 Oct 15 03:48:22.708332 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 728/1556] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:22 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:22.980551 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-23959305-9a6b-4a55-9268-8aacf18db2bb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:22.981372 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-23959305-9a6b-4a55-9268-8aacf18db2bb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:22.987102 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-23959305-9a6b-4a55-9268-8aacf18db2bb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:22.987551 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-23959305-9a6b-4a55-9268-8aacf18db2bb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:22.988343 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-23959305-9a6b-4a55-9268-8aacf18db2bb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:22.988878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-23959305-9a6b-4a55-9268-8aacf18db2bb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:23.017232 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-23959305-9a6b-4a55-9268-8aacf18db2bb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040643 Oct 15 03:48:23.017758 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 829/1557] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:22 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:23.036268 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0c84e58a-31b6-4a7f-b059-b9cc5f3a4e98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:23.037169 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0c84e58a-31b6-4a7f-b059-b9cc5f3a4e98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:23.042820 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0c84e58a-31b6-4a7f-b059-b9cc5f3a4e98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:23.043259 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0c84e58a-31b6-4a7f-b059-b9cc5f3a4e98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:23.044302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0c84e58a-31b6-4a7f-b059-b9cc5f3a4e98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:23.044756 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0c84e58a-31b6-4a7f-b059-b9cc5f3a4e98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:23.072444 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0c84e58a-31b6-4a7f-b059-b9cc5f3a4e98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039873 Oct 15 03:48:23.073556 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 729/1558] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:23 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:23.725081 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e3768330-842f-4e04-855a-f0c96ccbbbf0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:23.725689 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e3768330-842f-4e04-855a-f0c96ccbbbf0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:23.731422 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3768330-842f-4e04-855a-f0c96ccbbbf0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:23.731912 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3768330-842f-4e04-855a-f0c96ccbbbf0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:23.732668 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3768330-842f-4e04-855a-f0c96ccbbbf0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:23.733098 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3768330-842f-4e04-855a-f0c96ccbbbf0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:23.852609 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e3768330-842f-4e04-855a-f0c96ccbbbf0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:23.859814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e3768330-842f-4e04-855a-f0c96ccbbbf0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138370 Oct 15 03:48:23.860360 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 830/1559] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:23 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:24.028293 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0d888071-c7f6-4a40-a3e9-9d1dfd370fab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:24.029193 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0d888071-c7f6-4a40-a3e9-9d1dfd370fab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:24.034872 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0d888071-c7f6-4a40-a3e9-9d1dfd370fab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:24.035316 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0d888071-c7f6-4a40-a3e9-9d1dfd370fab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:24.036099 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0d888071-c7f6-4a40-a3e9-9d1dfd370fab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:24.036528 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0d888071-c7f6-4a40-a3e9-9d1dfd370fab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:24.064431 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0d888071-c7f6-4a40-a3e9-9d1dfd370fab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039901 Oct 15 03:48:24.064958 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 730/1560] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:24 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:24.083415 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ad1d8d9b-e0cd-4ec5-957d-ff182ffa1159 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:24.084365 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ad1d8d9b-e0cd-4ec5-957d-ff182ffa1159 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:24.090046 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ad1d8d9b-e0cd-4ec5-957d-ff182ffa1159 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:24.090492 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ad1d8d9b-e0cd-4ec5-957d-ff182ffa1159 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:24.091245 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ad1d8d9b-e0cd-4ec5-957d-ff182ffa1159 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:24.091707 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ad1d8d9b-e0cd-4ec5-957d-ff182ffa1159 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:24.120305 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ad1d8d9b-e0cd-4ec5-957d-ff182ffa1159 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040237 Oct 15 03:48:24.120766 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 831/1561] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:24 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:24.876708 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-86b26de1-84dc-480f-9f04-39f3c1333862 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:24.877308 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-86b26de1-84dc-480f-9f04-39f3c1333862 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:24.883005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-86b26de1-84dc-480f-9f04-39f3c1333862 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:24.883393 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-86b26de1-84dc-480f-9f04-39f3c1333862 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:24.884178 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-86b26de1-84dc-480f-9f04-39f3c1333862 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:24.884605 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-86b26de1-84dc-480f-9f04-39f3c1333862 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:24.999074 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-86b26de1-84dc-480f-9f04-39f3c1333862 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:25.006489 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-86b26de1-84dc-480f-9f04-39f3c1333862 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.133547 Oct 15 03:48:25.007057 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 731/1562] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:24 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:25.075322 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fd8929eb-db6d-45cf-9b0f-e83f0db8e30f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:25.076254 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fd8929eb-db6d-45cf-9b0f-e83f0db8e30f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:25.081912 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fd8929eb-db6d-45cf-9b0f-e83f0db8e30f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:25.082357 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fd8929eb-db6d-45cf-9b0f-e83f0db8e30f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:25.083367 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fd8929eb-db6d-45cf-9b0f-e83f0db8e30f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:25.083824 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fd8929eb-db6d-45cf-9b0f-e83f0db8e30f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:25.111985 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fd8929eb-db6d-45cf-9b0f-e83f0db8e30f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040318 Oct 15 03:48:25.112503 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 832/1563] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:25 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:25.193493 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-04b293fc-a81c-43b1-b790-78613f9a81c6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:25.194396 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-04b293fc-a81c-43b1-b790-78613f9a81c6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:25.200055 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-04b293fc-a81c-43b1-b790-78613f9a81c6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:25.200502 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-04b293fc-a81c-43b1-b790-78613f9a81c6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:25.201290 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-04b293fc-a81c-43b1-b790-78613f9a81c6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:25.201723 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-04b293fc-a81c-43b1-b790-78613f9a81c6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:25.229865 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-04b293fc-a81c-43b1-b790-78613f9a81c6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102214 Oct 15 03:48:25.230452 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 732/1564] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:25 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:26.023331 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2a716068-561e-4d95-b434-99fe1c132820 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:26.024143 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2a716068-561e-4d95-b434-99fe1c132820 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:26.029796 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2a716068-561e-4d95-b434-99fe1c132820 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:26.030238 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2a716068-561e-4d95-b434-99fe1c132820 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:26.031006 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2a716068-561e-4d95-b434-99fe1c132820 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:26.031436 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2a716068-561e-4d95-b434-99fe1c132820 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:26.123462 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ea711699-a9cb-417b-a7b4-d5b9db107301 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:26.124483 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ea711699-a9cb-417b-a7b4-d5b9db107301 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:26.130150 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea711699-a9cb-417b-a7b4-d5b9db107301 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:26.130670 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea711699-a9cb-417b-a7b4-d5b9db107301 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:26.131433 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea711699-a9cb-417b-a7b4-d5b9db107301 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:26.131910 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea711699-a9cb-417b-a7b4-d5b9db107301 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:26.152173 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2a716068-561e-4d95-b434-99fe1c132820 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:26.159364 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2a716068-561e-4d95-b434-99fe1c132820 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.139745 Oct 15 03:48:26.159944 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 833/1565] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:26 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:26.160078 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ea711699-a9cb-417b-a7b4-d5b9db107301 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041006 Oct 15 03:48:26.160579 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 733/1566] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:26 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:48:26.241604 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-32f31165-f00e-4fe2-b426-71427283f3ca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:26.242593 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-32f31165-f00e-4fe2-b426-71427283f3ca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:26.249105 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-32f31165-f00e-4fe2-b426-71427283f3ca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:26.249546 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-32f31165-f00e-4fe2-b426-71427283f3ca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:26.250302 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-32f31165-f00e-4fe2-b426-71427283f3ca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:26.250738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-32f31165-f00e-4fe2-b426-71427283f3ca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:26.278653 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-32f31165-f00e-4fe2-b426-71427283f3ca tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040734 Oct 15 03:48:26.279121 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 834/1567] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:26 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:27.171575 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-282e345d-e073-4714-85b1-076065a1c6a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:27.172499 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-282e345d-e073-4714-85b1-076065a1c6a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:27.176372 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-afb95b9f-9f82-4c96-981f-797ea880c823 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:27.176984 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-afb95b9f-9f82-4c96-981f-797ea880c823 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:27.178281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-282e345d-e073-4714-85b1-076065a1c6a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:27.178727 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-282e345d-e073-4714-85b1-076065a1c6a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:27.179473 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-282e345d-e073-4714-85b1-076065a1c6a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:27.179928 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-282e345d-e073-4714-85b1-076065a1c6a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:27.182761 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-afb95b9f-9f82-4c96-981f-797ea880c823 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:27.183211 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-afb95b9f-9f82-4c96-981f-797ea880c823 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:27.184002 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-afb95b9f-9f82-4c96-981f-797ea880c823 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:27.184433 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-afb95b9f-9f82-4c96-981f-797ea880c823 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:27.208045 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-282e345d-e073-4714-85b1-076065a1c6a4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040452 Oct 15 03:48:27.208594 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 734/1568] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:27 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:27.289763 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-52b9a72a-4d0c-4b10-9b1d-4381a8894480 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:27.290694 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-52b9a72a-4d0c-4b10-9b1d-4381a8894480 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:27.297216 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-52b9a72a-4d0c-4b10-9b1d-4381a8894480 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:27.297666 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-52b9a72a-4d0c-4b10-9b1d-4381a8894480 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:27.298435 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-52b9a72a-4d0c-4b10-9b1d-4381a8894480 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:27.298867 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-52b9a72a-4d0c-4b10-9b1d-4381a8894480 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:27.302036 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-afb95b9f-9f82-4c96-981f-797ea880c823 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:27.309317 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-afb95b9f-9f82-4c96-981f-797ea880c823 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.136500 Oct 15 03:48:27.309869 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 835/1569] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:27 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:48:27.327172 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-52b9a72a-4d0c-4b10-9b1d-4381a8894480 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041073 Oct 15 03:48:27.327725 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 735/1570] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:27 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:48:28.219137 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-872471f9-1389-4bb5-8bf0-cacc762912ed tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:28.219994 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-872471f9-1389-4bb5-8bf0-cacc762912ed tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:28.225819 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-872471f9-1389-4bb5-8bf0-cacc762912ed tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:28.226267 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-872471f9-1389-4bb5-8bf0-cacc762912ed tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:28.227023 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-872471f9-1389-4bb5-8bf0-cacc762912ed tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:28.227459 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-872471f9-1389-4bb5-8bf0-cacc762912ed tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:28.256099 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-872471f9-1389-4bb5-8bf0-cacc762912ed tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041278 Oct 15 03:48:28.256642 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 836/1571] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:28 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:28.325674 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5498bd7c-c8a8-4a29-9747-e51386d0c5f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:28.326283 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5498bd7c-c8a8-4a29-9747-e51386d0c5f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:28.332000 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5498bd7c-c8a8-4a29-9747-e51386d0c5f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:28.332705 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5498bd7c-c8a8-4a29-9747-e51386d0c5f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:28.333467 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5498bd7c-c8a8-4a29-9747-e51386d0c5f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:28.333904 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5498bd7c-c8a8-4a29-9747-e51386d0c5f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:28.338442 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3f689020-1e32-4e99-957b-c5d3a394d3f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:28.339344 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3f689020-1e32-4e99-957b-c5d3a394d3f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:28.344982 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3f689020-1e32-4e99-957b-c5d3a394d3f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:28.345429 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3f689020-1e32-4e99-957b-c5d3a394d3f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:28.346191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3f689020-1e32-4e99-957b-c5d3a394d3f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:28.346622 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3f689020-1e32-4e99-957b-c5d3a394d3f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:28.375250 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3f689020-1e32-4e99-957b-c5d3a394d3f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040451 Oct 15 03:48:28.375829 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 837/1572] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:28 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:48:28.451656 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5498bd7c-c8a8-4a29-9747-e51386d0c5f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:28.459261 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5498bd7c-c8a8-4a29-9747-e51386d0c5f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.137736 Oct 15 03:48:28.459852 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 736/1573] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:28 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:29.266769 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0d9754f1-2a5f-4575-8623-22b976ff4307 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:29.267718 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0d9754f1-2a5f-4575-8623-22b976ff4307 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:29.273501 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0d9754f1-2a5f-4575-8623-22b976ff4307 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:29.273951 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0d9754f1-2a5f-4575-8623-22b976ff4307 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:29.274709 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0d9754f1-2a5f-4575-8623-22b976ff4307 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:29.275142 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0d9754f1-2a5f-4575-8623-22b976ff4307 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:29.303842 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0d9754f1-2a5f-4575-8623-22b976ff4307 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040801 Oct 15 03:48:29.304371 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 838/1574] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:29 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:29.386411 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-30c1a03b-78be-42c2-8758-5b3655f18cab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:29.387306 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-30c1a03b-78be-42c2-8758-5b3655f18cab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:29.393051 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-30c1a03b-78be-42c2-8758-5b3655f18cab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:29.393472 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-30c1a03b-78be-42c2-8758-5b3655f18cab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:29.394217 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-30c1a03b-78be-42c2-8758-5b3655f18cab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:29.394642 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-30c1a03b-78be-42c2-8758-5b3655f18cab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:29.422583 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-30c1a03b-78be-42c2-8758-5b3655f18cab tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039889 Oct 15 03:48:29.423106 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 737/1575] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:29 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:29.475885 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-242335b1-fc03-4909-991f-e267a41f73bd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:29.476498 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-242335b1-fc03-4909-991f-e267a41f73bd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:29.482846 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-242335b1-fc03-4909-991f-e267a41f73bd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:29.483293 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-242335b1-fc03-4909-991f-e267a41f73bd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:29.484076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-242335b1-fc03-4909-991f-e267a41f73bd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:29.484510 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-242335b1-fc03-4909-991f-e267a41f73bd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:29.603095 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-242335b1-fc03-4909-991f-e267a41f73bd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:29.610764 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-242335b1-fc03-4909-991f-e267a41f73bd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138451 Oct 15 03:48:29.611314 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 839/1576] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:29 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:30.314956 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-91baeccf-8499-47ee-8db2-02b742d5b9bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:30.315914 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-91baeccf-8499-47ee-8db2-02b742d5b9bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:30.321723 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-91baeccf-8499-47ee-8db2-02b742d5b9bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:30.322170 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-91baeccf-8499-47ee-8db2-02b742d5b9bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:30.322924 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-91baeccf-8499-47ee-8db2-02b742d5b9bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:30.323355 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-91baeccf-8499-47ee-8db2-02b742d5b9bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:30.352292 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-91baeccf-8499-47ee-8db2-02b742d5b9bf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041091 Oct 15 03:48:30.352859 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 738/1577] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:30 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:30.433713 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-498e3cf3-8e77-417b-ba28-a063aa1c797c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:30.434611 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-498e3cf3-8e77-417b-ba28-a063aa1c797c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:30.440331 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-498e3cf3-8e77-417b-ba28-a063aa1c797c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:30.440774 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-498e3cf3-8e77-417b-ba28-a063aa1c797c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:30.441514 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-498e3cf3-8e77-417b-ba28-a063aa1c797c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:30.441944 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-498e3cf3-8e77-417b-ba28-a063aa1c797c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:30.471512 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-498e3cf3-8e77-417b-ba28-a063aa1c797c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041587 Oct 15 03:48:30.472073 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 840/1578] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:30 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:30.627385 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ec875f0f-0ae8-4cdc-9147-88523d0a464a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:30.628027 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ec875f0f-0ae8-4cdc-9147-88523d0a464a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:30.633661 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ec875f0f-0ae8-4cdc-9147-88523d0a464a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:30.634106 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ec875f0f-0ae8-4cdc-9147-88523d0a464a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:30.634862 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ec875f0f-0ae8-4cdc-9147-88523d0a464a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:30.635289 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ec875f0f-0ae8-4cdc-9147-88523d0a464a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:30.638573 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:48:30.641039 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 03:48:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 (ip 10.222.0.30) !!! Oct 15 03:48:30.764691 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ec875f0f-0ae8-4cdc-9147-88523d0a464a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:30.771910 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ec875f0f-0ae8-4cdc-9147-88523d0a464a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.148146 Oct 15 03:48:30.772461 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 739/1579] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:30 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:31.363131 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fa5d9327-ffe7-453b-8593-7759db39faf0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:31.364070 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fa5d9327-ffe7-453b-8593-7759db39faf0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:31.369775 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fa5d9327-ffe7-453b-8593-7759db39faf0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:31.370214 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fa5d9327-ffe7-453b-8593-7759db39faf0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:31.370961 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fa5d9327-ffe7-453b-8593-7759db39faf0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:31.371441 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fa5d9327-ffe7-453b-8593-7759db39faf0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:31.398846 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fa5d9327-ffe7-453b-8593-7759db39faf0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039586 Oct 15 03:48:31.399364 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 841/1580] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:31 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:31.483192 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-72ed5172-98e3-4aaf-8778-513def3a9a38 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:31.484201 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-72ed5172-98e3-4aaf-8778-513def3a9a38 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:31.489995 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-72ed5172-98e3-4aaf-8778-513def3a9a38 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:31.490736 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-72ed5172-98e3-4aaf-8778-513def3a9a38 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:31.491605 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-72ed5172-98e3-4aaf-8778-513def3a9a38 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:31.492060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-72ed5172-98e3-4aaf-8778-513def3a9a38 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:31.520331 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-72ed5172-98e3-4aaf-8778-513def3a9a38 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041496 Oct 15 03:48:31.520797 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 740/1581] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:31 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:31.790464 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-96b73474-dc9e-4a11-9fb1-7c8e9244cdce tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:31.791002 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-96b73474-dc9e-4a11-9fb1-7c8e9244cdce tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:31.796581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96b73474-dc9e-4a11-9fb1-7c8e9244cdce tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:31.797031 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96b73474-dc9e-4a11-9fb1-7c8e9244cdce tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:31.797773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96b73474-dc9e-4a11-9fb1-7c8e9244cdce tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:31.798200 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96b73474-dc9e-4a11-9fb1-7c8e9244cdce tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:31.915338 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-96b73474-dc9e-4a11-9fb1-7c8e9244cdce tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:31.922434 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-96b73474-dc9e-4a11-9fb1-7c8e9244cdce tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135590 Oct 15 03:48:31.923002 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 842/1582] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:31 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:32.410461 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-43c852d4-4ee6-49c3-8184-07a3b5e2ec02 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:32.411434 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-43c852d4-4ee6-49c3-8184-07a3b5e2ec02 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:32.417237 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-43c852d4-4ee6-49c3-8184-07a3b5e2ec02 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:32.417687 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-43c852d4-4ee6-49c3-8184-07a3b5e2ec02 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:32.418953 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-43c852d4-4ee6-49c3-8184-07a3b5e2ec02 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:32.419388 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-43c852d4-4ee6-49c3-8184-07a3b5e2ec02 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:32.447540 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-43c852d4-4ee6-49c3-8184-07a3b5e2ec02 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040905 Oct 15 03:48:32.448109 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 741/1583] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:32 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:32.531560 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a0b0f007-cc99-4561-b84a-e4fc8aab742a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:32.532464 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a0b0f007-cc99-4561-b84a-e4fc8aab742a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:32.538253 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0b0f007-cc99-4561-b84a-e4fc8aab742a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:32.538702 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0b0f007-cc99-4561-b84a-e4fc8aab742a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:32.539467 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0b0f007-cc99-4561-b84a-e4fc8aab742a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:32.539935 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a0b0f007-cc99-4561-b84a-e4fc8aab742a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:32.568819 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a0b0f007-cc99-4561-b84a-e4fc8aab742a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041069 Oct 15 03:48:32.569347 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 843/1584] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:32 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:32.939190 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-67159737-6da3-4f5f-86a9-e31cb45cb80b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:32.939744 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-67159737-6da3-4f5f-86a9-e31cb45cb80b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:32.945490 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-67159737-6da3-4f5f-86a9-e31cb45cb80b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:32.945936 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-67159737-6da3-4f5f-86a9-e31cb45cb80b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:32.946689 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-67159737-6da3-4f5f-86a9-e31cb45cb80b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:32.947120 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-67159737-6da3-4f5f-86a9-e31cb45cb80b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:33.068506 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-67159737-6da3-4f5f-86a9-e31cb45cb80b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:33.075919 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-67159737-6da3-4f5f-86a9-e31cb45cb80b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.140352 Oct 15 03:48:33.076499 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 742/1585] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:32 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:33.458804 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d0adbc5d-f396-4704-921c-18f7f1e5b8cb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:33.459731 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d0adbc5d-f396-4704-921c-18f7f1e5b8cb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:33.466286 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d0adbc5d-f396-4704-921c-18f7f1e5b8cb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:33.466727 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d0adbc5d-f396-4704-921c-18f7f1e5b8cb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:33.467475 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d0adbc5d-f396-4704-921c-18f7f1e5b8cb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:33.467932 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d0adbc5d-f396-4704-921c-18f7f1e5b8cb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:33.495193 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d0adbc5d-f396-4704-921c-18f7f1e5b8cb tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040354 Oct 15 03:48:33.495663 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 844/1586] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:33 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:33.581050 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-882894c4-d155-4482-920a-162dc6e75368 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:33.581953 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-882894c4-d155-4482-920a-162dc6e75368 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:33.587922 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-882894c4-d155-4482-920a-162dc6e75368 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:33.588365 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-882894c4-d155-4482-920a-162dc6e75368 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:33.589110 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-882894c4-d155-4482-920a-162dc6e75368 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:33.589534 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-882894c4-d155-4482-920a-162dc6e75368 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:33.616773 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-882894c4-d155-4482-920a-162dc6e75368 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039502 Oct 15 03:48:33.617288 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 743/1587] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:33 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:34.092978 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-97ed0a5b-c37c-466c-b7b7-e3b51773665b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:34.093657 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-97ed0a5b-c37c-466c-b7b7-e3b51773665b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:34.099588 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-97ed0a5b-c37c-466c-b7b7-e3b51773665b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:34.100071 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-97ed0a5b-c37c-466c-b7b7-e3b51773665b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:34.100832 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-97ed0a5b-c37c-466c-b7b7-e3b51773665b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:34.101261 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-97ed0a5b-c37c-466c-b7b7-e3b51773665b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:34.309513 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-97ed0a5b-c37c-466c-b7b7-e3b51773665b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:34.316614 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-97ed0a5b-c37c-466c-b7b7-e3b51773665b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.227280 Oct 15 03:48:34.317166 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 845/1588] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:34 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:34.507738 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b6b163e1-52ef-4c43-a68c-8701211e04cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:34.508745 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b6b163e1-52ef-4c43-a68c-8701211e04cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:34.514770 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b6b163e1-52ef-4c43-a68c-8701211e04cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:34.515211 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b6b163e1-52ef-4c43-a68c-8701211e04cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:34.516001 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b6b163e1-52ef-4c43-a68c-8701211e04cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:34.516435 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b6b163e1-52ef-4c43-a68c-8701211e04cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:34.546422 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b6b163e1-52ef-4c43-a68c-8701211e04cf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042435 Oct 15 03:48:34.546969 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 744/1589] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:34 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:34.627099 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a632e602-62ba-449a-95c6-1533f3912542 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:34.627957 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a632e602-62ba-449a-95c6-1533f3912542 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:34.633609 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a632e602-62ba-449a-95c6-1533f3912542 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:34.634049 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a632e602-62ba-449a-95c6-1533f3912542 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:34.634794 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a632e602-62ba-449a-95c6-1533f3912542 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:34.635219 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a632e602-62ba-449a-95c6-1533f3912542 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:34.663626 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a632e602-62ba-449a-95c6-1533f3912542 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040371 Oct 15 03:48:34.664181 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 846/1590] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:34 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:35.333766 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-38edf8cf-063c-44f4-a2d0-0cd2d02db433 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:35.334292 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-38edf8cf-063c-44f4-a2d0-0cd2d02db433 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:35.340084 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-38edf8cf-063c-44f4-a2d0-0cd2d02db433 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:35.340530 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-38edf8cf-063c-44f4-a2d0-0cd2d02db433 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:35.341288 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-38edf8cf-063c-44f4-a2d0-0cd2d02db433 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:35.341718 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-38edf8cf-063c-44f4-a2d0-0cd2d02db433 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:35.461034 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-38edf8cf-063c-44f4-a2d0-0cd2d02db433 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:35.468171 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-38edf8cf-063c-44f4-a2d0-0cd2d02db433 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138460 Oct 15 03:48:35.468732 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 745/1591] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:35 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:35.556854 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c960231b-bcfa-4e4c-8e5d-4a3345aaf3c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:35.557762 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c960231b-bcfa-4e4c-8e5d-4a3345aaf3c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:35.564213 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c960231b-bcfa-4e4c-8e5d-4a3345aaf3c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:35.564659 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c960231b-bcfa-4e4c-8e5d-4a3345aaf3c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:35.565415 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c960231b-bcfa-4e4c-8e5d-4a3345aaf3c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:35.565841 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c960231b-bcfa-4e4c-8e5d-4a3345aaf3c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:35.593567 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c960231b-bcfa-4e4c-8e5d-4a3345aaf3c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040445 Oct 15 03:48:35.594039 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 847/1592] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:35 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:35.674696 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a5ff0cfd-d468-4f45-8cb5-714467217a0c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:35.675628 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a5ff0cfd-d468-4f45-8cb5-714467217a0c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:35.681315 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a5ff0cfd-d468-4f45-8cb5-714467217a0c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:35.681762 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a5ff0cfd-d468-4f45-8cb5-714467217a0c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:35.682518 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a5ff0cfd-d468-4f45-8cb5-714467217a0c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:35.682947 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a5ff0cfd-d468-4f45-8cb5-714467217a0c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:35.711078 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a5ff0cfd-d468-4f45-8cb5-714467217a0c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040162 Oct 15 03:48:35.711603 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 746/1593] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:35 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:36.484961 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4450fd01-6d89-40ce-8ce3-904a2fa75331 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:36.485498 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4450fd01-6d89-40ce-8ce3-904a2fa75331 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:36.491545 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4450fd01-6d89-40ce-8ce3-904a2fa75331 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:36.492019 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4450fd01-6d89-40ce-8ce3-904a2fa75331 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:36.492764 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4450fd01-6d89-40ce-8ce3-904a2fa75331 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:36.493192 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4450fd01-6d89-40ce-8ce3-904a2fa75331 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:36.604120 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-85fb1467-8e04-4241-8b88-5288041e1685 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:36.605022 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-85fb1467-8e04-4241-8b88-5288041e1685 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:36.609588 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4450fd01-6d89-40ce-8ce3-904a2fa75331 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:36.610752 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-85fb1467-8e04-4241-8b88-5288041e1685 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:36.611195 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-85fb1467-8e04-4241-8b88-5288041e1685 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:36.612056 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-85fb1467-8e04-4241-8b88-5288041e1685 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:36.612484 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-85fb1467-8e04-4241-8b88-5288041e1685 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:36.616823 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4450fd01-6d89-40ce-8ce3-904a2fa75331 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135528 Oct 15 03:48:36.617377 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 848/1594] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:36 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:36.641647 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-85fb1467-8e04-4241-8b88-5288041e1685 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041209 Oct 15 03:48:36.642183 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 747/1595] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:36 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:48:36.721444 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bdf26e59-c3ae-431d-8667-32bb97e04c58 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:36.722353 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bdf26e59-c3ae-431d-8667-32bb97e04c58 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:36.728007 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bdf26e59-c3ae-431d-8667-32bb97e04c58 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:36.728460 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bdf26e59-c3ae-431d-8667-32bb97e04c58 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:36.729300 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bdf26e59-c3ae-431d-8667-32bb97e04c58 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:36.729738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bdf26e59-c3ae-431d-8667-32bb97e04c58 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:36.758556 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bdf26e59-c3ae-431d-8667-32bb97e04c58 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040817 Oct 15 03:48:36.759093 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 849/1596] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:36 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:37.634315 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5bacc406-d266-4177-90a8-cded1d3fd886 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:37.634921 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5bacc406-d266-4177-90a8-cded1d3fd886 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:37.641138 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5bacc406-d266-4177-90a8-cded1d3fd886 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:37.641713 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5bacc406-d266-4177-90a8-cded1d3fd886 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:37.642551 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5bacc406-d266-4177-90a8-cded1d3fd886 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:37.642980 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5bacc406-d266-4177-90a8-cded1d3fd886 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:37.653079 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0d1d2a3e-1d15-4b80-8f5c-1fc20d68c4ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:37.654535 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0d1d2a3e-1d15-4b80-8f5c-1fc20d68c4ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:37.660443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0d1d2a3e-1d15-4b80-8f5c-1fc20d68c4ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:37.660880 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0d1d2a3e-1d15-4b80-8f5c-1fc20d68c4ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:37.661636 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0d1d2a3e-1d15-4b80-8f5c-1fc20d68c4ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:37.662062 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0d1d2a3e-1d15-4b80-8f5c-1fc20d68c4ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:37.692030 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0d1d2a3e-1d15-4b80-8f5c-1fc20d68c4ad tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042797 Oct 15 03:48:37.692579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 850/1597] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:37 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:48:37.759662 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5bacc406-d266-4177-90a8-cded1d3fd886 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:37.766831 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5bacc406-d266-4177-90a8-cded1d3fd886 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.136285 Oct 15 03:48:37.767390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 748/1598] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:37 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:37.770393 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2dd6f5b3-3728-42d8-a8b5-d9d33e4ed9a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:37.771319 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2dd6f5b3-3728-42d8-a8b5-d9d33e4ed9a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:37.777047 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2dd6f5b3-3728-42d8-a8b5-d9d33e4ed9a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:37.777508 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2dd6f5b3-3728-42d8-a8b5-d9d33e4ed9a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:37.778272 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2dd6f5b3-3728-42d8-a8b5-d9d33e4ed9a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:37.778706 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2dd6f5b3-3728-42d8-a8b5-d9d33e4ed9a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:37.806498 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2dd6f5b3-3728-42d8-a8b5-d9d33e4ed9a9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040038 Oct 15 03:48:37.806954 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 851/1599] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:37 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:48:38.702983 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-42f45c1b-64a1-413a-ac38-3794cdb08b4d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:38.703844 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-42f45c1b-64a1-413a-ac38-3794cdb08b4d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:38.709913 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-42f45c1b-64a1-413a-ac38-3794cdb08b4d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:38.710359 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-42f45c1b-64a1-413a-ac38-3794cdb08b4d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:38.711119 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-42f45c1b-64a1-413a-ac38-3794cdb08b4d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:38.711551 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-42f45c1b-64a1-413a-ac38-3794cdb08b4d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:38.740050 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-42f45c1b-64a1-413a-ac38-3794cdb08b4d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041442 Oct 15 03:48:38.740629 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 749/1600] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:38 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:38.783392 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-95ebcc95-387f-4a0c-af8d-ce5ed77f964f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:38.784035 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-95ebcc95-387f-4a0c-af8d-ce5ed77f964f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:38.789737 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-95ebcc95-387f-4a0c-af8d-ce5ed77f964f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:38.790182 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-95ebcc95-387f-4a0c-af8d-ce5ed77f964f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:38.790934 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-95ebcc95-387f-4a0c-af8d-ce5ed77f964f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:38.791362 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-95ebcc95-387f-4a0c-af8d-ce5ed77f964f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:38.818251 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a2320331-1f08-4697-8222-ecb857878178 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:38.819434 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a2320331-1f08-4697-8222-ecb857878178 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:38.825243 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a2320331-1f08-4697-8222-ecb857878178 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:38.826213 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a2320331-1f08-4697-8222-ecb857878178 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:38.826966 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a2320331-1f08-4697-8222-ecb857878178 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:38.827417 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a2320331-1f08-4697-8222-ecb857878178 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:38.858174 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a2320331-1f08-4697-8222-ecb857878178 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043612 Oct 15 03:48:38.858730 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 750/1601] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:38 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 03:48:38.917037 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-95ebcc95-387f-4a0c-af8d-ce5ed77f964f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:38.924227 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-95ebcc95-387f-4a0c-af8d-ce5ed77f964f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.144482 Oct 15 03:48:38.924779 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 852/1602] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:38 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:39.751296 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-48f16d91-0e24-4bb7-9ba6-1ae640875977 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:39.752224 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-48f16d91-0e24-4bb7-9ba6-1ae640875977 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:39.757967 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-48f16d91-0e24-4bb7-9ba6-1ae640875977 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:39.758408 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-48f16d91-0e24-4bb7-9ba6-1ae640875977 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:39.759164 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-48f16d91-0e24-4bb7-9ba6-1ae640875977 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:39.759589 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-48f16d91-0e24-4bb7-9ba6-1ae640875977 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:39.787086 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-48f16d91-0e24-4bb7-9ba6-1ae640875977 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039568 Oct 15 03:48:39.787620 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 751/1603] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:39 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:39.869446 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-74bde8b3-55e4-41fc-aada-afa60deb31ef tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:39.870340 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-74bde8b3-55e4-41fc-aada-afa60deb31ef tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:39.876069 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-74bde8b3-55e4-41fc-aada-afa60deb31ef tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:39.876508 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-74bde8b3-55e4-41fc-aada-afa60deb31ef tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:39.877260 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-74bde8b3-55e4-41fc-aada-afa60deb31ef tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:39.877684 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-74bde8b3-55e4-41fc-aada-afa60deb31ef tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:39.905976 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-74bde8b3-55e4-41fc-aada-afa60deb31ef tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040282 Oct 15 03:48:39.906499 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 853/1604] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:39 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:39.940833 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7f0a16fd-c815-4064-a3f8-a65d82964526 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:39.941438 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7f0a16fd-c815-4064-a3f8-a65d82964526 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:39.947221 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7f0a16fd-c815-4064-a3f8-a65d82964526 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:39.947667 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7f0a16fd-c815-4064-a3f8-a65d82964526 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:39.948445 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7f0a16fd-c815-4064-a3f8-a65d82964526 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:39.948882 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7f0a16fd-c815-4064-a3f8-a65d82964526 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:40.069815 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7f0a16fd-c815-4064-a3f8-a65d82964526 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:40.077929 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7f0a16fd-c815-4064-a3f8-a65d82964526 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.140703 Oct 15 03:48:40.078477 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 752/1605] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:39 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:48:40.798646 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5ff30fca-6674-414d-8142-c7cef1786e13 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:40.799551 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5ff30fca-6674-414d-8142-c7cef1786e13 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:40.805252 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5ff30fca-6674-414d-8142-c7cef1786e13 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:40.805700 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5ff30fca-6674-414d-8142-c7cef1786e13 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:40.806456 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5ff30fca-6674-414d-8142-c7cef1786e13 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:40.806887 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5ff30fca-6674-414d-8142-c7cef1786e13 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:40.835409 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5ff30fca-6674-414d-8142-c7cef1786e13 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040444 Oct 15 03:48:40.835998 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 854/1606] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:40 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:40.916367 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-31ab6fc0-35e3-4ad1-8190-d712257bb07d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:40.917275 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-31ab6fc0-35e3-4ad1-8190-d712257bb07d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:40.923537 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-31ab6fc0-35e3-4ad1-8190-d712257bb07d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:40.924020 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-31ab6fc0-35e3-4ad1-8190-d712257bb07d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:40.924782 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-31ab6fc0-35e3-4ad1-8190-d712257bb07d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:40.925214 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-31ab6fc0-35e3-4ad1-8190-d712257bb07d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:40.953304 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-31ab6fc0-35e3-4ad1-8190-d712257bb07d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040697 Oct 15 03:48:40.953840 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 753/1607] 10.222.0.30 () {60 vars in 1342 bytes} [Fri Oct 15 03:48:40 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:48:41.095880 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0f65223d-70b5-4872-ba48-61007e00e319 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:41.096498 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0f65223d-70b5-4872-ba48-61007e00e319 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:41.102238 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0f65223d-70b5-4872-ba48-61007e00e319 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:41.102858 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0f65223d-70b5-4872-ba48-61007e00e319 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:41.103466 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0f65223d-70b5-4872-ba48-61007e00e319 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:41.103933 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0f65223d-70b5-4872-ba48-61007e00e319 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:41.218344 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0f65223d-70b5-4872-ba48-61007e00e319 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:41.225826 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0f65223d-70b5-4872-ba48-61007e00e319 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.133736 Oct 15 03:48:41.226390 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 855/1608] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:41 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:41.847741 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d68cf04e-48df-4369-8eb9-0d069e0fe3dd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:41.848649 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d68cf04e-48df-4369-8eb9-0d069e0fe3dd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:41.854890 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d68cf04e-48df-4369-8eb9-0d069e0fe3dd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:41.855342 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d68cf04e-48df-4369-8eb9-0d069e0fe3dd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:41.856363 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d68cf04e-48df-4369-8eb9-0d069e0fe3dd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:41.857370 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d68cf04e-48df-4369-8eb9-0d069e0fe3dd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:41.885835 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d68cf04e-48df-4369-8eb9-0d069e0fe3dd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041815 Oct 15 03:48:41.886365 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 754/1609] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:41 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:41.964540 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-28368024-f967-4244-b3aa-fe10bb1ec526 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:48:41.965482 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-28368024-f967-4244-b3aa-fe10bb1ec526 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:41.972082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28368024-f967-4244-b3aa-fe10bb1ec526 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:41.972524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28368024-f967-4244-b3aa-fe10bb1ec526 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:41.973271 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28368024-f967-4244-b3aa-fe10bb1ec526 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:41.973700 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28368024-f967-4244-b3aa-fe10bb1ec526 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:42.057800 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-28368024-f967-4244-b3aa-fe10bb1ec526 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action" status: 200 len: 38245 microversion: 2.20 time: 0.096706 Oct 15 03:48:42.058460 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 856/1610] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:48:41 2021] POST /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9/action => generated 38245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:48:42.243029 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3df200e4-12de-4016-b4b2-67deeec57006 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:42.244100 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3df200e4-12de-4016-b4b2-67deeec57006 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:42.250027 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3df200e4-12de-4016-b4b2-67deeec57006 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:42.250467 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3df200e4-12de-4016-b4b2-67deeec57006 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:42.251216 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3df200e4-12de-4016-b4b2-67deeec57006 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:42.251643 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3df200e4-12de-4016-b4b2-67deeec57006 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:42.368652 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3df200e4-12de-4016-b4b2-67deeec57006 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:42.376388 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3df200e4-12de-4016-b4b2-67deeec57006 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.136931 Oct 15 03:48:42.376941 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 755/1611] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:42 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:42.897581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-dcccb019-07f8-4a6e-9144-01253e514ca4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:42.898571 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-dcccb019-07f8-4a6e-9144-01253e514ca4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:42.905516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dcccb019-07f8-4a6e-9144-01253e514ca4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:42.905951 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dcccb019-07f8-4a6e-9144-01253e514ca4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:42.906697 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dcccb019-07f8-4a6e-9144-01253e514ca4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:42.907122 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dcccb019-07f8-4a6e-9144-01253e514ca4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:42.934307 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-dcccb019-07f8-4a6e-9144-01253e514ca4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040870 Oct 15 03:48:42.934832 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 857/1612] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:42 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:43.393441 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fcf0b1df-e127-493b-aad1-79151dc44d89 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:43.394081 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fcf0b1df-e127-493b-aad1-79151dc44d89 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:43.399876 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fcf0b1df-e127-493b-aad1-79151dc44d89 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:43.400271 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fcf0b1df-e127-493b-aad1-79151dc44d89 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:43.401031 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fcf0b1df-e127-493b-aad1-79151dc44d89 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:43.401461 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fcf0b1df-e127-493b-aad1-79151dc44d89 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:43.517143 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fcf0b1df-e127-493b-aad1-79151dc44d89 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:43.524234 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fcf0b1df-e127-493b-aad1-79151dc44d89 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134433 Oct 15 03:48:43.524791 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 756/1613] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:43 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:43.944658 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f39bca3e-d396-41d0-af3d-2c92cf5c9fe2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:43.945561 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f39bca3e-d396-41d0-af3d-2c92cf5c9fe2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:43.951702 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f39bca3e-d396-41d0-af3d-2c92cf5c9fe2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:43.952162 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f39bca3e-d396-41d0-af3d-2c92cf5c9fe2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:43.952920 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f39bca3e-d396-41d0-af3d-2c92cf5c9fe2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:43.953377 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f39bca3e-d396-41d0-af3d-2c92cf5c9fe2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:43.982088 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f39bca3e-d396-41d0-af3d-2c92cf5c9fe2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040632 Oct 15 03:48:43.982615 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 858/1614] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:43 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:44.540186 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5f1d6a95-3052-4542-94a4-8090b30cf703 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:44.540809 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5f1d6a95-3052-4542-94a4-8090b30cf703 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:44.546752 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5f1d6a95-3052-4542-94a4-8090b30cf703 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:44.547193 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5f1d6a95-3052-4542-94a4-8090b30cf703 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:44.547965 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5f1d6a95-3052-4542-94a4-8090b30cf703 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:44.548392 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5f1d6a95-3052-4542-94a4-8090b30cf703 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:44.665430 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5f1d6a95-3052-4542-94a4-8090b30cf703 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:44.673675 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5f1d6a95-3052-4542-94a4-8090b30cf703 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.137078 Oct 15 03:48:44.674557 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 757/1615] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:44 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:44.993675 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d4a45c01-a4e8-49a2-befa-3153455918ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:44.994581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d4a45c01-a4e8-49a2-befa-3153455918ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:45.000869 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4a45c01-a4e8-49a2-befa-3153455918ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:45.001309 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4a45c01-a4e8-49a2-befa-3153455918ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:45.002054 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4a45c01-a4e8-49a2-befa-3153455918ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:45.002481 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4a45c01-a4e8-49a2-befa-3153455918ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:45.030455 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d4a45c01-a4e8-49a2-befa-3153455918ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040571 Oct 15 03:48:45.030978 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 859/1616] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:44 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:45.690094 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b559f3cb-e26c-4560-94ac-941603bc9330 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:45.690691 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b559f3cb-e26c-4560-94ac-941603bc9330 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:45.696458 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b559f3cb-e26c-4560-94ac-941603bc9330 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:45.696899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b559f3cb-e26c-4560-94ac-941603bc9330 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:45.697650 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b559f3cb-e26c-4560-94ac-941603bc9330 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:45.698078 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b559f3cb-e26c-4560-94ac-941603bc9330 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:45.816045 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b559f3cb-e26c-4560-94ac-941603bc9330 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:45.823081 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b559f3cb-e26c-4560-94ac-941603bc9330 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.136704 Oct 15 03:48:45.823633 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 758/1617] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:45 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:46.041344 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0521640d-9566-4842-a737-6a34218e928c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:46.042262 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0521640d-9566-4842-a737-6a34218e928c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:46.048511 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0521640d-9566-4842-a737-6a34218e928c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:46.048963 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0521640d-9566-4842-a737-6a34218e928c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:46.049730 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0521640d-9566-4842-a737-6a34218e928c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:46.050192 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0521640d-9566-4842-a737-6a34218e928c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:46.078133 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0521640d-9566-4842-a737-6a34218e928c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040581 Oct 15 03:48:46.078665 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 860/1618] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:46 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:46.840150 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e26852e2-e33c-42c2-b944-176a47f70f1b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:46.840849 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e26852e2-e33c-42c2-b944-176a47f70f1b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:46.846803 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e26852e2-e33c-42c2-b944-176a47f70f1b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:46.847273 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e26852e2-e33c-42c2-b944-176a47f70f1b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:46.848043 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e26852e2-e33c-42c2-b944-176a47f70f1b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:46.848471 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e26852e2-e33c-42c2-b944-176a47f70f1b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:46.964667 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e26852e2-e33c-42c2-b944-176a47f70f1b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:46.972571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e26852e2-e33c-42c2-b944-176a47f70f1b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135992 Oct 15 03:48:46.973133 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 759/1619] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:46 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:47.089379 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-93c21d9e-8107-451c-b5b1-0ca29906f624 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:47.090275 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-93c21d9e-8107-451c-b5b1-0ca29906f624 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:47.096694 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-93c21d9e-8107-451c-b5b1-0ca29906f624 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:47.097127 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-93c21d9e-8107-451c-b5b1-0ca29906f624 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:47.097885 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-93c21d9e-8107-451c-b5b1-0ca29906f624 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:47.098318 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-93c21d9e-8107-451c-b5b1-0ca29906f624 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:47.126925 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-93c21d9e-8107-451c-b5b1-0ca29906f624 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041224 Oct 15 03:48:47.127480 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 861/1620] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:47 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:47.990251 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-463c0a81-259f-4e61-81c4-2b041a8546c1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:47.990780 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-463c0a81-259f-4e61-81c4-2b041a8546c1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:47.996578 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-463c0a81-259f-4e61-81c4-2b041a8546c1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:47.997022 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-463c0a81-259f-4e61-81c4-2b041a8546c1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:47.997777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-463c0a81-259f-4e61-81c4-2b041a8546c1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:47.998207 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-463c0a81-259f-4e61-81c4-2b041a8546c1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:48.113862 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-463c0a81-259f-4e61-81c4-2b041a8546c1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:48.120974 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-463c0a81-259f-4e61-81c4-2b041a8546c1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134546 Oct 15 03:48:48.121532 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 760/1621] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:47 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:48.138141 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-386c1bb0-0c9e-483a-a9d0-0f51cc13617b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:48.139038 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-386c1bb0-0c9e-483a-a9d0-0f51cc13617b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:48.144652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-386c1bb0-0c9e-483a-a9d0-0f51cc13617b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:48.145088 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-386c1bb0-0c9e-483a-a9d0-0f51cc13617b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:48.145838 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-386c1bb0-0c9e-483a-a9d0-0f51cc13617b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:48.146266 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-386c1bb0-0c9e-483a-a9d0-0f51cc13617b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:48.175059 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-386c1bb0-0c9e-483a-a9d0-0f51cc13617b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040658 Oct 15 03:48:48.175594 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 862/1622] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:48 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:49.138674 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b0dbf7e4-a4cc-4a61-a0f4-773c90ab12e9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:49.139206 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b0dbf7e4-a4cc-4a61-a0f4-773c90ab12e9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:49.145001 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b0dbf7e4-a4cc-4a61-a0f4-773c90ab12e9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:49.145446 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b0dbf7e4-a4cc-4a61-a0f4-773c90ab12e9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:49.146200 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b0dbf7e4-a4cc-4a61-a0f4-773c90ab12e9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:49.146633 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b0dbf7e4-a4cc-4a61-a0f4-773c90ab12e9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:49.186180 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6e5ab56c-98cd-42ce-ab5b-d3a3846d4c64 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:49.187090 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6e5ab56c-98cd-42ce-ab5b-d3a3846d4c64 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:49.192905 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6e5ab56c-98cd-42ce-ab5b-d3a3846d4c64 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:49.193353 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6e5ab56c-98cd-42ce-ab5b-d3a3846d4c64 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:49.194115 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6e5ab56c-98cd-42ce-ab5b-d3a3846d4c64 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:49.194546 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6e5ab56c-98cd-42ce-ab5b-d3a3846d4c64 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:49.223757 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6e5ab56c-98cd-42ce-ab5b-d3a3846d4c64 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041190 Oct 15 03:48:49.224520 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 863/1623] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:49 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 03:48:49.267054 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b0dbf7e4-a4cc-4a61-a0f4-773c90ab12e9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:49.274198 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b0dbf7e4-a4cc-4a61-a0f4-773c90ab12e9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.139714 Oct 15 03:48:49.274750 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 761/1624] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:49 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:50.234998 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-85d4ceae-97e5-41b4-9ff0-758a78c6a8f4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:50.235848 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-85d4ceae-97e5-41b4-9ff0-758a78c6a8f4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:50.242052 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-85d4ceae-97e5-41b4-9ff0-758a78c6a8f4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:50.242505 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-85d4ceae-97e5-41b4-9ff0-758a78c6a8f4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:50.243265 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-85d4ceae-97e5-41b4-9ff0-758a78c6a8f4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:50.243908 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-85d4ceae-97e5-41b4-9ff0-758a78c6a8f4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:50.273023 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-85d4ceae-97e5-41b4-9ff0-758a78c6a8f4 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041797 Oct 15 03:48:50.273550 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 864/1625] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:50 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:50.290672 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2b4881d4-0272-4fe3-a27a-e6b312297ff6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:50.291279 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2b4881d4-0272-4fe3-a27a-e6b312297ff6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:50.297098 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b4881d4-0272-4fe3-a27a-e6b312297ff6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:50.297543 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b4881d4-0272-4fe3-a27a-e6b312297ff6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:50.298301 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b4881d4-0272-4fe3-a27a-e6b312297ff6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:50.298730 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b4881d4-0272-4fe3-a27a-e6b312297ff6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:50.344145 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5cc85daf-8c99-49f7-9b26-c6658a21a2b7] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 15 03:48:50.414114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2b4881d4-0272-4fe3-a27a-e6b312297ff6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:50.421832 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2b4881d4-0272-4fe3-a27a-e6b312297ff6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134805 Oct 15 03:48:50.422391 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 762/1626] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:50 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:51.284224 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0fd8a572-4107-4ad9-82c7-b15eb6c6c156 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:51.285158 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0fd8a572-4107-4ad9-82c7-b15eb6c6c156 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:51.291180 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0fd8a572-4107-4ad9-82c7-b15eb6c6c156 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:51.291626 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0fd8a572-4107-4ad9-82c7-b15eb6c6c156 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:51.292399 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0fd8a572-4107-4ad9-82c7-b15eb6c6c156 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:51.292828 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0fd8a572-4107-4ad9-82c7-b15eb6c6c156 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:51.321449 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0fd8a572-4107-4ad9-82c7-b15eb6c6c156 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041028 Oct 15 03:48:51.321979 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 865/1627] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:51 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:51.438471 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-983d85dd-1644-4da3-b277-a673184de530 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:51.439069 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-983d85dd-1644-4da3-b277-a673184de530 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:51.456114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-983d85dd-1644-4da3-b277-a673184de530 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:51.456562 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-983d85dd-1644-4da3-b277-a673184de530 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:51.457582 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-983d85dd-1644-4da3-b277-a673184de530 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:51.458012 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-983d85dd-1644-4da3-b277-a673184de530 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:51.473674 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] [5cc85daf-8c99-49f7-9b26-c6658a21a2b7] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 60206. Oct 15 03:48:51.578441 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-983d85dd-1644-4da3-b277-a673184de530 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:51.594598 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-983d85dd-1644-4da3-b277-a673184de530 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.160226 Oct 15 03:48:51.595169 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 763/1628] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:51 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:52.332847 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cf148999-e542-4d0d-bdb0-9ca6278ee7e6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:52.333761 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cf148999-e542-4d0d-bdb0-9ca6278ee7e6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:52.339557 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cf148999-e542-4d0d-bdb0-9ca6278ee7e6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:52.340045 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cf148999-e542-4d0d-bdb0-9ca6278ee7e6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:52.340809 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cf148999-e542-4d0d-bdb0-9ca6278ee7e6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:52.341245 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cf148999-e542-4d0d-bdb0-9ca6278ee7e6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:52.368768 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cf148999-e542-4d0d-bdb0-9ca6278ee7e6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039931 Oct 15 03:48:52.369299 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 866/1629] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:52 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:52.611777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e4246faa-954c-42ac-8cf3-60e56241385b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:52.612392 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e4246faa-954c-42ac-8cf3-60e56241385b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:52.618138 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4246faa-954c-42ac-8cf3-60e56241385b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:52.618590 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4246faa-954c-42ac-8cf3-60e56241385b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:52.619369 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4246faa-954c-42ac-8cf3-60e56241385b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:52.619930 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4246faa-954c-42ac-8cf3-60e56241385b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:52.741295 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e4246faa-954c-42ac-8cf3-60e56241385b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:52.749327 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e4246faa-954c-42ac-8cf3-60e56241385b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.141179 Oct 15 03:48:52.749889 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 764/1630] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:52 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:53.380465 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a11b0a46-ffe1-4460-b2fd-85b4cbf757ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:53.381379 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a11b0a46-ffe1-4460-b2fd-85b4cbf757ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:53.387125 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a11b0a46-ffe1-4460-b2fd-85b4cbf757ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:53.387569 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a11b0a46-ffe1-4460-b2fd-85b4cbf757ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:53.388354 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a11b0a46-ffe1-4460-b2fd-85b4cbf757ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:53.388784 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a11b0a46-ffe1-4460-b2fd-85b4cbf757ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:53.415829 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a11b0a46-ffe1-4460-b2fd-85b4cbf757ae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039134 Oct 15 03:48:53.416354 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 867/1631] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 03:48:53 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:48:53.766083 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6138b29f-778b-44dd-a7a8-9bdb83d3e452 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:53.766694 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6138b29f-778b-44dd-a7a8-9bdb83d3e452 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:53.772407 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6138b29f-778b-44dd-a7a8-9bdb83d3e452 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:53.772855 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6138b29f-778b-44dd-a7a8-9bdb83d3e452 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:53.773616 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6138b29f-778b-44dd-a7a8-9bdb83d3e452 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:53.774051 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6138b29f-778b-44dd-a7a8-9bdb83d3e452 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:53.891537 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6138b29f-778b-44dd-a7a8-9bdb83d3e452 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:53.901679 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6138b29f-778b-44dd-a7a8-9bdb83d3e452 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.139172 Oct 15 03:48:53.902252 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 765/1632] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:53 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:54.427251 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-64707fa4-764d-4dd0-bf4a-854ca7018d7f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:48:54.428196 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-64707fa4-764d-4dd0-bf4a-854ca7018d7f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:54.434030 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64707fa4-764d-4dd0-bf4a-854ca7018d7f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:54.434488 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64707fa4-764d-4dd0-bf4a-854ca7018d7f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:54.435249 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64707fa4-764d-4dd0-bf4a-854ca7018d7f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:54.435696 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64707fa4-764d-4dd0-bf4a-854ca7018d7f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:54.515368 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-64707fa4-764d-4dd0-bf4a-854ca7018d7f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "POST /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/action" status: 200 len: 109900 microversion: 2.1 time: 0.091530 Oct 15 03:48:54.516392 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 868/1633] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 03:48:54 2021] POST /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d/action => generated 109900 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:48:54.920446 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5c5fa265-daf0-4c15-9efe-291e090b16cb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:54.921120 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5c5fa265-daf0-4c15-9efe-291e090b16cb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:54.926712 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c5fa265-daf0-4c15-9efe-291e090b16cb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:54.927149 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c5fa265-daf0-4c15-9efe-291e090b16cb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:54.927924 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c5fa265-daf0-4c15-9efe-291e090b16cb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:54.928350 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c5fa265-daf0-4c15-9efe-291e090b16cb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:55.042671 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5c5fa265-daf0-4c15-9efe-291e090b16cb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:55.050276 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5c5fa265-daf0-4c15-9efe-291e090b16cb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134133 Oct 15 03:48:55.050826 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 766/1634] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:54 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:56.068109 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4fbd6185-41af-4a61-a0bd-6f57f3b950d9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:56.068800 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4fbd6185-41af-4a61-a0bd-6f57f3b950d9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:56.075137 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4fbd6185-41af-4a61-a0bd-6f57f3b950d9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:56.075575 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4fbd6185-41af-4a61-a0bd-6f57f3b950d9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:56.076358 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4fbd6185-41af-4a61-a0bd-6f57f3b950d9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:56.076786 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4fbd6185-41af-4a61-a0bd-6f57f3b950d9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:56.197790 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4fbd6185-41af-4a61-a0bd-6f57f3b950d9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:56.205260 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4fbd6185-41af-4a61-a0bd-6f57f3b950d9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.141221 Oct 15 03:48:56.205812 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 869/1635] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:56 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:57.221798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-cec35c3c-a7fc-4fae-af14-68448eb81c91 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:57.222409 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-cec35c3c-a7fc-4fae-af14-68448eb81c91 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:57.228096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cec35c3c-a7fc-4fae-af14-68448eb81c91 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:57.228578 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cec35c3c-a7fc-4fae-af14-68448eb81c91 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:57.229334 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cec35c3c-a7fc-4fae-af14-68448eb81c91 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:57.229764 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cec35c3c-a7fc-4fae-af14-68448eb81c91 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:57.345744 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-cec35c3c-a7fc-4fae-af14-68448eb81c91 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:57.353027 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-cec35c3c-a7fc-4fae-af14-68448eb81c91 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134805 Oct 15 03:48:57.353590 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 767/1636] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:57 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:58.369998 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-12e4a6cc-525f-469f-8498-8541fe1a4067 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:58.370596 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-12e4a6cc-525f-469f-8498-8541fe1a4067 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:58.377178 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-12e4a6cc-525f-469f-8498-8541fe1a4067 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:58.377752 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-12e4a6cc-525f-469f-8498-8541fe1a4067 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:58.378368 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-12e4a6cc-525f-469f-8498-8541fe1a4067 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:58.378792 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-12e4a6cc-525f-469f-8498-8541fe1a4067 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:58.494676 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-12e4a6cc-525f-469f-8498-8541fe1a4067 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:58.502334 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-12e4a6cc-525f-469f-8498-8541fe1a4067 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135953 Oct 15 03:48:58.502875 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 870/1637] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:58 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:48:59.517985 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-17134b02-cc77-4450-ab3c-3ebf4bd74ad9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:48:59.518526 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-17134b02-cc77-4450-ab3c-3ebf4bd74ad9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:48:59.524458 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-17134b02-cc77-4450-ab3c-3ebf4bd74ad9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:59.524913 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-17134b02-cc77-4450-ab3c-3ebf4bd74ad9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:59.525670 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-17134b02-cc77-4450-ab3c-3ebf4bd74ad9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:48:59.526104 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-17134b02-cc77-4450-ab3c-3ebf4bd74ad9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:48:59.645435 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-17134b02-cc77-4450-ab3c-3ebf4bd74ad9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:48:59.652484 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-17134b02-cc77-4450-ab3c-3ebf4bd74ad9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138165 Oct 15 03:48:59.653039 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 768/1638] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:48:59 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:00.669689 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7cdff428-21a9-4513-9e9e-c8799488cb28 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:00.670201 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7cdff428-21a9-4513-9e9e-c8799488cb28 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:00.676341 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7cdff428-21a9-4513-9e9e-c8799488cb28 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:00.676782 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7cdff428-21a9-4513-9e9e-c8799488cb28 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:00.677530 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7cdff428-21a9-4513-9e9e-c8799488cb28 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:00.677957 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7cdff428-21a9-4513-9e9e-c8799488cb28 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:00.796111 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7cdff428-21a9-4513-9e9e-c8799488cb28 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:00.803126 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7cdff428-21a9-4513-9e9e-c8799488cb28 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.137344 Oct 15 03:49:00.803671 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 871/1639] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:00 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:01.820426 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-25518a29-3b4a-4355-80b9-5ee908706907 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:01.821028 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-25518a29-3b4a-4355-80b9-5ee908706907 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:01.827180 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-25518a29-3b4a-4355-80b9-5ee908706907 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:01.827618 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-25518a29-3b4a-4355-80b9-5ee908706907 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:01.828387 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-25518a29-3b4a-4355-80b9-5ee908706907 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:01.828811 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-25518a29-3b4a-4355-80b9-5ee908706907 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:01.946448 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-25518a29-3b4a-4355-80b9-5ee908706907 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:01.954243 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-25518a29-3b4a-4355-80b9-5ee908706907 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.137402 Oct 15 03:49:01.954796 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 769/1640] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:01 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:02.971711 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4ee2300a-04ac-4b20-ac5d-b6b167ab5627 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:02.972318 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4ee2300a-04ac-4b20-ac5d-b6b167ab5627 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:02.978086 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4ee2300a-04ac-4b20-ac5d-b6b167ab5627 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:02.978539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4ee2300a-04ac-4b20-ac5d-b6b167ab5627 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:02.979298 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4ee2300a-04ac-4b20-ac5d-b6b167ab5627 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:02.979767 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4ee2300a-04ac-4b20-ac5d-b6b167ab5627 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:03.100371 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4ee2300a-04ac-4b20-ac5d-b6b167ab5627 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:03.107417 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4ee2300a-04ac-4b20-ac5d-b6b167ab5627 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.139329 Oct 15 03:49:03.108067 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 872/1641] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:02 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:04.124302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-29292353-498d-47a3-abe8-18dedd2a9bc8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:04.124910 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-29292353-498d-47a3-abe8-18dedd2a9bc8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:04.130545 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-29292353-498d-47a3-abe8-18dedd2a9bc8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:04.131006 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-29292353-498d-47a3-abe8-18dedd2a9bc8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:04.131771 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-29292353-498d-47a3-abe8-18dedd2a9bc8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:04.132205 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-29292353-498d-47a3-abe8-18dedd2a9bc8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:04.251337 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-29292353-498d-47a3-abe8-18dedd2a9bc8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:04.258500 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-29292353-498d-47a3-abe8-18dedd2a9bc8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.137851 Oct 15 03:49:04.259056 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 770/1642] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:04 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:05.274934 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-88c8f479-1fd3-417c-8371-f3f3dd945fad tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:05.275539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-88c8f479-1fd3-417c-8371-f3f3dd945fad tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:05.282471 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-88c8f479-1fd3-417c-8371-f3f3dd945fad tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:05.282913 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-88c8f479-1fd3-417c-8371-f3f3dd945fad tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:05.283703 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-88c8f479-1fd3-417c-8371-f3f3dd945fad tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:05.284148 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-88c8f479-1fd3-417c-8371-f3f3dd945fad tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:05.441540 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-88c8f479-1fd3-417c-8371-f3f3dd945fad tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:05.448662 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-88c8f479-1fd3-417c-8371-f3f3dd945fad tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.177269 Oct 15 03:49:05.449216 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 873/1643] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:05 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:06.466544 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a632d28e-c6e5-49b3-8411-a3238d0a2aa9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:06.467090 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a632d28e-c6e5-49b3-8411-a3238d0a2aa9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:06.472761 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a632d28e-c6e5-49b3-8411-a3238d0a2aa9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:06.473208 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a632d28e-c6e5-49b3-8411-a3238d0a2aa9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:06.473961 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a632d28e-c6e5-49b3-8411-a3238d0a2aa9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:06.474390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a632d28e-c6e5-49b3-8411-a3238d0a2aa9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:06.638404 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-a632d28e-c6e5-49b3-8411-a3238d0a2aa9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:06.645727 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a632d28e-c6e5-49b3-8411-a3238d0a2aa9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.183437 Oct 15 03:49:06.646275 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 771/1644] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:06 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:07.662568 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b80a7d5d-5965-4ea6-922a-4a2252d33703 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:07.663176 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b80a7d5d-5965-4ea6-922a-4a2252d33703 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:07.669537 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b80a7d5d-5965-4ea6-922a-4a2252d33703 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:07.669987 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b80a7d5d-5965-4ea6-922a-4a2252d33703 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:07.670741 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b80a7d5d-5965-4ea6-922a-4a2252d33703 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:07.671221 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b80a7d5d-5965-4ea6-922a-4a2252d33703 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:07.788434 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b80a7d5d-5965-4ea6-922a-4a2252d33703 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:07.796091 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b80a7d5d-5965-4ea6-922a-4a2252d33703 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.137075 Oct 15 03:49:07.796641 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 874/1645] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:07 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:08.812921 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-bfb7f360-69b2-4707-ac91-6884301a84a9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:08.813519 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-bfb7f360-69b2-4707-ac91-6884301a84a9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:08.819289 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfb7f360-69b2-4707-ac91-6884301a84a9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:08.819757 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfb7f360-69b2-4707-ac91-6884301a84a9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:08.820511 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfb7f360-69b2-4707-ac91-6884301a84a9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:08.820937 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfb7f360-69b2-4707-ac91-6884301a84a9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:08.941844 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-bfb7f360-69b2-4707-ac91-6884301a84a9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:08.949012 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-bfb7f360-69b2-4707-ac91-6884301a84a9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.139925 Oct 15 03:49:08.949571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 772/1646] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:08 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:09.965951 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d3b74f88-6ae1-4b0c-a46a-5bd007b2a2ca tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:09.966539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d3b74f88-6ae1-4b0c-a46a-5bd007b2a2ca tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:09.972326 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d3b74f88-6ae1-4b0c-a46a-5bd007b2a2ca tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:09.972771 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d3b74f88-6ae1-4b0c-a46a-5bd007b2a2ca tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:09.973523 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d3b74f88-6ae1-4b0c-a46a-5bd007b2a2ca tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:09.973948 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d3b74f88-6ae1-4b0c-a46a-5bd007b2a2ca tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:10.095344 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d3b74f88-6ae1-4b0c-a46a-5bd007b2a2ca tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:10.102512 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d3b74f88-6ae1-4b0c-a46a-5bd007b2a2ca tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.140230 Oct 15 03:49:10.103059 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 875/1647] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:09 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:11.119305 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-99f1f950-961c-450b-bfa6-6b1dcafa0b40 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:11.119858 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-99f1f950-961c-450b-bfa6-6b1dcafa0b40 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:11.126111 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-99f1f950-961c-450b-bfa6-6b1dcafa0b40 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:11.126558 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-99f1f950-961c-450b-bfa6-6b1dcafa0b40 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:11.127313 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-99f1f950-961c-450b-bfa6-6b1dcafa0b40 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:11.127771 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-99f1f950-961c-450b-bfa6-6b1dcafa0b40 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:11.243806 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-99f1f950-961c-450b-bfa6-6b1dcafa0b40 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:11.251303 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-99f1f950-961c-450b-bfa6-6b1dcafa0b40 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135733 Oct 15 03:49:11.251902 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 773/1648] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:11 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:12.268641 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bb1fcd58-616f-456f-9b77-ec6eaf6d5150 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:12.269249 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bb1fcd58-616f-456f-9b77-ec6eaf6d5150 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:12.274946 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bb1fcd58-616f-456f-9b77-ec6eaf6d5150 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:12.275397 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bb1fcd58-616f-456f-9b77-ec6eaf6d5150 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:12.276178 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bb1fcd58-616f-456f-9b77-ec6eaf6d5150 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:12.276609 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bb1fcd58-616f-456f-9b77-ec6eaf6d5150 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:12.392730 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bb1fcd58-616f-456f-9b77-ec6eaf6d5150 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:12.400832 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bb1fcd58-616f-456f-9b77-ec6eaf6d5150 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134936 Oct 15 03:49:12.400832 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 876/1649] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:12 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:13.417673 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7d9994a6-2bb8-4186-8b4c-60269d6f1b27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:13.418278 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7d9994a6-2bb8-4186-8b4c-60269d6f1b27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:13.423877 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7d9994a6-2bb8-4186-8b4c-60269d6f1b27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:13.424327 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7d9994a6-2bb8-4186-8b4c-60269d6f1b27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:13.425077 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7d9994a6-2bb8-4186-8b4c-60269d6f1b27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:13.425663 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7d9994a6-2bb8-4186-8b4c-60269d6f1b27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:13.545411 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7d9994a6-2bb8-4186-8b4c-60269d6f1b27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:13.552596 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7d9994a6-2bb8-4186-8b4c-60269d6f1b27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138464 Oct 15 03:49:13.553144 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 774/1650] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:13 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:14.570259 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c63d29a0-6831-4a80-a473-5653ce82e729 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:14.570970 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c63d29a0-6831-4a80-a473-5653ce82e729 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:14.577638 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c63d29a0-6831-4a80-a473-5653ce82e729 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:14.578082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c63d29a0-6831-4a80-a473-5653ce82e729 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:14.578839 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c63d29a0-6831-4a80-a473-5653ce82e729 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:14.579273 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c63d29a0-6831-4a80-a473-5653ce82e729 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:14.702662 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c63d29a0-6831-4a80-a473-5653ce82e729 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:14.710153 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c63d29a0-6831-4a80-a473-5653ce82e729 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.144150 Oct 15 03:49:14.710696 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 877/1651] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:14 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:15.727051 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-bbcd12c7-b6fe-4c29-8f7a-18c22dda510d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:15.727651 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-bbcd12c7-b6fe-4c29-8f7a-18c22dda510d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:15.733937 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bbcd12c7-b6fe-4c29-8f7a-18c22dda510d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:15.734379 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bbcd12c7-b6fe-4c29-8f7a-18c22dda510d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:15.735130 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bbcd12c7-b6fe-4c29-8f7a-18c22dda510d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:15.735558 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bbcd12c7-b6fe-4c29-8f7a-18c22dda510d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:15.849895 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-bbcd12c7-b6fe-4c29-8f7a-18c22dda510d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:15.857142 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-bbcd12c7-b6fe-4c29-8f7a-18c22dda510d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.133687 Oct 15 03:49:15.857707 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 775/1652] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:15 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:16.874631 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a78c7fe1-750f-4448-9540-37034d155392 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:16.875167 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a78c7fe1-750f-4448-9540-37034d155392 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:16.880889 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a78c7fe1-750f-4448-9540-37034d155392 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:16.881334 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a78c7fe1-750f-4448-9540-37034d155392 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:16.882090 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a78c7fe1-750f-4448-9540-37034d155392 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:16.882521 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a78c7fe1-750f-4448-9540-37034d155392 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:17.002490 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a78c7fe1-750f-4448-9540-37034d155392 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:17.010497 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a78c7fe1-750f-4448-9540-37034d155392 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.140238 Oct 15 03:49:17.011052 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 878/1653] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:16 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:18.027092 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d52ed900-d466-49d0-9bbc-031db0bc93c5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:18.028229 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d52ed900-d466-49d0-9bbc-031db0bc93c5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:18.033927 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d52ed900-d466-49d0-9bbc-031db0bc93c5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:18.034372 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d52ed900-d466-49d0-9bbc-031db0bc93c5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:18.035135 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d52ed900-d466-49d0-9bbc-031db0bc93c5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:18.035568 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d52ed900-d466-49d0-9bbc-031db0bc93c5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:18.151043 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d52ed900-d466-49d0-9bbc-031db0bc93c5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:18.158844 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d52ed900-d466-49d0-9bbc-031db0bc93c5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135448 Oct 15 03:49:18.159408 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 776/1654] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:18 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:19.175562 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-64260faf-992f-4aa0-a157-78b072ba805d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:19.176228 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-64260faf-992f-4aa0-a157-78b072ba805d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:19.182167 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64260faf-992f-4aa0-a157-78b072ba805d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:19.182611 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64260faf-992f-4aa0-a157-78b072ba805d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:19.183363 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64260faf-992f-4aa0-a157-78b072ba805d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:19.183826 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-64260faf-992f-4aa0-a157-78b072ba805d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:19.301607 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-64260faf-992f-4aa0-a157-78b072ba805d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:19.308742 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-64260faf-992f-4aa0-a157-78b072ba805d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.136873 Oct 15 03:49:19.309842 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 879/1655] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:19 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:20.326243 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-62d3dba1-593a-47de-a31e-6ef5015513e2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:20.326852 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-62d3dba1-593a-47de-a31e-6ef5015513e2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:20.333037 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-62d3dba1-593a-47de-a31e-6ef5015513e2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:20.333474 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-62d3dba1-593a-47de-a31e-6ef5015513e2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:20.334235 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-62d3dba1-593a-47de-a31e-6ef5015513e2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:20.334664 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-62d3dba1-593a-47de-a31e-6ef5015513e2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:20.453183 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-62d3dba1-593a-47de-a31e-6ef5015513e2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:20.460709 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-62d3dba1-593a-47de-a31e-6ef5015513e2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138540 Oct 15 03:49:20.461199 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 777/1656] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:20 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:21.477424 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-045e1d90-574e-4bf3-a38a-0b5e489bb7f7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:21.477964 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-045e1d90-574e-4bf3-a38a-0b5e489bb7f7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:21.484382 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-045e1d90-574e-4bf3-a38a-0b5e489bb7f7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:21.484829 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-045e1d90-574e-4bf3-a38a-0b5e489bb7f7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:21.485585 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-045e1d90-574e-4bf3-a38a-0b5e489bb7f7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:21.486016 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-045e1d90-574e-4bf3-a38a-0b5e489bb7f7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:21.607591 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-045e1d90-574e-4bf3-a38a-0b5e489bb7f7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:21.614817 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-045e1d90-574e-4bf3-a38a-0b5e489bb7f7 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.141089 Oct 15 03:49:21.615371 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 880/1657] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:21 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:22.631331 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d29db9b1-3b61-4f12-bbb8-70be6519ea0d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:22.631964 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d29db9b1-3b61-4f12-bbb8-70be6519ea0d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:22.637785 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d29db9b1-3b61-4f12-bbb8-70be6519ea0d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:22.638233 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d29db9b1-3b61-4f12-bbb8-70be6519ea0d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:22.638986 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d29db9b1-3b61-4f12-bbb8-70be6519ea0d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:22.639419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d29db9b1-3b61-4f12-bbb8-70be6519ea0d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:22.753986 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d29db9b1-3b61-4f12-bbb8-70be6519ea0d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:22.761053 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d29db9b1-3b61-4f12-bbb8-70be6519ea0d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.133339 Oct 15 03:49:22.761606 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 778/1658] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:22 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:23.777982 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f490fa57-08af-440c-bd74-50d1418a808f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:23.778589 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f490fa57-08af-440c-bd74-50d1418a808f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:23.784440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f490fa57-08af-440c-bd74-50d1418a808f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:23.784887 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f490fa57-08af-440c-bd74-50d1418a808f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:23.785643 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f490fa57-08af-440c-bd74-50d1418a808f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:23.786078 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f490fa57-08af-440c-bd74-50d1418a808f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:23.904790 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f490fa57-08af-440c-bd74-50d1418a808f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:23.911971 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f490fa57-08af-440c-bd74-50d1418a808f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.137756 Oct 15 03:49:23.912521 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 881/1659] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:23 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:24.928919 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e12eda0e-780b-4e73-816f-4cb187857a89 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:24.929530 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e12eda0e-780b-4e73-816f-4cb187857a89 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:24.935490 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e12eda0e-780b-4e73-816f-4cb187857a89 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:24.935969 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e12eda0e-780b-4e73-816f-4cb187857a89 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:24.936716 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e12eda0e-780b-4e73-816f-4cb187857a89 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:24.937142 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e12eda0e-780b-4e73-816f-4cb187857a89 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:25.056348 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e12eda0e-780b-4e73-816f-4cb187857a89 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:25.063937 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e12eda0e-780b-4e73-816f-4cb187857a89 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138612 Oct 15 03:49:25.064492 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 779/1660] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:24 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:26.080419 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fe61b154-19c4-4efc-9a82-dd23717a2b27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:26.081021 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fe61b154-19c4-4efc-9a82-dd23717a2b27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:26.086870 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fe61b154-19c4-4efc-9a82-dd23717a2b27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:26.087316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fe61b154-19c4-4efc-9a82-dd23717a2b27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:26.088100 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fe61b154-19c4-4efc-9a82-dd23717a2b27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:26.088536 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fe61b154-19c4-4efc-9a82-dd23717a2b27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:26.205159 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fe61b154-19c4-4efc-9a82-dd23717a2b27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:26.212646 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fe61b154-19c4-4efc-9a82-dd23717a2b27 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135770 Oct 15 03:49:26.213197 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 882/1661] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:26 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:27.229705 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-85196317-439e-4b78-9d89-4b137aefaf51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:27.230346 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-85196317-439e-4b78-9d89-4b137aefaf51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:27.236192 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-85196317-439e-4b78-9d89-4b137aefaf51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:27.236629 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-85196317-439e-4b78-9d89-4b137aefaf51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:27.237376 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-85196317-439e-4b78-9d89-4b137aefaf51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:27.237807 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-85196317-439e-4b78-9d89-4b137aefaf51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:27.361031 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-85196317-439e-4b78-9d89-4b137aefaf51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:27.368322 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-85196317-439e-4b78-9d89-4b137aefaf51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.142289 Oct 15 03:49:27.368913 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 780/1662] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:27 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:28.385001 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0db1f1c8-eb08-4c2a-b4f1-6e4128baa906 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:28.385617 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0db1f1c8-eb08-4c2a-b4f1-6e4128baa906 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:28.391401 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0db1f1c8-eb08-4c2a-b4f1-6e4128baa906 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:28.391885 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0db1f1c8-eb08-4c2a-b4f1-6e4128baa906 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:28.392644 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0db1f1c8-eb08-4c2a-b4f1-6e4128baa906 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:28.393079 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0db1f1c8-eb08-4c2a-b4f1-6e4128baa906 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:28.510820 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0db1f1c8-eb08-4c2a-b4f1-6e4128baa906 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:28.517907 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0db1f1c8-eb08-4c2a-b4f1-6e4128baa906 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.136617 Oct 15 03:49:28.518470 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 883/1663] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:28 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:29.534468 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5c9a6119-97e6-44d1-a152-ad1343e850f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:29.535084 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5c9a6119-97e6-44d1-a152-ad1343e850f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:29.540913 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c9a6119-97e6-44d1-a152-ad1343e850f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:29.541359 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c9a6119-97e6-44d1-a152-ad1343e850f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:29.542117 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c9a6119-97e6-44d1-a152-ad1343e850f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:29.542551 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c9a6119-97e6-44d1-a152-ad1343e850f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:29.657059 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5c9a6119-97e6-44d1-a152-ad1343e850f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:29.664231 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5c9a6119-97e6-44d1-a152-ad1343e850f5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.133319 Oct 15 03:49:29.664724 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 781/1664] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:29 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:30.680940 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-05e07cee-cbf3-4d01-9920-4893efb92cd5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:30.681549 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-05e07cee-cbf3-4d01-9920-4893efb92cd5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:30.688284 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-05e07cee-cbf3-4d01-9920-4893efb92cd5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:30.688686 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-05e07cee-cbf3-4d01-9920-4893efb92cd5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:30.689444 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-05e07cee-cbf3-4d01-9920-4893efb92cd5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:30.689879 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-05e07cee-cbf3-4d01-9920-4893efb92cd5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:30.810366 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-05e07cee-cbf3-4d01-9920-4893efb92cd5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:30.817534 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-05e07cee-cbf3-4d01-9920-4893efb92cd5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.140306 Oct 15 03:49:30.818079 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 884/1665] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:30 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:31.836276 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a9f652a3-f963-4b48-8f17-2c6fc02bb1f3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:31.836886 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a9f652a3-f963-4b48-8f17-2c6fc02bb1f3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:31.842626 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a9f652a3-f963-4b48-8f17-2c6fc02bb1f3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:31.843075 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a9f652a3-f963-4b48-8f17-2c6fc02bb1f3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:31.843871 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a9f652a3-f963-4b48-8f17-2c6fc02bb1f3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:31.844304 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a9f652a3-f963-4b48-8f17-2c6fc02bb1f3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:31.961050 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-a9f652a3-f963-4b48-8f17-2c6fc02bb1f3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:31.968722 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a9f652a3-f963-4b48-8f17-2c6fc02bb1f3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.136852 Oct 15 03:49:31.969278 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 782/1666] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:31 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:32.986041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6aeb464f-acc7-48e1-a025-e79965ee050c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:32.986655 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6aeb464f-acc7-48e1-a025-e79965ee050c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:32.992409 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6aeb464f-acc7-48e1-a025-e79965ee050c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:32.992861 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6aeb464f-acc7-48e1-a025-e79965ee050c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:32.993647 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6aeb464f-acc7-48e1-a025-e79965ee050c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:32.994084 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6aeb464f-acc7-48e1-a025-e79965ee050c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:33.110202 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6aeb464f-acc7-48e1-a025-e79965ee050c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:33.117327 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6aeb464f-acc7-48e1-a025-e79965ee050c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134891 Oct 15 03:49:33.117878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 885/1667] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:32 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:34.134041 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-68f6f1d3-c461-4161-ad45-80100f6236da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:34.134645 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-68f6f1d3-c461-4161-ad45-80100f6236da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:34.140838 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-68f6f1d3-c461-4161-ad45-80100f6236da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:34.141282 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-68f6f1d3-c461-4161-ad45-80100f6236da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:34.142038 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-68f6f1d3-c461-4161-ad45-80100f6236da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:34.142468 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-68f6f1d3-c461-4161-ad45-80100f6236da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:34.356825 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-68f6f1d3-c461-4161-ad45-80100f6236da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:34.364159 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-68f6f1d3-c461-4161-ad45-80100f6236da tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.233729 Oct 15 03:49:34.364722 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 783/1668] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:34 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:35.380979 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7df95782-09f0-4ff3-90ed-b11c5c479ab8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:35.381584 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7df95782-09f0-4ff3-90ed-b11c5c479ab8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:35.387309 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7df95782-09f0-4ff3-90ed-b11c5c479ab8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:35.387781 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7df95782-09f0-4ff3-90ed-b11c5c479ab8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:35.388524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7df95782-09f0-4ff3-90ed-b11c5c479ab8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:35.388949 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7df95782-09f0-4ff3-90ed-b11c5c479ab8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:35.506417 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7df95782-09f0-4ff3-90ed-b11c5c479ab8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:35.513589 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7df95782-09f0-4ff3-90ed-b11c5c479ab8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.136248 Oct 15 03:49:35.514138 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 886/1669] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:35 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:36.530429 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3e6409b2-ec66-4e78-8933-8862e2c6d6bc tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:36.531037 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3e6409b2-ec66-4e78-8933-8862e2c6d6bc tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:36.541160 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3e6409b2-ec66-4e78-8933-8862e2c6d6bc tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:36.541614 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3e6409b2-ec66-4e78-8933-8862e2c6d6bc tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:36.542384 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3e6409b2-ec66-4e78-8933-8862e2c6d6bc tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:36.542830 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3e6409b2-ec66-4e78-8933-8862e2c6d6bc tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:36.661018 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3e6409b2-ec66-4e78-8933-8862e2c6d6bc tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:36.668236 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3e6409b2-ec66-4e78-8933-8862e2c6d6bc tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.141958 Oct 15 03:49:36.668801 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 784/1670] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:36 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:37.686404 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0b8b85ec-9635-4b7c-a7d9-5be0a95ff123 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:37.687218 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0b8b85ec-9635-4b7c-a7d9-5be0a95ff123 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:37.692878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0b8b85ec-9635-4b7c-a7d9-5be0a95ff123 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:37.693323 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0b8b85ec-9635-4b7c-a7d9-5be0a95ff123 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:37.694076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0b8b85ec-9635-4b7c-a7d9-5be0a95ff123 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:37.694508 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0b8b85ec-9635-4b7c-a7d9-5be0a95ff123 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:37.817255 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0b8b85ec-9635-4b7c-a7d9-5be0a95ff123 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:37.824300 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0b8b85ec-9635-4b7c-a7d9-5be0a95ff123 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.142299 Oct 15 03:49:37.824846 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 887/1671] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:37 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:38.841069 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7d8141eb-c019-4127-aaee-0c54c933ae62 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:38.841645 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7d8141eb-c019-4127-aaee-0c54c933ae62 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:38.847214 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7d8141eb-c019-4127-aaee-0c54c933ae62 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:38.847654 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7d8141eb-c019-4127-aaee-0c54c933ae62 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:38.848425 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7d8141eb-c019-4127-aaee-0c54c933ae62 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:38.848850 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7d8141eb-c019-4127-aaee-0c54c933ae62 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:38.963131 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7d8141eb-c019-4127-aaee-0c54c933ae62 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:38.970291 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7d8141eb-c019-4127-aaee-0c54c933ae62 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.132806 Oct 15 03:49:38.970838 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 785/1672] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:38 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:39.986391 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-941740a4-cce5-4473-a4ea-751484bca194 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:39.986897 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-941740a4-cce5-4473-a4ea-751484bca194 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:39.993002 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-941740a4-cce5-4473-a4ea-751484bca194 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:39.993448 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-941740a4-cce5-4473-a4ea-751484bca194 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:39.994218 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-941740a4-cce5-4473-a4ea-751484bca194 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:39.994654 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-941740a4-cce5-4473-a4ea-751484bca194 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:40.113732 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-941740a4-cce5-4473-a4ea-751484bca194 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:40.120933 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-941740a4-cce5-4473-a4ea-751484bca194 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138243 Oct 15 03:49:40.121492 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 888/1673] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:39 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:41.137566 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-06e5894b-a549-4266-8b35-bd66904d0944 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:41.138164 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-06e5894b-a549-4266-8b35-bd66904d0944 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:41.143876 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-06e5894b-a549-4266-8b35-bd66904d0944 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:41.144321 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-06e5894b-a549-4266-8b35-bd66904d0944 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:41.145108 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-06e5894b-a549-4266-8b35-bd66904d0944 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:41.145534 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-06e5894b-a549-4266-8b35-bd66904d0944 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:41.269198 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-06e5894b-a549-4266-8b35-bd66904d0944 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:41.276353 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-06e5894b-a549-4266-8b35-bd66904d0944 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.142438 Oct 15 03:49:41.276916 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 786/1674] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:41 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:42.293061 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6011bcc1-ce20-4550-a0b2-b7fbc5f6dc60 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:42.293663 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6011bcc1-ce20-4550-a0b2-b7fbc5f6dc60 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:42.299375 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6011bcc1-ce20-4550-a0b2-b7fbc5f6dc60 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:42.299853 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6011bcc1-ce20-4550-a0b2-b7fbc5f6dc60 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:42.300601 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6011bcc1-ce20-4550-a0b2-b7fbc5f6dc60 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:42.301029 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6011bcc1-ce20-4550-a0b2-b7fbc5f6dc60 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:42.421231 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6011bcc1-ce20-4550-a0b2-b7fbc5f6dc60 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:42.428308 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6011bcc1-ce20-4550-a0b2-b7fbc5f6dc60 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138900 Oct 15 03:49:42.428850 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 889/1675] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:42 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:43.445338 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-80ef7e06-3983-4f9e-bc80-7dae1b957c4b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:43.445948 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-80ef7e06-3983-4f9e-bc80-7dae1b957c4b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:43.451643 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-80ef7e06-3983-4f9e-bc80-7dae1b957c4b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:43.452110 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-80ef7e06-3983-4f9e-bc80-7dae1b957c4b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:43.452868 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-80ef7e06-3983-4f9e-bc80-7dae1b957c4b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:43.453302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-80ef7e06-3983-4f9e-bc80-7dae1b957c4b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:43.569543 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-80ef7e06-3983-4f9e-bc80-7dae1b957c4b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:43.577235 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-80ef7e06-3983-4f9e-bc80-7dae1b957c4b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135516 Oct 15 03:49:43.577785 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 787/1676] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:43 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:44.593796 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-33af7193-1519-4719-8420-b0fef35efb49 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:44.594363 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-33af7193-1519-4719-8420-b0fef35efb49 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:44.599986 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-33af7193-1519-4719-8420-b0fef35efb49 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:44.600434 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-33af7193-1519-4719-8420-b0fef35efb49 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:44.601188 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-33af7193-1519-4719-8420-b0fef35efb49 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:44.601620 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-33af7193-1519-4719-8420-b0fef35efb49 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:44.722437 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-33af7193-1519-4719-8420-b0fef35efb49 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:44.729598 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-33af7193-1519-4719-8420-b0fef35efb49 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.139502 Oct 15 03:49:44.730149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 890/1677] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:44 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:45.747271 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5d82eb84-5f0a-4cb8-b9dc-a7c3084035c5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:45.747909 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5d82eb84-5f0a-4cb8-b9dc-a7c3084035c5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:45.754199 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5d82eb84-5f0a-4cb8-b9dc-a7c3084035c5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:45.754641 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5d82eb84-5f0a-4cb8-b9dc-a7c3084035c5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:45.755389 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5d82eb84-5f0a-4cb8-b9dc-a7c3084035c5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:45.755845 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5d82eb84-5f0a-4cb8-b9dc-a7c3084035c5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:45.870636 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5d82eb84-5f0a-4cb8-b9dc-a7c3084035c5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:45.878368 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5d82eb84-5f0a-4cb8-b9dc-a7c3084035c5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134737 Oct 15 03:49:45.878917 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 788/1678] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:45 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:46.894625 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-edadb59c-0a99-4900-8d38-3b415d50dc86 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:46.895229 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-edadb59c-0a99-4900-8d38-3b415d50dc86 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:46.900867 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edadb59c-0a99-4900-8d38-3b415d50dc86 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:46.901303 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edadb59c-0a99-4900-8d38-3b415d50dc86 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:46.902046 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edadb59c-0a99-4900-8d38-3b415d50dc86 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:46.902471 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edadb59c-0a99-4900-8d38-3b415d50dc86 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:47.020019 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-edadb59c-0a99-4900-8d38-3b415d50dc86 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:47.027122 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-edadb59c-0a99-4900-8d38-3b415d50dc86 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.136161 Oct 15 03:49:47.027673 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 891/1679] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:46 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:48.043743 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e884b1b8-fad8-4783-a247-f24fd79d7b6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:48.044375 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e884b1b8-fad8-4783-a247-f24fd79d7b6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:48.050075 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e884b1b8-fad8-4783-a247-f24fd79d7b6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:48.050515 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e884b1b8-fad8-4783-a247-f24fd79d7b6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:48.051265 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e884b1b8-fad8-4783-a247-f24fd79d7b6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:48.051727 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e884b1b8-fad8-4783-a247-f24fd79d7b6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:48.172181 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e884b1b8-fad8-4783-a247-f24fd79d7b6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:48.179494 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e884b1b8-fad8-4783-a247-f24fd79d7b6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.139428 Oct 15 03:49:48.180067 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 789/1680] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:48 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:49.195611 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a13c81c7-c2c3-4e58-b754-c2ee989c05b3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:49.196247 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a13c81c7-c2c3-4e58-b754-c2ee989c05b3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:49.201851 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a13c81c7-c2c3-4e58-b754-c2ee989c05b3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:49.202298 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a13c81c7-c2c3-4e58-b754-c2ee989c05b3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:49.203054 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a13c81c7-c2c3-4e58-b754-c2ee989c05b3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:49.203496 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a13c81c7-c2c3-4e58-b754-c2ee989c05b3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:49.323798 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a13c81c7-c2c3-4e58-b754-c2ee989c05b3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:49.330913 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a13c81c7-c2c3-4e58-b754-c2ee989c05b3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138907 Oct 15 03:49:49.331749 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 892/1681] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:49 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:50.348685 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4ef232d1-b260-495b-80a1-3e8c324960b2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:50.349292 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4ef232d1-b260-495b-80a1-3e8c324960b2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:50.354898 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4ef232d1-b260-495b-80a1-3e8c324960b2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:50.355345 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4ef232d1-b260-495b-80a1-3e8c324960b2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:50.356130 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4ef232d1-b260-495b-80a1-3e8c324960b2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:50.356552 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4ef232d1-b260-495b-80a1-3e8c324960b2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:50.472899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4ef232d1-b260-495b-80a1-3e8c324960b2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:50.480283 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4ef232d1-b260-495b-80a1-3e8c324960b2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135250 Oct 15 03:49:50.480833 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 790/1682] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:50 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:51.496760 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0ce18ac8-c66f-4833-a523-19435eec556e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:51.497374 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0ce18ac8-c66f-4833-a523-19435eec556e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:51.503001 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0ce18ac8-c66f-4833-a523-19435eec556e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:51.503450 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0ce18ac8-c66f-4833-a523-19435eec556e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:51.504268 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0ce18ac8-c66f-4833-a523-19435eec556e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:51.504701 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0ce18ac8-c66f-4833-a523-19435eec556e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:51.625404 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0ce18ac8-c66f-4833-a523-19435eec556e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:51.632567 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0ce18ac8-c66f-4833-a523-19435eec556e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.139454 Oct 15 03:49:51.633118 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 893/1683] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:51 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:52.649472 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-deac8c58-922f-45d7-80f7-80016f63080e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:52.650005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-deac8c58-922f-45d7-80f7-80016f63080e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:52.655918 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-deac8c58-922f-45d7-80f7-80016f63080e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:52.656376 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-deac8c58-922f-45d7-80f7-80016f63080e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:52.657131 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-deac8c58-922f-45d7-80f7-80016f63080e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:52.657563 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-deac8c58-922f-45d7-80f7-80016f63080e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:52.773689 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-deac8c58-922f-45d7-80f7-80016f63080e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:52.780743 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-deac8c58-922f-45d7-80f7-80016f63080e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135201 Oct 15 03:49:52.781299 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 791/1684] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:52 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:53.798087 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-eef07f5c-f84f-49c0-98de-b5e27cc2ee39 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:53.798620 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-eef07f5c-f84f-49c0-98de-b5e27cc2ee39 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:53.804921 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eef07f5c-f84f-49c0-98de-b5e27cc2ee39 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:53.805375 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eef07f5c-f84f-49c0-98de-b5e27cc2ee39 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:53.806141 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eef07f5c-f84f-49c0-98de-b5e27cc2ee39 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:53.806576 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eef07f5c-f84f-49c0-98de-b5e27cc2ee39 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:53.930729 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-eef07f5c-f84f-49c0-98de-b5e27cc2ee39 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:53.937968 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-eef07f5c-f84f-49c0-98de-b5e27cc2ee39 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.144300 Oct 15 03:49:53.938520 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 894/1685] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:53 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:54.954354 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f45f698e-3a39-48f8-81d6-314d26a7bdbb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:54.954956 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f45f698e-3a39-48f8-81d6-314d26a7bdbb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:54.960853 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f45f698e-3a39-48f8-81d6-314d26a7bdbb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:54.961324 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f45f698e-3a39-48f8-81d6-314d26a7bdbb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:54.962088 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f45f698e-3a39-48f8-81d6-314d26a7bdbb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:54.962533 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f45f698e-3a39-48f8-81d6-314d26a7bdbb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:55.083218 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f45f698e-3a39-48f8-81d6-314d26a7bdbb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:55.090427 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f45f698e-3a39-48f8-81d6-314d26a7bdbb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.140121 Oct 15 03:49:55.090985 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 792/1686] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:54 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:56.107696 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-eb685a7f-5d44-4d9c-8320-b9967204b45b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:56.108864 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-eb685a7f-5d44-4d9c-8320-b9967204b45b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:56.114526 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eb685a7f-5d44-4d9c-8320-b9967204b45b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:56.114973 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eb685a7f-5d44-4d9c-8320-b9967204b45b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:56.115757 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eb685a7f-5d44-4d9c-8320-b9967204b45b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:56.116193 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eb685a7f-5d44-4d9c-8320-b9967204b45b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:56.235033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-eb685a7f-5d44-4d9c-8320-b9967204b45b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:56.242630 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-eb685a7f-5d44-4d9c-8320-b9967204b45b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138556 Oct 15 03:49:56.243195 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 895/1687] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:56 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:57.259486 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ce6d0571-2d9e-4d9d-9699-8e46672708ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:57.260067 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ce6d0571-2d9e-4d9d-9699-8e46672708ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:57.265819 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce6d0571-2d9e-4d9d-9699-8e46672708ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:57.266264 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce6d0571-2d9e-4d9d-9699-8e46672708ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:57.267018 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce6d0571-2d9e-4d9d-9699-8e46672708ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:57.267447 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce6d0571-2d9e-4d9d-9699-8e46672708ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:57.382529 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ce6d0571-2d9e-4d9d-9699-8e46672708ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:57.389608 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ce6d0571-2d9e-4d9d-9699-8e46672708ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.133881 Oct 15 03:49:57.390220 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 793/1688] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:57 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:58.090524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:49:58.090998 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 03:49:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:49:58.406164 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e6341854-5d76-47bf-899c-af825954b18b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:58.406778 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e6341854-5d76-47bf-899c-af825954b18b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:58.412624 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e6341854-5d76-47bf-899c-af825954b18b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:58.413070 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e6341854-5d76-47bf-899c-af825954b18b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:58.413831 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e6341854-5d76-47bf-899c-af825954b18b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:58.414266 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e6341854-5d76-47bf-899c-af825954b18b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:58.688901 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e6341854-5d76-47bf-899c-af825954b18b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:58.696211 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e6341854-5d76-47bf-899c-af825954b18b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.293695 Oct 15 03:49:58.696854 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 896/1689] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:58 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:49:59.712686 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3f1dcf42-127f-4902-8280-292a6b15c669 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:49:59.713289 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3f1dcf42-127f-4902-8280-292a6b15c669 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:49:59.718877 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f1dcf42-127f-4902-8280-292a6b15c669 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:59.719316 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f1dcf42-127f-4902-8280-292a6b15c669 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:59.720091 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f1dcf42-127f-4902-8280-292a6b15c669 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:49:59.720525 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3f1dcf42-127f-4902-8280-292a6b15c669 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:49:59.839201 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3f1dcf42-127f-4902-8280-292a6b15c669 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:49:59.846449 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3f1dcf42-127f-4902-8280-292a6b15c669 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.137289 Oct 15 03:49:59.847004 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 794/1690] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:49:59 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:00.863444 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a363a605-b126-432a-9ed6-b18872dcf938 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:00.864093 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a363a605-b126-432a-9ed6-b18872dcf938 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:00.869727 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a363a605-b126-432a-9ed6-b18872dcf938 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:00.870173 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a363a605-b126-432a-9ed6-b18872dcf938 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:00.870932 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a363a605-b126-432a-9ed6-b18872dcf938 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:00.871363 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a363a605-b126-432a-9ed6-b18872dcf938 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:00.987187 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a363a605-b126-432a-9ed6-b18872dcf938 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:00.994324 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a363a605-b126-432a-9ed6-b18872dcf938 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.134461 Oct 15 03:50:00.994864 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 897/1691] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:00 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:02.011623 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ad92f0e7-43c6-4fbd-b14c-7d3d52b9c693 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:02.012290 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ad92f0e7-43c6-4fbd-b14c-7d3d52b9c693 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:02.018887 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ad92f0e7-43c6-4fbd-b14c-7d3d52b9c693 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:02.019332 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ad92f0e7-43c6-4fbd-b14c-7d3d52b9c693 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:02.020152 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ad92f0e7-43c6-4fbd-b14c-7d3d52b9c693 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:02.020586 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ad92f0e7-43c6-4fbd-b14c-7d3d52b9c693 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:02.138537 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ad92f0e7-43c6-4fbd-b14c-7d3d52b9c693 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:02.146202 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ad92f0e7-43c6-4fbd-b14c-7d3d52b9c693 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138251 Oct 15 03:50:02.146750 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 795/1692] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:02 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:03.163199 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-dd9ab595-f98e-4626-9805-530a1f56318b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:03.163763 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-dd9ab595-f98e-4626-9805-530a1f56318b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:03.169539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dd9ab595-f98e-4626-9805-530a1f56318b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:03.169992 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dd9ab595-f98e-4626-9805-530a1f56318b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:03.171269 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dd9ab595-f98e-4626-9805-530a1f56318b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:03.171790 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dd9ab595-f98e-4626-9805-530a1f56318b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:03.288440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-dd9ab595-f98e-4626-9805-530a1f56318b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:03.296080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-dd9ab595-f98e-4626-9805-530a1f56318b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.136119 Oct 15 03:50:03.296617 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 898/1693] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:03 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:04.313471 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fcd618f8-28d0-440e-8eaf-914689385ad6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:04.314083 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fcd618f8-28d0-440e-8eaf-914689385ad6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:04.319909 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fcd618f8-28d0-440e-8eaf-914689385ad6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:04.320361 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fcd618f8-28d0-440e-8eaf-914689385ad6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:04.321202 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fcd618f8-28d0-440e-8eaf-914689385ad6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:04.321639 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fcd618f8-28d0-440e-8eaf-914689385ad6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:04.437437 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fcd618f8-28d0-440e-8eaf-914689385ad6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:04.444584 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fcd618f8-28d0-440e-8eaf-914689385ad6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.135291 Oct 15 03:50:04.445143 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 796/1694] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:04 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:05.461939 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8be06eb0-df93-420b-a928-c7ecad6f4469 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:05.462544 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8be06eb0-df93-420b-a928-c7ecad6f4469 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:05.468849 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8be06eb0-df93-420b-a928-c7ecad6f4469 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:05.469284 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8be06eb0-df93-420b-a928-c7ecad6f4469 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:05.470029 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8be06eb0-df93-420b-a928-c7ecad6f4469 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:05.470450 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8be06eb0-df93-420b-a928-c7ecad6f4469 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:05.589053 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8be06eb0-df93-420b-a928-c7ecad6f4469 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:05.596851 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8be06eb0-df93-420b-a928-c7ecad6f4469 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1563 microversion: 2.1 time: 0.138509 Oct 15 03:50:05.597395 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 899/1695] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:05 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:05.649740 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:50:05.649943 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 03:50:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:50:06.427228 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-539e3db0-d784-4583-93b3-fa7c9170e4de tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:06.428036 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-539e3db0-d784-4583-93b3-fa7c9170e4de tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:06.434216 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-539e3db0-d784-4583-93b3-fa7c9170e4de tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:06.434672 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-539e3db0-d784-4583-93b3-fa7c9170e4de tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:06.435436 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-539e3db0-d784-4583-93b3-fa7c9170e4de tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:06.435947 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-539e3db0-d784-4583-93b3-fa7c9170e4de tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:06.461593 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-539e3db0-d784-4583-93b3-fa7c9170e4de tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Going to try to terminate instance {{(pid=120899) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 15 03:50:06.485156 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-ebf48cc7-77a2-4620-beb4-f8747b5f7e06 req-db81bfb6-5f28-4b30-8767-0546441f09a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37285523-63b9-4079-939b-b156366439e6", "tag": "6991361a-3fd3-4d0d-8d4b-edd950821f5d"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:50:06.486893 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:50:06.486893 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:50:06.494873 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-ebf48cc7-77a2-4620-beb4-f8747b5f7e06 req-db81bfb6-5f28-4b30-8767-0546441f09a4 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:06.495462 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-ebf48cc7-77a2-4620-beb4-f8747b5f7e06 req-db81bfb6-5f28-4b30-8767-0546441f09a4 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:06.507485 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-ebf48cc7-77a2-4620-beb4-f8747b5f7e06 req-db81bfb6-5f28-4b30-8767-0546441f09a4 service nova] Creating event network-changed:6991361a-3fd3-4d0d-8d4b-edd950821f5d for instance 37285523-63b9-4079-939b-b156366439e6 on hv-cinder-81410 Oct 15 03:50:06.514850 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-ebf48cc7-77a2-4620-beb4-f8747b5f7e06 req-db81bfb6-5f28-4b30-8767-0546441f09a4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087862 Oct 15 03:50:06.515861 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 900/1696] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:50:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:50:06.555601 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-539e3db0-d784-4583-93b3-fa7c9170e4de tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "DELETE /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 204 len: 0 microversion: 2.1 time: 0.131726 Oct 15 03:50:06.559895 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 797/1697] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 03:50:06 2021] DELETE /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 03:50:06.565947 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-80d0f5ed-86f2-4b6b-8aec-40527e2b7ff1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:06.566672 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-80d0f5ed-86f2-4b6b-8aec-40527e2b7ff1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:06.572750 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-80d0f5ed-86f2-4b6b-8aec-40527e2b7ff1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:06.573163 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-80d0f5ed-86f2-4b6b-8aec-40527e2b7ff1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:06.574032 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-80d0f5ed-86f2-4b6b-8aec-40527e2b7ff1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:06.574364 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-80d0f5ed-86f2-4b6b-8aec-40527e2b7ff1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:06.804982 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-80d0f5ed-86f2-4b6b-8aec-40527e2b7ff1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:06.813030 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-80d0f5ed-86f2-4b6b-8aec-40527e2b7ff1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1569 microversion: 2.1 time: 0.251789 Oct 15 03:50:06.813808 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 901/1698] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:06 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:50:07.831150 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e72d66fb-f653-428f-bfc5-a707cb8b79f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:07.832157 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e72d66fb-f653-428f-bfc5-a707cb8b79f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:07.838077 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e72d66fb-f653-428f-bfc5-a707cb8b79f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:07.838530 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e72d66fb-f653-428f-bfc5-a707cb8b79f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:07.839290 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e72d66fb-f653-428f-bfc5-a707cb8b79f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:07.839755 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e72d66fb-f653-428f-bfc5-a707cb8b79f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:07.898952 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e72d66fb-f653-428f-bfc5-a707cb8b79f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:07.906818 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e72d66fb-f653-428f-bfc5-a707cb8b79f8 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079662 Oct 15 03:50:07.907379 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 798/1699] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:07 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:08.531448 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-a857b4a4-6eb3-4f3b-a461-8c900ca89a27 req-0a5b26bf-9de7-4cba-8fe4-4595ed9a0f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37285523-63b9-4079-939b-b156366439e6", "name": "network-vif-deleted", "tag": "6991361a-3fd3-4d0d-8d4b-edd950821f5d"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:50:08.532966 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:50:08.532966 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:50:08.539613 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-a857b4a4-6eb3-4f3b-a461-8c900ca89a27 req-0a5b26bf-9de7-4cba-8fe4-4595ed9a0f60 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:08.540093 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-a857b4a4-6eb3-4f3b-a461-8c900ca89a27 req-0a5b26bf-9de7-4cba-8fe4-4595ed9a0f60 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:08.550007 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-a857b4a4-6eb3-4f3b-a461-8c900ca89a27 req-0a5b26bf-9de7-4cba-8fe4-4595ed9a0f60 service nova] Creating event network-vif-deleted:6991361a-3fd3-4d0d-8d4b-edd950821f5d for instance 37285523-63b9-4079-939b-b156366439e6 on hv-cinder-81410 Oct 15 03:50:08.555049 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-a857b4a4-6eb3-4f3b-a461-8c900ca89a27 req-0a5b26bf-9de7-4cba-8fe4-4595ed9a0f60 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027773 Oct 15 03:50:08.555962 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 902/1700] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:50:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:50:08.923398 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c67a1aee-185e-40cd-9b86-a78619441eb9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:08.923960 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c67a1aee-185e-40cd-9b86-a78619441eb9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:08.930403 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c67a1aee-185e-40cd-9b86-a78619441eb9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:08.930851 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c67a1aee-185e-40cd-9b86-a78619441eb9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:08.931597 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c67a1aee-185e-40cd-9b86-a78619441eb9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:08.932053 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c67a1aee-185e-40cd-9b86-a78619441eb9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:08.990460 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c67a1aee-185e-40cd-9b86-a78619441eb9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:08.997563 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c67a1aee-185e-40cd-9b86-a78619441eb9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077927 Oct 15 03:50:08.998115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 799/1701] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:08 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:10.013883 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-08ecca08-6462-4f69-a809-0ea6565300d2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:10.015074 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-08ecca08-6462-4f69-a809-0ea6565300d2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:10.021260 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-08ecca08-6462-4f69-a809-0ea6565300d2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:10.021704 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-08ecca08-6462-4f69-a809-0ea6565300d2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:10.022453 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-08ecca08-6462-4f69-a809-0ea6565300d2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:10.022881 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-08ecca08-6462-4f69-a809-0ea6565300d2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:10.084414 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-08ecca08-6462-4f69-a809-0ea6565300d2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:10.091349 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-08ecca08-6462-4f69-a809-0ea6565300d2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.081372 Oct 15 03:50:10.091920 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 903/1702] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:10 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:10.796384 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:50:10.796893 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 03:50:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:50:11.109091 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-93554eb8-6d8b-4dee-be3d-f51cacae8da9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:11.109700 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-93554eb8-6d8b-4dee-be3d-f51cacae8da9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:11.115438 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-93554eb8-6d8b-4dee-be3d-f51cacae8da9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:11.115920 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-93554eb8-6d8b-4dee-be3d-f51cacae8da9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:11.116672 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-93554eb8-6d8b-4dee-be3d-f51cacae8da9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:11.117097 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-93554eb8-6d8b-4dee-be3d-f51cacae8da9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:11.176795 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-93554eb8-6d8b-4dee-be3d-f51cacae8da9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:11.183878 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-93554eb8-6d8b-4dee-be3d-f51cacae8da9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079045 Oct 15 03:50:11.184431 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 800/1703] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:11 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:12.200340 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7d0ee5cb-1ece-46f5-9be4-29bbe5b40ecf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:12.200885 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7d0ee5cb-1ece-46f5-9be4-29bbe5b40ecf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:12.206823 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7d0ee5cb-1ece-46f5-9be4-29bbe5b40ecf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:12.207261 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7d0ee5cb-1ece-46f5-9be4-29bbe5b40ecf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:12.208041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7d0ee5cb-1ece-46f5-9be4-29bbe5b40ecf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:12.208464 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7d0ee5cb-1ece-46f5-9be4-29bbe5b40ecf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:12.266053 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7d0ee5cb-1ece-46f5-9be4-29bbe5b40ecf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:12.273343 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7d0ee5cb-1ece-46f5-9be4-29bbe5b40ecf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076689 Oct 15 03:50:12.273890 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 904/1704] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:12 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:13.289894 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6bf74b64-eeb5-463d-a8fe-e03737e3352e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:13.290505 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6bf74b64-eeb5-463d-a8fe-e03737e3352e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:13.296835 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6bf74b64-eeb5-463d-a8fe-e03737e3352e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:13.297281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6bf74b64-eeb5-463d-a8fe-e03737e3352e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:13.298033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6bf74b64-eeb5-463d-a8fe-e03737e3352e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:13.298456 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6bf74b64-eeb5-463d-a8fe-e03737e3352e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:13.357063 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6bf74b64-eeb5-463d-a8fe-e03737e3352e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:13.365060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6bf74b64-eeb5-463d-a8fe-e03737e3352e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.078764 Oct 15 03:50:13.365613 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 801/1705] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:13 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:14.381814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-576ecc66-db67-4ee4-97a9-cf5ec49ed06e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:14.382416 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-576ecc66-db67-4ee4-97a9-cf5ec49ed06e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:14.387967 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-576ecc66-db67-4ee4-97a9-cf5ec49ed06e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:14.388424 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-576ecc66-db67-4ee4-97a9-cf5ec49ed06e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:14.389169 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-576ecc66-db67-4ee4-97a9-cf5ec49ed06e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:14.389597 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-576ecc66-db67-4ee4-97a9-cf5ec49ed06e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:14.446473 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-576ecc66-db67-4ee4-97a9-cf5ec49ed06e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:14.453733 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-576ecc66-db67-4ee4-97a9-cf5ec49ed06e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.075446 Oct 15 03:50:14.454275 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 905/1706] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:14 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:15.470727 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-03d6d992-d2ed-4e70-8a2c-8891dda44425 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:15.471325 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-03d6d992-d2ed-4e70-8a2c-8891dda44425 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:15.476974 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-03d6d992-d2ed-4e70-8a2c-8891dda44425 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:15.477419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-03d6d992-d2ed-4e70-8a2c-8891dda44425 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:15.478168 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-03d6d992-d2ed-4e70-8a2c-8891dda44425 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:15.478597 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-03d6d992-d2ed-4e70-8a2c-8891dda44425 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:15.537550 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-03d6d992-d2ed-4e70-8a2c-8891dda44425 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:15.544840 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-03d6d992-d2ed-4e70-8a2c-8891dda44425 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.078231 Oct 15 03:50:15.545385 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 802/1707] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:15 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:16.561096 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8fd284e3-11a7-4b59-9df9-512712334c18 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:16.561761 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8fd284e3-11a7-4b59-9df9-512712334c18 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:16.567338 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8fd284e3-11a7-4b59-9df9-512712334c18 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:16.567825 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8fd284e3-11a7-4b59-9df9-512712334c18 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:16.568577 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8fd284e3-11a7-4b59-9df9-512712334c18 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:16.569002 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8fd284e3-11a7-4b59-9df9-512712334c18 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:16.627462 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8fd284e3-11a7-4b59-9df9-512712334c18 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:16.634628 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8fd284e3-11a7-4b59-9df9-512712334c18 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077083 Oct 15 03:50:16.635300 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 906/1708] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:16 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:17.649987 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6425bbf6-041f-4d92-8b92-9181ea514661 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:17.650683 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6425bbf6-041f-4d92-8b92-9181ea514661 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:17.656942 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6425bbf6-041f-4d92-8b92-9181ea514661 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:17.657389 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6425bbf6-041f-4d92-8b92-9181ea514661 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:17.658137 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6425bbf6-041f-4d92-8b92-9181ea514661 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:17.658565 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6425bbf6-041f-4d92-8b92-9181ea514661 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:17.722342 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6425bbf6-041f-4d92-8b92-9181ea514661 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:17.729638 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6425bbf6-041f-4d92-8b92-9181ea514661 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.083187 Oct 15 03:50:17.730186 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 803/1709] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:17 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:18.745851 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-28f495ef-3566-4a39-abdb-38dd554237a4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:18.746455 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-28f495ef-3566-4a39-abdb-38dd554237a4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:18.752123 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28f495ef-3566-4a39-abdb-38dd554237a4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:18.752568 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28f495ef-3566-4a39-abdb-38dd554237a4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:18.753311 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28f495ef-3566-4a39-abdb-38dd554237a4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:18.753739 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28f495ef-3566-4a39-abdb-38dd554237a4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:18.810007 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-28f495ef-3566-4a39-abdb-38dd554237a4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:18.816996 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-28f495ef-3566-4a39-abdb-38dd554237a4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.074713 Oct 15 03:50:18.817538 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 907/1710] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:18 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:19.834189 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0778351c-bcb9-42b1-b081-e68cc454b08b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:19.834812 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0778351c-bcb9-42b1-b081-e68cc454b08b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:19.840469 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0778351c-bcb9-42b1-b081-e68cc454b08b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:19.840943 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0778351c-bcb9-42b1-b081-e68cc454b08b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:19.841690 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0778351c-bcb9-42b1-b081-e68cc454b08b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:19.842117 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0778351c-bcb9-42b1-b081-e68cc454b08b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:19.899244 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0778351c-bcb9-42b1-b081-e68cc454b08b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:19.906363 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0778351c-bcb9-42b1-b081-e68cc454b08b tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076086 Oct 15 03:50:19.906909 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 804/1711] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:19 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:20.983290 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5c3535a3-c82d-4878-a9cd-65db7b200b6e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:20.984023 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5c3535a3-c82d-4878-a9cd-65db7b200b6e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:20.989685 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c3535a3-c82d-4878-a9cd-65db7b200b6e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:20.990127 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c3535a3-c82d-4878-a9cd-65db7b200b6e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:20.990880 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c3535a3-c82d-4878-a9cd-65db7b200b6e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:20.991307 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c3535a3-c82d-4878-a9cd-65db7b200b6e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:21.048096 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5c3535a3-c82d-4878-a9cd-65db7b200b6e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:21.055115 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5c3535a3-c82d-4878-a9cd-65db7b200b6e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.136143 Oct 15 03:50:21.055652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 908/1712] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:20 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:22.072259 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d1911cd6-2ae1-4683-8deb-032b3fdaa7fa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:22.072893 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d1911cd6-2ae1-4683-8deb-032b3fdaa7fa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:22.078591 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d1911cd6-2ae1-4683-8deb-032b3fdaa7fa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:22.079035 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d1911cd6-2ae1-4683-8deb-032b3fdaa7fa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:22.079955 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d1911cd6-2ae1-4683-8deb-032b3fdaa7fa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:22.080385 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d1911cd6-2ae1-4683-8deb-032b3fdaa7fa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:22.137866 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d1911cd6-2ae1-4683-8deb-032b3fdaa7fa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:22.145462 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d1911cd6-2ae1-4683-8deb-032b3fdaa7fa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077009 Oct 15 03:50:22.146018 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 805/1713] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:22 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:23.161104 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-66335d67-bc14-47fb-81ee-51468101dc7f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:23.161733 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-66335d67-bc14-47fb-81ee-51468101dc7f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:23.167477 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-66335d67-bc14-47fb-81ee-51468101dc7f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:23.167961 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-66335d67-bc14-47fb-81ee-51468101dc7f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:23.168709 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-66335d67-bc14-47fb-81ee-51468101dc7f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:23.169135 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-66335d67-bc14-47fb-81ee-51468101dc7f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:23.227816 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-66335d67-bc14-47fb-81ee-51468101dc7f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:23.235540 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-66335d67-bc14-47fb-81ee-51468101dc7f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.078111 Oct 15 03:50:23.236118 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 909/1714] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:23 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:24.252674 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4190d516-e7c5-4db8-945c-7277cbbe2541 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:24.253272 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4190d516-e7c5-4db8-945c-7277cbbe2541 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:24.259111 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4190d516-e7c5-4db8-945c-7277cbbe2541 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:24.259595 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4190d516-e7c5-4db8-945c-7277cbbe2541 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:24.260420 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4190d516-e7c5-4db8-945c-7277cbbe2541 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:24.260852 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4190d516-e7c5-4db8-945c-7277cbbe2541 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:24.320345 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4190d516-e7c5-4db8-945c-7277cbbe2541 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:24.328264 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4190d516-e7c5-4db8-945c-7277cbbe2541 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079829 Oct 15 03:50:24.328818 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 806/1715] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:24 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:25.348682 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8cc60d3a-a3e2-42b2-a38d-491117800366 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:25.349283 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8cc60d3a-a3e2-42b2-a38d-491117800366 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:25.355203 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8cc60d3a-a3e2-42b2-a38d-491117800366 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:25.355643 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8cc60d3a-a3e2-42b2-a38d-491117800366 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:25.356424 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8cc60d3a-a3e2-42b2-a38d-491117800366 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:25.356855 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8cc60d3a-a3e2-42b2-a38d-491117800366 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:25.414841 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8cc60d3a-a3e2-42b2-a38d-491117800366 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:25.421980 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8cc60d3a-a3e2-42b2-a38d-491117800366 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076915 Oct 15 03:50:25.422527 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 910/1716] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:25 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:26.438579 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ac1c9ebb-c9b1-4c94-be13-cdc7e0f03512 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:26.439179 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ac1c9ebb-c9b1-4c94-be13-cdc7e0f03512 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:26.444885 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ac1c9ebb-c9b1-4c94-be13-cdc7e0f03512 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:26.445330 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ac1c9ebb-c9b1-4c94-be13-cdc7e0f03512 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:26.446092 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ac1c9ebb-c9b1-4c94-be13-cdc7e0f03512 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:26.446509 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ac1c9ebb-c9b1-4c94-be13-cdc7e0f03512 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:26.504618 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ac1c9ebb-c9b1-4c94-be13-cdc7e0f03512 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:26.511760 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ac1c9ebb-c9b1-4c94-be13-cdc7e0f03512 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076906 Oct 15 03:50:26.512299 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 807/1717] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:26 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:27.528226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cfe6c7c3-9a5f-47f5-8d31-50fbdd1efbdd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:27.528845 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cfe6c7c3-9a5f-47f5-8d31-50fbdd1efbdd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:27.534467 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cfe6c7c3-9a5f-47f5-8d31-50fbdd1efbdd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:27.534918 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cfe6c7c3-9a5f-47f5-8d31-50fbdd1efbdd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:27.535667 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cfe6c7c3-9a5f-47f5-8d31-50fbdd1efbdd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:27.536121 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cfe6c7c3-9a5f-47f5-8d31-50fbdd1efbdd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:27.593733 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-cfe6c7c3-9a5f-47f5-8d31-50fbdd1efbdd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:27.600833 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cfe6c7c3-9a5f-47f5-8d31-50fbdd1efbdd tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076454 Oct 15 03:50:27.601376 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 911/1718] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:27 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:28.618016 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e749e0cc-6a6f-4bf5-a734-27e709d00888 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:28.618627 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e749e0cc-6a6f-4bf5-a734-27e709d00888 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:28.624942 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e749e0cc-6a6f-4bf5-a734-27e709d00888 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:28.625394 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e749e0cc-6a6f-4bf5-a734-27e709d00888 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:28.626155 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e749e0cc-6a6f-4bf5-a734-27e709d00888 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:28.626586 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e749e0cc-6a6f-4bf5-a734-27e709d00888 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:28.683493 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e749e0cc-6a6f-4bf5-a734-27e709d00888 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:28.691060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e749e0cc-6a6f-4bf5-a734-27e709d00888 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076897 Oct 15 03:50:28.691620 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 808/1719] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:28 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:29.707645 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5cd3bcd3-b723-4851-b08f-30db5604ee63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:29.708278 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5cd3bcd3-b723-4851-b08f-30db5604ee63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:29.713948 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5cd3bcd3-b723-4851-b08f-30db5604ee63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:29.714391 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5cd3bcd3-b723-4851-b08f-30db5604ee63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:29.715150 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5cd3bcd3-b723-4851-b08f-30db5604ee63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:29.715582 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5cd3bcd3-b723-4851-b08f-30db5604ee63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:29.772243 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5cd3bcd3-b723-4851-b08f-30db5604ee63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:29.779189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5cd3bcd3-b723-4851-b08f-30db5604ee63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.075383 Oct 15 03:50:29.779746 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 912/1720] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:29 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:30.795491 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c8b5d37c-e59c-43a5-9854-7c114e895df3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:30.796115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c8b5d37c-e59c-43a5-9854-7c114e895df3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:30.801792 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c8b5d37c-e59c-43a5-9854-7c114e895df3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:30.802239 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c8b5d37c-e59c-43a5-9854-7c114e895df3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:30.802998 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c8b5d37c-e59c-43a5-9854-7c114e895df3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:30.803429 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c8b5d37c-e59c-43a5-9854-7c114e895df3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:30.863386 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c8b5d37c-e59c-43a5-9854-7c114e895df3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:30.870514 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c8b5d37c-e59c-43a5-9854-7c114e895df3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.078685 Oct 15 03:50:30.871073 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 809/1721] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:30 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:31.887054 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5085f5ef-c36e-477a-913a-85aebb2c6f5d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:31.887646 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5085f5ef-c36e-477a-913a-85aebb2c6f5d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:31.893806 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5085f5ef-c36e-477a-913a-85aebb2c6f5d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:31.894252 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5085f5ef-c36e-477a-913a-85aebb2c6f5d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:31.895000 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5085f5ef-c36e-477a-913a-85aebb2c6f5d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:31.895428 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5085f5ef-c36e-477a-913a-85aebb2c6f5d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:31.953574 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5085f5ef-c36e-477a-913a-85aebb2c6f5d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:31.960894 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5085f5ef-c36e-477a-913a-85aebb2c6f5d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077439 Oct 15 03:50:31.961433 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 913/1722] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:31 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:32.977841 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1339bb61-0e23-4ffd-9b64-582746707d33 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:32.978439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1339bb61-0e23-4ffd-9b64-582746707d33 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:32.984138 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1339bb61-0e23-4ffd-9b64-582746707d33 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:32.984582 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1339bb61-0e23-4ffd-9b64-582746707d33 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:32.985333 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1339bb61-0e23-4ffd-9b64-582746707d33 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:32.985761 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1339bb61-0e23-4ffd-9b64-582746707d33 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:33.042663 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-1339bb61-0e23-4ffd-9b64-582746707d33 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:33.050012 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1339bb61-0e23-4ffd-9b64-582746707d33 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.075724 Oct 15 03:50:33.050575 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 810/1723] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:32 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:34.068628 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-02d19d48-6663-4b3a-abd4-f59a9dcafcfa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:34.069171 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-02d19d48-6663-4b3a-abd4-f59a9dcafcfa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:34.074883 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-02d19d48-6663-4b3a-abd4-f59a9dcafcfa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:34.075329 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-02d19d48-6663-4b3a-abd4-f59a9dcafcfa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:34.076104 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-02d19d48-6663-4b3a-abd4-f59a9dcafcfa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:34.076531 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-02d19d48-6663-4b3a-abd4-f59a9dcafcfa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:34.133647 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-02d19d48-6663-4b3a-abd4-f59a9dcafcfa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:34.141258 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-02d19d48-6663-4b3a-abd4-f59a9dcafcfa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076387 Oct 15 03:50:34.141800 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 914/1724] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:34 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:50:35.158406 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-edb2ca3c-e6e6-4083-b464-1a560719c4f9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:35.159009 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-edb2ca3c-e6e6-4083-b464-1a560719c4f9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:35.164685 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-edb2ca3c-e6e6-4083-b464-1a560719c4f9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:35.165131 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-edb2ca3c-e6e6-4083-b464-1a560719c4f9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:35.165895 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-edb2ca3c-e6e6-4083-b464-1a560719c4f9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:35.166331 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-edb2ca3c-e6e6-4083-b464-1a560719c4f9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:35.246122 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-edb2ca3c-e6e6-4083-b464-1a560719c4f9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:35.254050 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-edb2ca3c-e6e6-4083-b464-1a560719c4f9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.099882 Oct 15 03:50:35.254617 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 811/1725] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:35 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:36.270027 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-17860d18-d688-4aa2-8c6c-4085ec619f06 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:36.270635 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-17860d18-d688-4aa2-8c6c-4085ec619f06 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:36.276456 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-17860d18-d688-4aa2-8c6c-4085ec619f06 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:36.276902 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-17860d18-d688-4aa2-8c6c-4085ec619f06 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:36.277658 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-17860d18-d688-4aa2-8c6c-4085ec619f06 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:36.278090 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-17860d18-d688-4aa2-8c6c-4085ec619f06 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:36.344320 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-17860d18-d688-4aa2-8c6c-4085ec619f06 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:36.351623 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-17860d18-d688-4aa2-8c6c-4085ec619f06 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.085204 Oct 15 03:50:36.352215 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 915/1726] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:36 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:37.368131 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f93b99ea-a4a8-4ddd-97bb-7d9d174203c2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:37.368779 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f93b99ea-a4a8-4ddd-97bb-7d9d174203c2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:37.374630 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f93b99ea-a4a8-4ddd-97bb-7d9d174203c2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:37.375706 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f93b99ea-a4a8-4ddd-97bb-7d9d174203c2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:37.376471 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f93b99ea-a4a8-4ddd-97bb-7d9d174203c2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:37.376906 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f93b99ea-a4a8-4ddd-97bb-7d9d174203c2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:37.436614 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f93b99ea-a4a8-4ddd-97bb-7d9d174203c2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:37.444471 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f93b99ea-a4a8-4ddd-97bb-7d9d174203c2 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079942 Oct 15 03:50:37.445028 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 812/1727] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:37 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:38.461269 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c8429a99-c502-44f4-98ea-f03fe92a643c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:38.461878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c8429a99-c502-44f4-98ea-f03fe92a643c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:38.467442 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c8429a99-c502-44f4-98ea-f03fe92a643c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:38.467922 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c8429a99-c502-44f4-98ea-f03fe92a643c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:38.468702 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c8429a99-c502-44f4-98ea-f03fe92a643c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:38.469133 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c8429a99-c502-44f4-98ea-f03fe92a643c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:38.529597 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c8429a99-c502-44f4-98ea-f03fe92a643c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:38.536786 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c8429a99-c502-44f4-98ea-f03fe92a643c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079267 Oct 15 03:50:38.537325 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 916/1728] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:38 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:39.552870 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a5bc7363-d069-4659-94d4-56982d10a223 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:39.553550 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a5bc7363-d069-4659-94d4-56982d10a223 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:39.559489 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a5bc7363-d069-4659-94d4-56982d10a223 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:39.559991 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a5bc7363-d069-4659-94d4-56982d10a223 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:39.560751 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a5bc7363-d069-4659-94d4-56982d10a223 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:39.561177 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a5bc7363-d069-4659-94d4-56982d10a223 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:39.618247 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-a5bc7363-d069-4659-94d4-56982d10a223 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:39.625370 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a5bc7363-d069-4659-94d4-56982d10a223 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076235 Oct 15 03:50:39.625915 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 813/1729] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:39 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:40.641632 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-349511f6-c776-495e-ad6e-7cb4d24ca669 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:40.642237 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-349511f6-c776-495e-ad6e-7cb4d24ca669 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:40.648449 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-349511f6-c776-495e-ad6e-7cb4d24ca669 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:40.648895 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-349511f6-c776-495e-ad6e-7cb4d24ca669 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:40.649667 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-349511f6-c776-495e-ad6e-7cb4d24ca669 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:40.650128 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-349511f6-c776-495e-ad6e-7cb4d24ca669 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:40.708375 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-349511f6-c776-495e-ad6e-7cb4d24ca669 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:40.717226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-349511f6-c776-495e-ad6e-7cb4d24ca669 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.078234 Oct 15 03:50:40.717226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 917/1730] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:40 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:41.732077 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-608b34cd-d4fb-4227-902e-248c6b3f488d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:41.732692 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-608b34cd-d4fb-4227-902e-248c6b3f488d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:41.738376 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-608b34cd-d4fb-4227-902e-248c6b3f488d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:41.738827 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-608b34cd-d4fb-4227-902e-248c6b3f488d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:41.739590 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-608b34cd-d4fb-4227-902e-248c6b3f488d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:41.740056 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-608b34cd-d4fb-4227-902e-248c6b3f488d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:41.799481 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-608b34cd-d4fb-4227-902e-248c6b3f488d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:41.806772 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-608b34cd-d4fb-4227-902e-248c6b3f488d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.078346 Oct 15 03:50:41.807343 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 814/1731] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:41 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:42.823110 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e3e7f102-9ece-46da-b993-d6583afb0521 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:42.823741 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e3e7f102-9ece-46da-b993-d6583afb0521 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:42.829456 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3e7f102-9ece-46da-b993-d6583afb0521 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:42.829900 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3e7f102-9ece-46da-b993-d6583afb0521 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:42.830651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3e7f102-9ece-46da-b993-d6583afb0521 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:42.831350 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e3e7f102-9ece-46da-b993-d6583afb0521 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:42.890987 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e3e7f102-9ece-46da-b993-d6583afb0521 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:42.898075 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e3e7f102-9ece-46da-b993-d6583afb0521 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.078571 Oct 15 03:50:42.898617 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 918/1732] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:42 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:43.915955 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c28c598f-e2b9-45c0-8dc8-a19e33814e59 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:43.916752 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c28c598f-e2b9-45c0-8dc8-a19e33814e59 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:43.922546 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c28c598f-e2b9-45c0-8dc8-a19e33814e59 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:43.922992 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c28c598f-e2b9-45c0-8dc8-a19e33814e59 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:43.923779 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c28c598f-e2b9-45c0-8dc8-a19e33814e59 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:43.924213 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c28c598f-e2b9-45c0-8dc8-a19e33814e59 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:43.983446 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c28c598f-e2b9-45c0-8dc8-a19e33814e59 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:43.991193 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c28c598f-e2b9-45c0-8dc8-a19e33814e59 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079500 Oct 15 03:50:43.991772 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 815/1733] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:43 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:45.008132 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-309f2e23-ff04-4dc9-8e14-357ea72d8165 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:45.008732 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-309f2e23-ff04-4dc9-8e14-357ea72d8165 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:45.014378 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-309f2e23-ff04-4dc9-8e14-357ea72d8165 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:45.014826 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-309f2e23-ff04-4dc9-8e14-357ea72d8165 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:45.015575 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-309f2e23-ff04-4dc9-8e14-357ea72d8165 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:45.016041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-309f2e23-ff04-4dc9-8e14-357ea72d8165 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:45.072976 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-309f2e23-ff04-4dc9-8e14-357ea72d8165 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:45.080127 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-309f2e23-ff04-4dc9-8e14-357ea72d8165 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.075516 Oct 15 03:50:45.080674 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 919/1734] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:45 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:46.096670 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-905144ea-5156-4a11-bc65-ddbfaab323cf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:46.097299 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-905144ea-5156-4a11-bc65-ddbfaab323cf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:46.102981 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-905144ea-5156-4a11-bc65-ddbfaab323cf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:46.103422 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-905144ea-5156-4a11-bc65-ddbfaab323cf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:46.104207 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-905144ea-5156-4a11-bc65-ddbfaab323cf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:46.104640 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-905144ea-5156-4a11-bc65-ddbfaab323cf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:46.161790 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-905144ea-5156-4a11-bc65-ddbfaab323cf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:46.168839 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-905144ea-5156-4a11-bc65-ddbfaab323cf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.075758 Oct 15 03:50:46.169411 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 816/1735] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:46 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:47.185692 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-686901e3-9132-4f44-b7d6-778ec530e893 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:47.186233 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-686901e3-9132-4f44-b7d6-778ec530e893 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:47.192469 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-686901e3-9132-4f44-b7d6-778ec530e893 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:47.192921 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-686901e3-9132-4f44-b7d6-778ec530e893 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:47.193705 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-686901e3-9132-4f44-b7d6-778ec530e893 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:47.194138 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-686901e3-9132-4f44-b7d6-778ec530e893 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:47.252151 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-686901e3-9132-4f44-b7d6-778ec530e893 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:47.259378 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-686901e3-9132-4f44-b7d6-778ec530e893 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077415 Oct 15 03:50:47.259959 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 920/1736] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:47 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:48.276494 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-aff1536f-c89b-4fc4-be42-1ef91c26d2c6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:48.277101 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-aff1536f-c89b-4fc4-be42-1ef91c26d2c6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:48.282826 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aff1536f-c89b-4fc4-be42-1ef91c26d2c6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:48.283274 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aff1536f-c89b-4fc4-be42-1ef91c26d2c6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:48.284077 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aff1536f-c89b-4fc4-be42-1ef91c26d2c6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:48.284507 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aff1536f-c89b-4fc4-be42-1ef91c26d2c6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:48.341855 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-aff1536f-c89b-4fc4-be42-1ef91c26d2c6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:48.349013 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-aff1536f-c89b-4fc4-be42-1ef91c26d2c6 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076109 Oct 15 03:50:48.349574 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 817/1737] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:48 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:49.367837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-be34347d-af24-47f9-8e71-5dba0119eb62 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:49.368459 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-be34347d-af24-47f9-8e71-5dba0119eb62 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:49.374359 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-be34347d-af24-47f9-8e71-5dba0119eb62 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:49.374844 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-be34347d-af24-47f9-8e71-5dba0119eb62 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:49.375605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-be34347d-af24-47f9-8e71-5dba0119eb62 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:49.376063 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-be34347d-af24-47f9-8e71-5dba0119eb62 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:49.435764 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-be34347d-af24-47f9-8e71-5dba0119eb62 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:49.443368 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-be34347d-af24-47f9-8e71-5dba0119eb62 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.081197 Oct 15 03:50:49.443945 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 921/1738] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:49 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:50.460246 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6bbf249f-7eca-4124-82ec-7e0013b0c3b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:50.460849 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6bbf249f-7eca-4124-82ec-7e0013b0c3b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:50.466568 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6bbf249f-7eca-4124-82ec-7e0013b0c3b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:50.467007 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6bbf249f-7eca-4124-82ec-7e0013b0c3b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:50.467780 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6bbf249f-7eca-4124-82ec-7e0013b0c3b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:50.468211 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6bbf249f-7eca-4124-82ec-7e0013b0c3b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:50.525384 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6bbf249f-7eca-4124-82ec-7e0013b0c3b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:50.532500 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6bbf249f-7eca-4124-82ec-7e0013b0c3b0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.075905 Oct 15 03:50:50.533049 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 818/1739] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:50 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:50:51.548964 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3be979c6-9506-4c92-bd51-9ae1414b30e1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:51.549570 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3be979c6-9506-4c92-bd51-9ae1414b30e1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:51.555405 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3be979c6-9506-4c92-bd51-9ae1414b30e1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:51.555900 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3be979c6-9506-4c92-bd51-9ae1414b30e1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:51.556659 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3be979c6-9506-4c92-bd51-9ae1414b30e1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:51.557093 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3be979c6-9506-4c92-bd51-9ae1414b30e1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:51.615259 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3be979c6-9506-4c92-bd51-9ae1414b30e1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:51.624033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3be979c6-9506-4c92-bd51-9ae1414b30e1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.078662 Oct 15 03:50:51.624609 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 922/1740] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:51 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:52.640662 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0023d276-c044-40a5-940d-746edfabb25c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:52.641178 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0023d276-c044-40a5-940d-746edfabb25c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:52.646967 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0023d276-c044-40a5-940d-746edfabb25c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:52.647413 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0023d276-c044-40a5-940d-746edfabb25c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:52.648198 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0023d276-c044-40a5-940d-746edfabb25c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:52.648631 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0023d276-c044-40a5-940d-746edfabb25c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:52.706209 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0023d276-c044-40a5-940d-746edfabb25c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:52.713951 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0023d276-c044-40a5-940d-746edfabb25c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077130 Oct 15 03:50:52.714507 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 819/1741] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:52 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:53.730901 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7c88b319-e3c7-44e0-9321-4f15e33390d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:53.731507 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7c88b319-e3c7-44e0-9321-4f15e33390d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:53.737815 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7c88b319-e3c7-44e0-9321-4f15e33390d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:53.738254 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7c88b319-e3c7-44e0-9321-4f15e33390d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:53.739104 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7c88b319-e3c7-44e0-9321-4f15e33390d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:53.739544 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7c88b319-e3c7-44e0-9321-4f15e33390d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:53.798324 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7c88b319-e3c7-44e0-9321-4f15e33390d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:53.805895 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7c88b319-e3c7-44e0-9321-4f15e33390d1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.078575 Oct 15 03:50:53.806514 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 923/1742] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:53 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:54.822608 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-71ccae9b-27a5-44f8-a386-1d5957302164 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:54.823211 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-71ccae9b-27a5-44f8-a386-1d5957302164 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:54.829441 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-71ccae9b-27a5-44f8-a386-1d5957302164 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:54.829882 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-71ccae9b-27a5-44f8-a386-1d5957302164 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:54.830633 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-71ccae9b-27a5-44f8-a386-1d5957302164 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:54.831318 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-71ccae9b-27a5-44f8-a386-1d5957302164 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:54.888596 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-71ccae9b-27a5-44f8-a386-1d5957302164 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:54.896236 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-71ccae9b-27a5-44f8-a386-1d5957302164 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077243 Oct 15 03:50:54.896776 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 820/1743] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:54 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:50:55.912592 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-17f81456-febd-4a8e-b842-7c5b6f8a5d51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:55.913196 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-17f81456-febd-4a8e-b842-7c5b6f8a5d51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:55.918799 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-17f81456-febd-4a8e-b842-7c5b6f8a5d51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:55.919240 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-17f81456-febd-4a8e-b842-7c5b6f8a5d51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:55.920021 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-17f81456-febd-4a8e-b842-7c5b6f8a5d51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:55.920455 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-17f81456-febd-4a8e-b842-7c5b6f8a5d51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:55.981067 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-17f81456-febd-4a8e-b842-7c5b6f8a5d51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:55.988222 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-17f81456-febd-4a8e-b842-7c5b6f8a5d51 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079206 Oct 15 03:50:55.988758 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 924/1744] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:55 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:57.004674 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-42007711-8127-477d-96f8-486a78818774 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:57.005284 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-42007711-8127-477d-96f8-486a78818774 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:57.011007 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-42007711-8127-477d-96f8-486a78818774 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:57.011457 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-42007711-8127-477d-96f8-486a78818774 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:57.012255 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-42007711-8127-477d-96f8-486a78818774 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:57.012687 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-42007711-8127-477d-96f8-486a78818774 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:57.069770 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-42007711-8127-477d-96f8-486a78818774 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:57.076916 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-42007711-8127-477d-96f8-486a78818774 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.075916 Oct 15 03:50:57.077473 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 821/1745] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:56 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:58.093539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0b16d01f-2276-40a6-8fda-e98b1ddfdb35 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:58.094141 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0b16d01f-2276-40a6-8fda-e98b1ddfdb35 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:58.099825 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0b16d01f-2276-40a6-8fda-e98b1ddfdb35 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:58.100287 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0b16d01f-2276-40a6-8fda-e98b1ddfdb35 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:58.101017 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0b16d01f-2276-40a6-8fda-e98b1ddfdb35 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:58.101444 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0b16d01f-2276-40a6-8fda-e98b1ddfdb35 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:58.158282 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0b16d01f-2276-40a6-8fda-e98b1ddfdb35 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:58.165324 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0b16d01f-2276-40a6-8fda-e98b1ddfdb35 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.075391 Oct 15 03:50:58.165867 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 925/1746] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:58 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:50:59.182512 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c3e39c19-837d-496f-8ae8-17b472a4cddf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:50:59.183153 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c3e39c19-837d-496f-8ae8-17b472a4cddf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:50:59.189413 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c3e39c19-837d-496f-8ae8-17b472a4cddf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:59.189859 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c3e39c19-837d-496f-8ae8-17b472a4cddf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:59.190621 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c3e39c19-837d-496f-8ae8-17b472a4cddf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:50:59.191059 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c3e39c19-837d-496f-8ae8-17b472a4cddf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:50:59.248685 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c3e39c19-837d-496f-8ae8-17b472a4cddf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:50:59.256487 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c3e39c19-837d-496f-8ae8-17b472a4cddf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077880 Oct 15 03:50:59.257044 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 822/1747] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:50:59 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:00.272465 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-17e66cd1-e1cb-4402-99c2-cd0f8121b843 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:00.273068 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-17e66cd1-e1cb-4402-99c2-cd0f8121b843 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:00.278757 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-17e66cd1-e1cb-4402-99c2-cd0f8121b843 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:00.279199 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-17e66cd1-e1cb-4402-99c2-cd0f8121b843 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:00.279979 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-17e66cd1-e1cb-4402-99c2-cd0f8121b843 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:00.280424 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-17e66cd1-e1cb-4402-99c2-cd0f8121b843 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:00.338791 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-17e66cd1-e1cb-4402-99c2-cd0f8121b843 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:00.346680 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-17e66cd1-e1cb-4402-99c2-cd0f8121b843 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077808 Oct 15 03:51:00.347229 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 926/1748] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:00 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:01.363398 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3c73daf0-43be-498a-a1b5-0b9049c47246 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:01.364042 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3c73daf0-43be-498a-a1b5-0b9049c47246 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:01.370017 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3c73daf0-43be-498a-a1b5-0b9049c47246 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:01.370467 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3c73daf0-43be-498a-a1b5-0b9049c47246 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:01.371229 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3c73daf0-43be-498a-a1b5-0b9049c47246 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:01.371660 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3c73daf0-43be-498a-a1b5-0b9049c47246 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:01.430899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3c73daf0-43be-498a-a1b5-0b9049c47246 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:01.438761 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3c73daf0-43be-498a-a1b5-0b9049c47246 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.078976 Oct 15 03:51:01.439314 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 823/1749] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:01 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:02.456337 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ecd24ac7-5ee0-4b0f-bd7b-8822a3d71c63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:02.456880 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ecd24ac7-5ee0-4b0f-bd7b-8822a3d71c63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:02.462592 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ecd24ac7-5ee0-4b0f-bd7b-8822a3d71c63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:02.463035 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ecd24ac7-5ee0-4b0f-bd7b-8822a3d71c63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:02.463809 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ecd24ac7-5ee0-4b0f-bd7b-8822a3d71c63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:02.464233 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ecd24ac7-5ee0-4b0f-bd7b-8822a3d71c63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:02.525038 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ecd24ac7-5ee0-4b0f-bd7b-8822a3d71c63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:02.532090 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ecd24ac7-5ee0-4b0f-bd7b-8822a3d71c63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.080508 Oct 15 03:51:02.532631 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 927/1750] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:02 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:03.547622 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3a02f5ff-b09a-44e1-a7e5-87ad16c2ec5c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:03.548747 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3a02f5ff-b09a-44e1-a7e5-87ad16c2ec5c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:03.554568 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a02f5ff-b09a-44e1-a7e5-87ad16c2ec5c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:03.555146 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a02f5ff-b09a-44e1-a7e5-87ad16c2ec5c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:03.555998 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a02f5ff-b09a-44e1-a7e5-87ad16c2ec5c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:03.556430 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3a02f5ff-b09a-44e1-a7e5-87ad16c2ec5c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:03.614250 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3a02f5ff-b09a-44e1-a7e5-87ad16c2ec5c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:03.621347 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3a02f5ff-b09a-44e1-a7e5-87ad16c2ec5c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077351 Oct 15 03:51:03.621895 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 824/1751] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:03 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:04.638449 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-35cceec3-c269-41b8-9801-3de8717ead63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:04.638982 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-35cceec3-c269-41b8-9801-3de8717ead63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:04.644694 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35cceec3-c269-41b8-9801-3de8717ead63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:04.645169 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35cceec3-c269-41b8-9801-3de8717ead63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:04.645920 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35cceec3-c269-41b8-9801-3de8717ead63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:04.646347 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35cceec3-c269-41b8-9801-3de8717ead63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:04.704032 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-35cceec3-c269-41b8-9801-3de8717ead63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:04.711802 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-35cceec3-c269-41b8-9801-3de8717ead63 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076941 Oct 15 03:51:04.712352 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 928/1752] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:04 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:05.729315 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b174eca7-583c-41ee-b45e-31b6a075b8e9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:05.729918 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b174eca7-583c-41ee-b45e-31b6a075b8e9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:05.744571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b174eca7-583c-41ee-b45e-31b6a075b8e9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:05.744571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b174eca7-583c-41ee-b45e-31b6a075b8e9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:05.744571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b174eca7-583c-41ee-b45e-31b6a075b8e9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:05.744571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b174eca7-583c-41ee-b45e-31b6a075b8e9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:05.795099 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b174eca7-583c-41ee-b45e-31b6a075b8e9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:05.802746 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b174eca7-583c-41ee-b45e-31b6a075b8e9 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077026 Oct 15 03:51:05.803297 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 825/1753] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:05 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:06.819139 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1327c691-8c48-4a70-9117-43a069df5bbb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:06.819772 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1327c691-8c48-4a70-9117-43a069df5bbb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:06.822177 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: ERROR oslo.messaging._drivers.impl_rabbit [-] [62b4e7dd-437c-4699-815c-b81f4b01b864] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 15 03:51:06.826442 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1327c691-8c48-4a70-9117-43a069df5bbb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:06.826887 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1327c691-8c48-4a70-9117-43a069df5bbb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:06.827652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1327c691-8c48-4a70-9117-43a069df5bbb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:06.828095 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1327c691-8c48-4a70-9117-43a069df5bbb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:06.887249 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1327c691-8c48-4a70-9117-43a069df5bbb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:06.894905 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1327c691-8c48-4a70-9117-43a069df5bbb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079424 Oct 15 03:51:06.895448 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 929/1754] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:06 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:07.912201 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-445f13b9-4a0a-41e0-92c5-2de1178ba6ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:07.912846 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-445f13b9-4a0a-41e0-92c5-2de1178ba6ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:07.918518 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-445f13b9-4a0a-41e0-92c5-2de1178ba6ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:07.918968 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-445f13b9-4a0a-41e0-92c5-2de1178ba6ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:07.919753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-445f13b9-4a0a-41e0-92c5-2de1178ba6ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:07.920185 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-445f13b9-4a0a-41e0-92c5-2de1178ba6ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:07.979619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-445f13b9-4a0a-41e0-92c5-2de1178ba6ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:07.988385 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-445f13b9-4a0a-41e0-92c5-2de1178ba6ee tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.080448 Oct 15 03:51:07.988948 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 826/1755] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:07 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:09.005242 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3683b39b-98af-4fa9-b925-311455ba7a92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:09.005903 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3683b39b-98af-4fa9-b925-311455ba7a92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:09.021871 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3683b39b-98af-4fa9-b925-311455ba7a92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:09.022330 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3683b39b-98af-4fa9-b925-311455ba7a92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:09.023100 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3683b39b-98af-4fa9-b925-311455ba7a92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:09.023527 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3683b39b-98af-4fa9-b925-311455ba7a92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:09.033737 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] [62b4e7dd-437c-4699-815c-b81f4b01b864] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 33598. Oct 15 03:51:09.091362 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3683b39b-98af-4fa9-b925-311455ba7a92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:09.099152 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3683b39b-98af-4fa9-b925-311455ba7a92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.097460 Oct 15 03:51:09.099623 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 930/1756] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:09 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:10.115926 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-31ce036b-7d75-4d37-b3c3-299799f636ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:10.116526 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-31ce036b-7d75-4d37-b3c3-299799f636ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:10.127920 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-31ce036b-7d75-4d37-b3c3-299799f636ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:10.128439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-31ce036b-7d75-4d37-b3c3-299799f636ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:10.129319 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-31ce036b-7d75-4d37-b3c3-299799f636ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:10.129745 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-31ce036b-7d75-4d37-b3c3-299799f636ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:10.186730 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-31ce036b-7d75-4d37-b3c3-299799f636ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:10.194534 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-31ce036b-7d75-4d37-b3c3-299799f636ab tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.082280 Oct 15 03:51:10.195083 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 827/1757] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:10 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:11.211422 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7c716488-492b-4f2d-aa57-a3a1c1083466 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:11.212001 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7c716488-492b-4f2d-aa57-a3a1c1083466 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:11.217641 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7c716488-492b-4f2d-aa57-a3a1c1083466 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:11.218095 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7c716488-492b-4f2d-aa57-a3a1c1083466 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:11.218863 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7c716488-492b-4f2d-aa57-a3a1c1083466 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:11.219298 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7c716488-492b-4f2d-aa57-a3a1c1083466 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:11.276603 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7c716488-492b-4f2d-aa57-a3a1c1083466 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:11.283744 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7c716488-492b-4f2d-aa57-a3a1c1083466 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.075989 Oct 15 03:51:11.284300 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 931/1758] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:11 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:12.300359 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ef18c1ff-ba79-482b-817a-fcb3ed64055f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:12.300880 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ef18c1ff-ba79-482b-817a-fcb3ed64055f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:12.306600 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ef18c1ff-ba79-482b-817a-fcb3ed64055f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:12.307043 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ef18c1ff-ba79-482b-817a-fcb3ed64055f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:12.307819 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ef18c1ff-ba79-482b-817a-fcb3ed64055f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:12.308261 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ef18c1ff-ba79-482b-817a-fcb3ed64055f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:12.365825 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ef18c1ff-ba79-482b-817a-fcb3ed64055f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:12.372866 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ef18c1ff-ba79-482b-817a-fcb3ed64055f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076263 Oct 15 03:51:12.373413 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 828/1759] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:12 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:13.389301 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d6eba244-56f9-4bdd-b6de-43027c1b1fc4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:13.389854 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d6eba244-56f9-4bdd-b6de-43027c1b1fc4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:13.395581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6eba244-56f9-4bdd-b6de-43027c1b1fc4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:13.396066 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6eba244-56f9-4bdd-b6de-43027c1b1fc4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:13.396832 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6eba244-56f9-4bdd-b6de-43027c1b1fc4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:13.397299 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d6eba244-56f9-4bdd-b6de-43027c1b1fc4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:13.457882 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d6eba244-56f9-4bdd-b6de-43027c1b1fc4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:13.465216 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d6eba244-56f9-4bdd-b6de-43027c1b1fc4 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079603 Oct 15 03:51:13.465773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 932/1760] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:13 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:14.481675 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e2684d19-fc84-4476-9459-d781d11eaf20 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:14.482278 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e2684d19-fc84-4476-9459-d781d11eaf20 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:14.488714 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e2684d19-fc84-4476-9459-d781d11eaf20 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:14.489161 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e2684d19-fc84-4476-9459-d781d11eaf20 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:14.489921 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e2684d19-fc84-4476-9459-d781d11eaf20 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:14.490353 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e2684d19-fc84-4476-9459-d781d11eaf20 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:14.547214 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e2684d19-fc84-4476-9459-d781d11eaf20 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:14.554289 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e2684d19-fc84-4476-9459-d781d11eaf20 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076260 Oct 15 03:51:14.554841 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 829/1761] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:14 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:15.570516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d52f9afd-20fe-456f-add2-c192b0ed866a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:15.571057 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d52f9afd-20fe-456f-add2-c192b0ed866a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:15.576990 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d52f9afd-20fe-456f-add2-c192b0ed866a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:15.577443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d52f9afd-20fe-456f-add2-c192b0ed866a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:15.578212 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d52f9afd-20fe-456f-add2-c192b0ed866a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:15.578647 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d52f9afd-20fe-456f-add2-c192b0ed866a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:15.638858 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d52f9afd-20fe-456f-add2-c192b0ed866a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:15.646039 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d52f9afd-20fe-456f-add2-c192b0ed866a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079259 Oct 15 03:51:15.646589 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 933/1762] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:15 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:16.663616 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4eb12c28-1e89-4071-b323-eb558ec40188 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:16.664270 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4eb12c28-1e89-4071-b323-eb558ec40188 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:16.670011 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4eb12c28-1e89-4071-b323-eb558ec40188 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:16.670461 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4eb12c28-1e89-4071-b323-eb558ec40188 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:16.671224 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4eb12c28-1e89-4071-b323-eb558ec40188 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:16.671657 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4eb12c28-1e89-4071-b323-eb558ec40188 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:16.729271 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4eb12c28-1e89-4071-b323-eb558ec40188 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:16.736394 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4eb12c28-1e89-4071-b323-eb558ec40188 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076433 Oct 15 03:51:16.736951 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 830/1763] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:16 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:17.752829 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8d0778fc-2b63-42fe-a2e8-e424c398f7aa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:17.753436 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8d0778fc-2b63-42fe-a2e8-e424c398f7aa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:17.759094 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8d0778fc-2b63-42fe-a2e8-e424c398f7aa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:17.759543 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8d0778fc-2b63-42fe-a2e8-e424c398f7aa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:17.760342 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8d0778fc-2b63-42fe-a2e8-e424c398f7aa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:17.760781 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8d0778fc-2b63-42fe-a2e8-e424c398f7aa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:17.818041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8d0778fc-2b63-42fe-a2e8-e424c398f7aa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:17.825265 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8d0778fc-2b63-42fe-a2e8-e424c398f7aa tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076121 Oct 15 03:51:17.825816 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 934/1764] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:17 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:18.843033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-08db249a-e822-4cbf-9f82-a7091ff09163 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:18.843593 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-08db249a-e822-4cbf-9f82-a7091ff09163 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:18.849300 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08db249a-e822-4cbf-9f82-a7091ff09163 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:18.849741 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08db249a-e822-4cbf-9f82-a7091ff09163 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:18.850490 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08db249a-e822-4cbf-9f82-a7091ff09163 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:18.850918 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08db249a-e822-4cbf-9f82-a7091ff09163 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:18.907906 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-08db249a-e822-4cbf-9f82-a7091ff09163 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:18.915043 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-08db249a-e822-4cbf-9f82-a7091ff09163 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.075703 Oct 15 03:51:18.915593 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 831/1765] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:18 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:19.931287 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9518fa00-e6cf-405d-8816-aa8b6348ff1d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:19.931877 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9518fa00-e6cf-405d-8816-aa8b6348ff1d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:19.937582 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9518fa00-e6cf-405d-8816-aa8b6348ff1d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:19.938002 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9518fa00-e6cf-405d-8816-aa8b6348ff1d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:19.938769 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9518fa00-e6cf-405d-8816-aa8b6348ff1d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:19.939199 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9518fa00-e6cf-405d-8816-aa8b6348ff1d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:19.996287 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9518fa00-e6cf-405d-8816-aa8b6348ff1d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:20.003282 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9518fa00-e6cf-405d-8816-aa8b6348ff1d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.075722 Oct 15 03:51:20.003980 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 935/1766] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:19 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:21.020232 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-09e68414-dbcd-4023-a196-4e607ce992f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:21.020835 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-09e68414-dbcd-4023-a196-4e607ce992f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:21.026687 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09e68414-dbcd-4023-a196-4e607ce992f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:21.027135 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09e68414-dbcd-4023-a196-4e607ce992f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:21.027927 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09e68414-dbcd-4023-a196-4e607ce992f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:21.028356 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09e68414-dbcd-4023-a196-4e607ce992f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:21.086276 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-09e68414-dbcd-4023-a196-4e607ce992f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:21.093508 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-09e68414-dbcd-4023-a196-4e607ce992f1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076934 Oct 15 03:51:21.094069 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 832/1767] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:21 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:22.110054 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-308b18be-9a55-43e5-bf02-f59142535c6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:22.110503 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-308b18be-9a55-43e5-bf02-f59142535c6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:22.116940 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-308b18be-9a55-43e5-bf02-f59142535c6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:22.117389 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-308b18be-9a55-43e5-bf02-f59142535c6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:22.118149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-308b18be-9a55-43e5-bf02-f59142535c6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:22.118583 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-308b18be-9a55-43e5-bf02-f59142535c6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:22.178423 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-308b18be-9a55-43e5-bf02-f59142535c6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:22.185618 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-308b18be-9a55-43e5-bf02-f59142535c6c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079348 Oct 15 03:51:22.186164 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 936/1768] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:22 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:23.201930 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fd92dedf-358f-49fb-aaf4-b7f7e244000d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:23.202698 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fd92dedf-358f-49fb-aaf4-b7f7e244000d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:23.209663 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd92dedf-358f-49fb-aaf4-b7f7e244000d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:23.210153 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd92dedf-358f-49fb-aaf4-b7f7e244000d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:23.211492 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd92dedf-358f-49fb-aaf4-b7f7e244000d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:23.212346 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd92dedf-358f-49fb-aaf4-b7f7e244000d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:23.271227 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fd92dedf-358f-49fb-aaf4-b7f7e244000d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:23.278337 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fd92dedf-358f-49fb-aaf4-b7f7e244000d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.080147 Oct 15 03:51:23.278890 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 833/1769] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:23 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:24.294697 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f1ad2f1a-1c3e-4904-b059-70740d390d6e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:24.295314 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f1ad2f1a-1c3e-4904-b059-70740d390d6e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:24.301737 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f1ad2f1a-1c3e-4904-b059-70740d390d6e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:24.302190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f1ad2f1a-1c3e-4904-b059-70740d390d6e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:24.302952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f1ad2f1a-1c3e-4904-b059-70740d390d6e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:24.303396 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f1ad2f1a-1c3e-4904-b059-70740d390d6e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:24.360182 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f1ad2f1a-1c3e-4904-b059-70740d390d6e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:24.367965 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f1ad2f1a-1c3e-4904-b059-70740d390d6e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076936 Oct 15 03:51:24.368545 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 937/1770] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:24 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:25.384386 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7389cc3a-353d-4847-9926-3c82f953e612 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:25.384991 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7389cc3a-353d-4847-9926-3c82f953e612 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:25.390620 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7389cc3a-353d-4847-9926-3c82f953e612 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:25.391065 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7389cc3a-353d-4847-9926-3c82f953e612 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:25.392393 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7389cc3a-353d-4847-9926-3c82f953e612 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:25.392818 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7389cc3a-353d-4847-9926-3c82f953e612 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:25.452401 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7389cc3a-353d-4847-9926-3c82f953e612 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:25.460409 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7389cc3a-353d-4847-9926-3c82f953e612 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079643 Oct 15 03:51:25.460963 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 834/1771] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:25 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:26.477168 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e4cf510b-11b7-4d79-ac58-c8d52939dc92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:26.477779 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e4cf510b-11b7-4d79-ac58-c8d52939dc92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:26.483471 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e4cf510b-11b7-4d79-ac58-c8d52939dc92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:26.483949 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e4cf510b-11b7-4d79-ac58-c8d52939dc92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:26.484705 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e4cf510b-11b7-4d79-ac58-c8d52939dc92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:26.485136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e4cf510b-11b7-4d79-ac58-c8d52939dc92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:26.543447 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e4cf510b-11b7-4d79-ac58-c8d52939dc92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:26.551154 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e4cf510b-11b7-4d79-ac58-c8d52939dc92 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077608 Oct 15 03:51:26.552036 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 938/1772] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:26 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:27.569523 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d0a744d7-0521-4b5f-a0b3-22e3d4e0e11d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:27.570094 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d0a744d7-0521-4b5f-a0b3-22e3d4e0e11d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:27.575872 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d0a744d7-0521-4b5f-a0b3-22e3d4e0e11d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:27.576324 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d0a744d7-0521-4b5f-a0b3-22e3d4e0e11d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:27.577081 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d0a744d7-0521-4b5f-a0b3-22e3d4e0e11d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:27.577515 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d0a744d7-0521-4b5f-a0b3-22e3d4e0e11d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:27.636271 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d0a744d7-0521-4b5f-a0b3-22e3d4e0e11d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:27.643874 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d0a744d7-0521-4b5f-a0b3-22e3d4e0e11d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.078093 Oct 15 03:51:27.644441 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 835/1773] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:27 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:28.660396 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-35896886-ed41-494e-b87a-1bbdbd382a76 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:28.660935 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-35896886-ed41-494e-b87a-1bbdbd382a76 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:28.666595 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35896886-ed41-494e-b87a-1bbdbd382a76 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:28.667035 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35896886-ed41-494e-b87a-1bbdbd382a76 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:28.668075 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35896886-ed41-494e-b87a-1bbdbd382a76 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:28.668507 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35896886-ed41-494e-b87a-1bbdbd382a76 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:28.728678 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-35896886-ed41-494e-b87a-1bbdbd382a76 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:28.736290 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-35896886-ed41-494e-b87a-1bbdbd382a76 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079047 Oct 15 03:51:28.736824 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 939/1774] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:28 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:29.753073 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-15dac32a-3377-4c9c-b438-5686d3748e01 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:29.753590 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-15dac32a-3377-4c9c-b438-5686d3748e01 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:29.759392 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-15dac32a-3377-4c9c-b438-5686d3748e01 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:29.759876 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-15dac32a-3377-4c9c-b438-5686d3748e01 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:29.760621 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-15dac32a-3377-4c9c-b438-5686d3748e01 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:29.761044 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-15dac32a-3377-4c9c-b438-5686d3748e01 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:29.818379 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-15dac32a-3377-4c9c-b438-5686d3748e01 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:29.825714 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-15dac32a-3377-4c9c-b438-5686d3748e01 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076410 Oct 15 03:51:29.826271 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 836/1775] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:29 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:30.842047 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9524e159-0af0-4889-98dc-b4bc4980c5df tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:30.842652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9524e159-0af0-4889-98dc-b4bc4980c5df tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:30.848409 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9524e159-0af0-4889-98dc-b4bc4980c5df tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:30.848856 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9524e159-0af0-4889-98dc-b4bc4980c5df tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:30.849609 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9524e159-0af0-4889-98dc-b4bc4980c5df tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:30.850039 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9524e159-0af0-4889-98dc-b4bc4980c5df tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:30.909944 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9524e159-0af0-4889-98dc-b4bc4980c5df tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:30.919144 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9524e159-0af0-4889-98dc-b4bc4980c5df tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.080676 Oct 15 03:51:30.919751 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 940/1776] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:30 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:31.936129 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6b953efe-13e7-43e7-a4fb-dd8275408ac0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:31.936746 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6b953efe-13e7-43e7-a4fb-dd8275408ac0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:31.943439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b953efe-13e7-43e7-a4fb-dd8275408ac0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:31.943924 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b953efe-13e7-43e7-a4fb-dd8275408ac0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:31.944693 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b953efe-13e7-43e7-a4fb-dd8275408ac0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:31.945126 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b953efe-13e7-43e7-a4fb-dd8275408ac0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:32.003768 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6b953efe-13e7-43e7-a4fb-dd8275408ac0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:32.010971 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6b953efe-13e7-43e7-a4fb-dd8275408ac0 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.078520 Oct 15 03:51:32.011536 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 837/1777] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:31 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:33.027245 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-25abab4a-da0f-44b8-a7ae-bb858a737291 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:33.027897 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-25abab4a-da0f-44b8-a7ae-bb858a737291 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:33.034316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-25abab4a-da0f-44b8-a7ae-bb858a737291 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:33.034766 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-25abab4a-da0f-44b8-a7ae-bb858a737291 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:33.035534 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-25abab4a-da0f-44b8-a7ae-bb858a737291 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:33.035993 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-25abab4a-da0f-44b8-a7ae-bb858a737291 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:33.092855 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-25abab4a-da0f-44b8-a7ae-bb858a737291 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:33.100573 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-25abab4a-da0f-44b8-a7ae-bb858a737291 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076938 Oct 15 03:51:33.101121 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 941/1778] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:33 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:34.117073 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b8e20519-7231-4276-b834-653aade8f797 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:34.117684 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b8e20519-7231-4276-b834-653aade8f797 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:34.123349 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b8e20519-7231-4276-b834-653aade8f797 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:34.123845 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b8e20519-7231-4276-b834-653aade8f797 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:34.124607 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b8e20519-7231-4276-b834-653aade8f797 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:34.125039 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b8e20519-7231-4276-b834-653aade8f797 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:34.183605 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b8e20519-7231-4276-b834-653aade8f797 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:34.191030 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b8e20519-7231-4276-b834-653aade8f797 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077554 Oct 15 03:51:34.191624 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 838/1779] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:34 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:35.207548 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0c5c18a7-5130-437d-907a-082b6c79a705 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:35.208189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0c5c18a7-5130-437d-907a-082b6c79a705 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:35.213898 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0c5c18a7-5130-437d-907a-082b6c79a705 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:35.214350 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0c5c18a7-5130-437d-907a-082b6c79a705 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:35.215107 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0c5c18a7-5130-437d-907a-082b6c79a705 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:35.215545 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0c5c18a7-5130-437d-907a-082b6c79a705 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:35.276487 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0c5c18a7-5130-437d-907a-082b6c79a705 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:35.284200 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0c5c18a7-5130-437d-907a-082b6c79a705 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.080323 Oct 15 03:51:35.284847 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 942/1780] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:35 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:36.300622 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8d84eff8-77b1-4377-8c64-d174c1d01f21 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:36.301235 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8d84eff8-77b1-4377-8c64-d174c1d01f21 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:36.306849 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8d84eff8-77b1-4377-8c64-d174c1d01f21 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:36.307297 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8d84eff8-77b1-4377-8c64-d174c1d01f21 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:36.308087 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8d84eff8-77b1-4377-8c64-d174c1d01f21 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:36.308518 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8d84eff8-77b1-4377-8c64-d174c1d01f21 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:36.367059 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8d84eff8-77b1-4377-8c64-d174c1d01f21 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:36.375390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8d84eff8-77b1-4377-8c64-d174c1d01f21 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.078376 Oct 15 03:51:36.376693 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 839/1781] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:36 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:37.393094 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7f27c2ee-961b-4d26-b2f3-5a80e3c6481e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:37.393701 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7f27c2ee-961b-4d26-b2f3-5a80e3c6481e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:37.399296 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7f27c2ee-961b-4d26-b2f3-5a80e3c6481e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:37.399778 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7f27c2ee-961b-4d26-b2f3-5a80e3c6481e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:37.400533 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7f27c2ee-961b-4d26-b2f3-5a80e3c6481e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:37.400962 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7f27c2ee-961b-4d26-b2f3-5a80e3c6481e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:37.458868 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7f27c2ee-961b-4d26-b2f3-5a80e3c6481e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:37.465996 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7f27c2ee-961b-4d26-b2f3-5a80e3c6481e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077122 Oct 15 03:51:37.466533 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 943/1782] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:37 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:38.482935 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4a044ca4-2deb-4ddf-8a59-95acd25c44a3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:38.483533 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4a044ca4-2deb-4ddf-8a59-95acd25c44a3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:38.489988 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4a044ca4-2deb-4ddf-8a59-95acd25c44a3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:38.490432 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4a044ca4-2deb-4ddf-8a59-95acd25c44a3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:38.491177 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4a044ca4-2deb-4ddf-8a59-95acd25c44a3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:38.491603 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4a044ca4-2deb-4ddf-8a59-95acd25c44a3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:38.548856 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4a044ca4-2deb-4ddf-8a59-95acd25c44a3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:38.556761 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4a044ca4-2deb-4ddf-8a59-95acd25c44a3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077413 Oct 15 03:51:38.557305 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 840/1783] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:38 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:39.013684 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:51:39.013870 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 03:51:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:51:39.573498 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-76313922-85a7-43d9-a557-287e738b0ebf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:39.574139 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-76313922-85a7-43d9-a557-287e738b0ebf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:39.580000 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-76313922-85a7-43d9-a557-287e738b0ebf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:39.581352 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-76313922-85a7-43d9-a557-287e738b0ebf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:39.582118 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-76313922-85a7-43d9-a557-287e738b0ebf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:39.582555 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-76313922-85a7-43d9-a557-287e738b0ebf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:39.640093 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-76313922-85a7-43d9-a557-287e738b0ebf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:39.647151 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-76313922-85a7-43d9-a557-287e738b0ebf tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077273 Oct 15 03:51:39.647711 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 944/1784] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:39 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:40.663619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-da43d712-ef59-4a71-abba-f39313d9c50e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:40.664255 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-da43d712-ef59-4a71-abba-f39313d9c50e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:40.670245 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-da43d712-ef59-4a71-abba-f39313d9c50e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:40.670700 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-da43d712-ef59-4a71-abba-f39313d9c50e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:40.671498 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-da43d712-ef59-4a71-abba-f39313d9c50e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:40.671965 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-da43d712-ef59-4a71-abba-f39313d9c50e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:40.731234 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-da43d712-ef59-4a71-abba-f39313d9c50e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:40.739175 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-da43d712-ef59-4a71-abba-f39313d9c50e tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079269 Oct 15 03:51:40.739748 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 841/1785] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:40 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:41.756079 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-35b7e098-cab2-449b-8727-2122a299948c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:41.756693 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-35b7e098-cab2-449b-8727-2122a299948c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:41.762356 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35b7e098-cab2-449b-8727-2122a299948c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:41.762805 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35b7e098-cab2-449b-8727-2122a299948c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:41.763565 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35b7e098-cab2-449b-8727-2122a299948c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:41.764021 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35b7e098-cab2-449b-8727-2122a299948c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:41.823833 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-35b7e098-cab2-449b-8727-2122a299948c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:41.831758 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-35b7e098-cab2-449b-8727-2122a299948c tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079296 Oct 15 03:51:41.832312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 945/1786] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:41 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:42.848464 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8b275e4f-78c6-4b98-b0a3-2d846ddaf512 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:42.849064 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8b275e4f-78c6-4b98-b0a3-2d846ddaf512 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:42.854866 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8b275e4f-78c6-4b98-b0a3-2d846ddaf512 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:42.855310 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8b275e4f-78c6-4b98-b0a3-2d846ddaf512 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:42.856301 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8b275e4f-78c6-4b98-b0a3-2d846ddaf512 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:42.856730 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8b275e4f-78c6-4b98-b0a3-2d846ddaf512 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:42.916235 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8b275e4f-78c6-4b98-b0a3-2d846ddaf512 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:42.923283 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8b275e4f-78c6-4b98-b0a3-2d846ddaf512 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079000 Oct 15 03:51:42.923863 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 842/1787] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:42 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:43.938938 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fa093590-7cb0-4a18-91dc-898d97214e20 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:43.939542 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fa093590-7cb0-4a18-91dc-898d97214e20 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:43.946026 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fa093590-7cb0-4a18-91dc-898d97214e20 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:43.946470 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fa093590-7cb0-4a18-91dc-898d97214e20 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:43.947489 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fa093590-7cb0-4a18-91dc-898d97214e20 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:43.947957 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fa093590-7cb0-4a18-91dc-898d97214e20 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:44.006845 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fa093590-7cb0-4a18-91dc-898d97214e20 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:44.014115 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fa093590-7cb0-4a18-91dc-898d97214e20 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.078779 Oct 15 03:51:44.014672 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 946/1788] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:43 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:45.033416 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8c531196-1af8-40e2-a379-ff79e3bee724 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:45.034567 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8c531196-1af8-40e2-a379-ff79e3bee724 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:45.040186 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8c531196-1af8-40e2-a379-ff79e3bee724 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:45.040632 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8c531196-1af8-40e2-a379-ff79e3bee724 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:45.041382 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8c531196-1af8-40e2-a379-ff79e3bee724 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:45.041808 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8c531196-1af8-40e2-a379-ff79e3bee724 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:45.099275 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8c531196-1af8-40e2-a379-ff79e3bee724 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:45.106361 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8c531196-1af8-40e2-a379-ff79e3bee724 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076541 Oct 15 03:51:45.106910 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 843/1789] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:45 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:46.122142 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a740cb55-c871-45f5-93fc-a084e5a81a1f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:46.122744 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a740cb55-c871-45f5-93fc-a084e5a81a1f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:46.128952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a740cb55-c871-45f5-93fc-a084e5a81a1f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:46.129392 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a740cb55-c871-45f5-93fc-a084e5a81a1f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:46.130142 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a740cb55-c871-45f5-93fc-a084e5a81a1f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:46.130572 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a740cb55-c871-45f5-93fc-a084e5a81a1f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:46.187017 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a740cb55-c871-45f5-93fc-a084e5a81a1f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:46.194599 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a740cb55-c871-45f5-93fc-a084e5a81a1f tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076129 Oct 15 03:51:46.195139 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 947/1790] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:46 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:47.211527 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-96519975-327d-4cc1-8691-7d496db68345 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:47.212083 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-96519975-327d-4cc1-8691-7d496db68345 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:47.217801 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-96519975-327d-4cc1-8691-7d496db68345 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:47.218245 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-96519975-327d-4cc1-8691-7d496db68345 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:47.218999 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-96519975-327d-4cc1-8691-7d496db68345 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:47.219427 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-96519975-327d-4cc1-8691-7d496db68345 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:47.277646 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-96519975-327d-4cc1-8691-7d496db68345 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:47.284796 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-96519975-327d-4cc1-8691-7d496db68345 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076974 Oct 15 03:51:47.285348 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 844/1791] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:47 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:48.301331 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-28763837-d80f-42cd-978e-e0b2c33704ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:48.301943 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-28763837-d80f-42cd-978e-e0b2c33704ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:48.307841 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28763837-d80f-42cd-978e-e0b2c33704ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:48.308294 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28763837-d80f-42cd-978e-e0b2c33704ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:48.309058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28763837-d80f-42cd-978e-e0b2c33704ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:48.309498 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28763837-d80f-42cd-978e-e0b2c33704ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:48.369768 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-28763837-d80f-42cd-978e-e0b2c33704ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:48.377100 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-28763837-d80f-42cd-978e-e0b2c33704ea tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079427 Oct 15 03:51:48.378159 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 948/1792] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:48 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:49.394192 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-49d27c0a-ae8e-4ac1-a7ee-41350810275d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:49.394799 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-49d27c0a-ae8e-4ac1-a7ee-41350810275d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:49.400545 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-49d27c0a-ae8e-4ac1-a7ee-41350810275d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:49.400992 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-49d27c0a-ae8e-4ac1-a7ee-41350810275d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:49.401746 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-49d27c0a-ae8e-4ac1-a7ee-41350810275d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:49.402175 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-49d27c0a-ae8e-4ac1-a7ee-41350810275d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:49.462793 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-49d27c0a-ae8e-4ac1-a7ee-41350810275d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:49.470054 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-49d27c0a-ae8e-4ac1-a7ee-41350810275d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079465 Oct 15 03:51:49.470605 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 845/1793] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:49 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:50.486134 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-423e33ec-988e-4488-b4a1-7e9083948b4d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:50.486734 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-423e33ec-988e-4488-b4a1-7e9083948b4d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:50.492320 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-423e33ec-988e-4488-b4a1-7e9083948b4d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:50.492760 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-423e33ec-988e-4488-b4a1-7e9083948b4d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:50.493513 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-423e33ec-988e-4488-b4a1-7e9083948b4d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:50.493946 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-423e33ec-988e-4488-b4a1-7e9083948b4d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:50.552506 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-423e33ec-988e-4488-b4a1-7e9083948b4d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:50.559539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-423e33ec-988e-4488-b4a1-7e9083948b4d tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077132 Oct 15 03:51:50.560112 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 949/1794] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:50 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:51.576393 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9fd296b3-ef4f-41c6-a40f-a5b0a534d635 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:51.577002 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9fd296b3-ef4f-41c6-a40f-a5b0a534d635 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:51.579273 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5cc85daf-8c99-49f7-9b26-c6658a21a2b7] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 15 03:51:51.583875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9fd296b3-ef4f-41c6-a40f-a5b0a534d635 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:51.584323 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9fd296b3-ef4f-41c6-a40f-a5b0a534d635 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:51.585081 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9fd296b3-ef4f-41c6-a40f-a5b0a534d635 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:51.585515 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9fd296b3-ef4f-41c6-a40f-a5b0a534d635 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:51.643352 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-9fd296b3-ef4f-41c6-a40f-a5b0a534d635 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:51.650390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9fd296b3-ef4f-41c6-a40f-a5b0a534d635 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077612 Oct 15 03:51:51.650941 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 846/1795] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:51 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:52.667304 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-53b982d6-40f4-4cb0-b27d-04c1f651c208 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:52.667877 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-53b982d6-40f4-4cb0-b27d-04c1f651c208 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:52.673567 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53b982d6-40f4-4cb0-b27d-04c1f651c208 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:52.674046 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53b982d6-40f4-4cb0-b27d-04c1f651c208 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:52.674823 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53b982d6-40f4-4cb0-b27d-04c1f651c208 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:52.675257 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53b982d6-40f4-4cb0-b27d-04c1f651c208 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:52.734483 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-53b982d6-40f4-4cb0-b27d-04c1f651c208 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:52.741618 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-53b982d6-40f4-4cb0-b27d-04c1f651c208 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077966 Oct 15 03:51:52.742175 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 950/1796] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:52 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:53.757305 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-34e74adf-29e4-41d0-8b3e-538d4b974b75 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:53.757937 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-34e74adf-29e4-41d0-8b3e-538d4b974b75 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:53.773893 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-34e74adf-29e4-41d0-8b3e-538d4b974b75 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:53.774342 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-34e74adf-29e4-41d0-8b3e-538d4b974b75 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:53.775102 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-34e74adf-29e4-41d0-8b3e-538d4b974b75 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:53.775533 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-34e74adf-29e4-41d0-8b3e-538d4b974b75 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:53.780371 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] [5cc85daf-8c99-49f7-9b26-c6658a21a2b7] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 34118. Oct 15 03:51:53.837605 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-34e74adf-29e4-41d0-8b3e-538d4b974b75 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:53.844809 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-34e74adf-29e4-41d0-8b3e-538d4b974b75 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.091147 Oct 15 03:51:53.845398 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 847/1797] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:53 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:54.861362 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-63c10ec4-4664-4f7b-976e-ef61865333eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:54.862449 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-63c10ec4-4664-4f7b-976e-ef61865333eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:54.868703 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-63c10ec4-4664-4f7b-976e-ef61865333eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:54.869419 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-63c10ec4-4664-4f7b-976e-ef61865333eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:54.870227 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-63c10ec4-4664-4f7b-976e-ef61865333eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:54.870651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-63c10ec4-4664-4f7b-976e-ef61865333eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:54.929962 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-63c10ec4-4664-4f7b-976e-ef61865333eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:54.937474 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-63c10ec4-4664-4f7b-976e-ef61865333eb tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079665 Oct 15 03:51:54.938046 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 951/1798] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:54 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:55.955530 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-251dc0ae-4077-48ea-b6ad-189a94f49b43 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:55.956755 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-251dc0ae-4077-48ea-b6ad-189a94f49b43 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:55.962426 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-251dc0ae-4077-48ea-b6ad-189a94f49b43 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:55.962875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-251dc0ae-4077-48ea-b6ad-189a94f49b43 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:55.963629 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-251dc0ae-4077-48ea-b6ad-189a94f49b43 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:55.964087 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-251dc0ae-4077-48ea-b6ad-189a94f49b43 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:56.022617 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-251dc0ae-4077-48ea-b6ad-189a94f49b43 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:56.029739 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-251dc0ae-4077-48ea-b6ad-189a94f49b43 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.078280 Oct 15 03:51:56.030296 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 848/1799] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:55 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:57.046173 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5cf65187-6ded-4a9f-a5f5-3c805c6be4ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:57.046705 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5cf65187-6ded-4a9f-a5f5-3c805c6be4ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:57.052808 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5cf65187-6ded-4a9f-a5f5-3c805c6be4ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:57.053257 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5cf65187-6ded-4a9f-a5f5-3c805c6be4ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:57.054012 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5cf65187-6ded-4a9f-a5f5-3c805c6be4ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:57.054446 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5cf65187-6ded-4a9f-a5f5-3c805c6be4ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:57.112870 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5cf65187-6ded-4a9f-a5f5-3c805c6be4ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:57.120119 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5cf65187-6ded-4a9f-a5f5-3c805c6be4ef tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077678 Oct 15 03:51:57.120673 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 952/1800] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:57 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:58.137949 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a858b617-e2b0-4526-aca3-55e24312bab1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:58.138481 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a858b617-e2b0-4526-aca3-55e24312bab1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:58.144850 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a858b617-e2b0-4526-aca3-55e24312bab1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:58.145300 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a858b617-e2b0-4526-aca3-55e24312bab1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:58.146095 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a858b617-e2b0-4526-aca3-55e24312bab1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:58.146528 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a858b617-e2b0-4526-aca3-55e24312bab1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:58.206325 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-a858b617-e2b0-4526-aca3-55e24312bab1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:58.213761 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a858b617-e2b0-4526-aca3-55e24312bab1 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.079535 Oct 15 03:51:58.214325 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 849/1801] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:58 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:51:59.230356 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-195a8ce0-e5c0-44fd-b9d0-fd76d928ac02 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:51:59.232298 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-195a8ce0-e5c0-44fd-b9d0-fd76d928ac02 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:51:59.237038 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-195a8ce0-e5c0-44fd-b9d0-fd76d928ac02 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:59.237488 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-195a8ce0-e5c0-44fd-b9d0-fd76d928ac02 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:59.238262 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-195a8ce0-e5c0-44fd-b9d0-fd76d928ac02 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:51:59.238694 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-195a8ce0-e5c0-44fd-b9d0-fd76d928ac02 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:51:59.297261 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-195a8ce0-e5c0-44fd-b9d0-fd76d928ac02 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:51:59.304414 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-195a8ce0-e5c0-44fd-b9d0-fd76d928ac02 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.077936 Oct 15 03:51:59.304970 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 953/1802] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:51:59 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:52:00.320601 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-bb3bd22b-5a2e-490e-8a74-f98f9e99229a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:52:00.321729 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-bb3bd22b-5a2e-490e-8a74-f98f9e99229a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:52:00.326827 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bb3bd22b-5a2e-490e-8a74-f98f9e99229a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:52:00.327270 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bb3bd22b-5a2e-490e-8a74-f98f9e99229a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:52:00.328118 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bb3bd22b-5a2e-490e-8a74-f98f9e99229a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:52:00.328548 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bb3bd22b-5a2e-490e-8a74-f98f9e99229a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:52:00.385471 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-bb3bd22b-5a2e-490e-8a74-f98f9e99229a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:52:00.392577 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-bb3bd22b-5a2e-490e-8a74-f98f9e99229a tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.075610 Oct 15 03:52:00.393129 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 850/1803] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:52:00 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:52:01.407909 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0dae15a5-923c-49a0-9ca0-9d4bed0dd241 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:52:01.408545 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0dae15a5-923c-49a0-9ca0-9d4bed0dd241 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:52:01.414355 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0dae15a5-923c-49a0-9ca0-9d4bed0dd241 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:52:01.414808 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0dae15a5-923c-49a0-9ca0-9d4bed0dd241 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:52:01.415567 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0dae15a5-923c-49a0-9ca0-9d4bed0dd241 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:52:01.416031 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0dae15a5-923c-49a0-9ca0-9d4bed0dd241 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:52:01.475656 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0dae15a5-923c-49a0-9ca0-9d4bed0dd241 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:52:01.482711 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0dae15a5-923c-49a0-9ca0-9d4bed0dd241 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.078529 Oct 15 03:52:01.483266 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 954/1804] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:52:01 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:52:02.498751 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f9e13b8a-52c1-4090-bb55-84daf0652b56 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:52:02.499291 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f9e13b8a-52c1-4090-bb55-84daf0652b56 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:52:02.505466 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f9e13b8a-52c1-4090-bb55-84daf0652b56 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:52:02.505906 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f9e13b8a-52c1-4090-bb55-84daf0652b56 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:52:02.506655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f9e13b8a-52c1-4090-bb55-84daf0652b56 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:52:02.507080 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f9e13b8a-52c1-4090-bb55-84daf0652b56 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:52:02.563927 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f9e13b8a-52c1-4090-bb55-84daf0652b56 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:52:02.571470 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f9e13b8a-52c1-4090-bb55-84daf0652b56 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076343 Oct 15 03:52:02.572047 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 851/1805] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:52:02 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:52:03.588268 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-09b46111-08b8-44a7-8e05-59ddd8bcc4a5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:52:03.588873 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-09b46111-08b8-44a7-8e05-59ddd8bcc4a5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:52:03.594599 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-09b46111-08b8-44a7-8e05-59ddd8bcc4a5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:52:03.595043 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-09b46111-08b8-44a7-8e05-59ddd8bcc4a5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:52:03.595820 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-09b46111-08b8-44a7-8e05-59ddd8bcc4a5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:52:03.596773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-09b46111-08b8-44a7-8e05-59ddd8bcc4a5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:52:03.659202 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-09b46111-08b8-44a7-8e05-59ddd8bcc4a5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:52:03.666654 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-09b46111-08b8-44a7-8e05-59ddd8bcc4a5 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.081977 Oct 15 03:52:03.667368 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 955/1806] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:52:03 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:52:04.683762 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d913067c-de7f-472c-a410-44da013007ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:52:04.684283 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d913067c-de7f-472c-a410-44da013007ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:52:04.690933 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d913067c-de7f-472c-a410-44da013007ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:52:04.691383 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d913067c-de7f-472c-a410-44da013007ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:52:04.692161 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d913067c-de7f-472c-a410-44da013007ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:52:04.692590 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d913067c-de7f-472c-a410-44da013007ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:52:04.754021 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d913067c-de7f-472c-a410-44da013007ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:52:04.761964 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d913067c-de7f-472c-a410-44da013007ed tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.082266 Oct 15 03:52:04.763438 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 852/1807] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:52:04 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:52:05.778050 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-dfc55a7b-96b9-4bc2-82cd-74d78d518268 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:52:05.778650 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-dfc55a7b-96b9-4bc2-82cd-74d78d518268 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:52:05.784416 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfc55a7b-96b9-4bc2-82cd-74d78d518268 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:52:05.784861 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfc55a7b-96b9-4bc2-82cd-74d78d518268 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:52:05.785618 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfc55a7b-96b9-4bc2-82cd-74d78d518268 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:52:05.786051 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfc55a7b-96b9-4bc2-82cd-74d78d518268 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:52:05.843951 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-dfc55a7b-96b9-4bc2-82cd-74d78d518268 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:52:05.851030 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-dfc55a7b-96b9-4bc2-82cd-74d78d518268 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.076621 Oct 15 03:52:05.851570 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 956/1808] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:52:05 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:52:06.867083 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-68f82aba-a5e7-4a85-8fa4-609af706f535 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:52:06.867699 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-68f82aba-a5e7-4a85-8fa4-609af706f535 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:52:06.873324 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-68f82aba-a5e7-4a85-8fa4-609af706f535 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:52:06.873769 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-68f82aba-a5e7-4a85-8fa4-609af706f535 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:52:06.874553 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-68f82aba-a5e7-4a85-8fa4-609af706f535 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:52:06.874981 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-68f82aba-a5e7-4a85-8fa4-609af706f535 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:52:06.932261 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-68f82aba-a5e7-4a85-8fa4-609af706f535 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:52:06.939212 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-68f82aba-a5e7-4a85-8fa4-609af706f535 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1219 microversion: 2.1 time: 0.075749 Oct 15 03:52:06.939800 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 853/1809] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:52:06 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:52:07.955875 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ca09f30e-114b-4a62-8fdd-bff5701ff981 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:52:07.956481 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ca09f30e-114b-4a62-8fdd-bff5701ff981 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:52:07.962119 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ca09f30e-114b-4a62-8fdd-bff5701ff981 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:52:07.962559 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ca09f30e-114b-4a62-8fdd-bff5701ff981 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:52:07.963308 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ca09f30e-114b-4a62-8fdd-bff5701ff981 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:52:07.963760 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ca09f30e-114b-4a62-8fdd-bff5701ff981 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:52:07.992948 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ca09f30e-114b-4a62-8fdd-bff5701ff981 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:52:07.993392 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ca09f30e-114b-4a62-8fdd-bff5701ff981 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:52:07.993826 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.objects.instance [None req-ca09f30e-114b-4a62-8fdd-bff5701ff981 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lazy-loading 'fault' on Instance uuid 37285523-63b9-4079-939b-b156366439e6 {{(pid=120897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 03:52:08.034211 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ca09f30e-114b-4a62-8fdd-bff5701ff981 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb29072473e4c198148b0059eb1bc3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e70b7afa65b45d19294e3a06917a51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:52:08.041260 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ca09f30e-114b-4a62-8fdd-bff5701ff981 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 200 len: 1313 microversion: 2.1 time: 0.089237 Oct 15 03:52:08.041804 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 957/1810] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:52:07 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 1313 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:52:09.057905 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7e972aac-0ff7-448f-b799-3d3aae1a5654 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:52:09.058516 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7e972aac-0ff7-448f-b799-3d3aae1a5654 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] [instance: 37285523-63b9-4079-939b-b156366439e6] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:52:09.064323 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7e972aac-0ff7-448f-b799-3d3aae1a5654 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:52:09.064771 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7e972aac-0ff7-448f-b799-3d3aae1a5654 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:52:09.065527 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7e972aac-0ff7-448f-b799-3d3aae1a5654 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:52:09.065958 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7e972aac-0ff7-448f-b799-3d3aae1a5654 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:52:09.078599 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-7e972aac-0ff7-448f-b799-3d3aae1a5654 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] HTTP exception thrown: Instance 37285523-63b9-4079-939b-b156366439e6 could not be found. Oct 15 03:52:09.079172 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7e972aac-0ff7-448f-b799-3d3aae1a5654 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Returning 404 to user: Instance 37285523-63b9-4079-939b-b156366439e6 could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:52:09.080003 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7e972aac-0ff7-448f-b799-3d3aae1a5654 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6" status: 404 len: 111 microversion: 2.1 time: 0.025738 Oct 15 03:52:09.081252 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 854/1811] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:52:09 2021] GET /compute/v2.1/servers/37285523-63b9-4079-939b-b156366439e6 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 03:52:09.235757 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-776735e9-0197-4679-9bfe-6c4ad52352a3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] Calling method '.version_select at 0x7f4abc9c4c10>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:52:09.262908 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-776735e9-0197-4679-9bfe-6c4ad52352a3 tempest-TestShelveInstance-324418943 tempest-TestShelveInstance-324418943-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1243066600" status: 202 len: 0 microversion: 2.1 time: 0.030983 Oct 15 03:52:09.263490 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 958/1812] 10.222.0.30 () {58 vars in 1253 bytes} [Fri Oct 15 03:52:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1243066600 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:52:43.206686 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b8c91f8b-5f90-46f0-a07b-f19e77c93983 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] Calling method '.version_select at 0x7f4ac18aaaf0>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:52:43.230638 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b8c91f8b-5f90-46f0-a07b-f19e77c93983 tempest-TestVolumeBootPattern-2081968805 tempest-TestVolumeBootPattern-2081968805-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-878614080" status: 202 len: 0 microversion: 2.1 time: 0.027715 Oct 15 03:52:43.231288 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 855/1813] 10.222.0.30 () {58 vars in 1259 bytes} [Fri Oct 15 03:52:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-878614080 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:53:18.108416 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:53:18.108926 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 03:53:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:53:47.870477 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2f637ad4-d7c8-496f-84c2-8eac4919c24c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:53:47.871116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2f637ad4-d7c8-496f-84c2-8eac4919c24c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:53:47.877576 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2f637ad4-d7c8-496f-84c2-8eac4919c24c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:47.878029 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2f637ad4-d7c8-496f-84c2-8eac4919c24c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:47.878792 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2f637ad4-d7c8-496f-84c2-8eac4919c24c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:47.879232 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2f637ad4-d7c8-496f-84c2-8eac4919c24c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:47.902711 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2f637ad4-d7c8-496f-84c2-8eac4919c24c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Going to try to terminate instance {{(pid=120897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 15 03:53:47.976925 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2f637ad4-d7c8-496f-84c2-8eac4919c24c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "DELETE /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 204 len: 0 microversion: 2.1 time: 0.111166 Oct 15 03:53:47.977548 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 959/1814] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 03:53:47 2021] DELETE /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 03:53:47.986503 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9b393e5d-729b-4b5c-a342-4ec4e61bda7e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:53:47.987109 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9b393e5d-729b-4b5c-a342-4ec4e61bda7e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:53:47.996268 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9b393e5d-729b-4b5c-a342-4ec4e61bda7e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:47.996717 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9b393e5d-729b-4b5c-a342-4ec4e61bda7e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:47.997497 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9b393e5d-729b-4b5c-a342-4ec4e61bda7e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:47.998057 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9b393e5d-729b-4b5c-a342-4ec4e61bda7e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:48.121199 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-9b393e5d-729b-4b5c-a342-4ec4e61bda7e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:53:48.129215 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9b393e5d-729b-4b5c-a342-4ec4e61bda7e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1559 microversion: 2.1 time: 0.147458 Oct 15 03:53:48.129777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 856/1815] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:53:47 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:53:49.024334 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-2ce564f7-f2c0-4c74-a6be-542e7e2f8169 req-c053ee41-8b54-42b9-835c-79b200a5628f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828d646d-36c6-41b2-9e74-56a8ac3c1a73", "name": "network-vif-deleted", "tag": "de7e38b1-f501-40e5-8e8e-f969ae95d240"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:53:49.026012 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:53:49.026012 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:53:49.034793 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-2ce564f7-f2c0-4c74-a6be-542e7e2f8169 req-c053ee41-8b54-42b9-835c-79b200a5628f service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:49.035237 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-2ce564f7-f2c0-4c74-a6be-542e7e2f8169 req-c053ee41-8b54-42b9-835c-79b200a5628f service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:49.046641 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-2ce564f7-f2c0-4c74-a6be-542e7e2f8169 req-c053ee41-8b54-42b9-835c-79b200a5628f service nova] Creating event network-vif-deleted:de7e38b1-f501-40e5-8e8e-f969ae95d240 for instance 828d646d-36c6-41b2-9e74-56a8ac3c1a73 on hv-cinder-81410 Oct 15 03:53:49.051239 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-2ce564f7-f2c0-4c74-a6be-542e7e2f8169 req-c053ee41-8b54-42b9-835c-79b200a5628f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031248 Oct 15 03:53:49.051985 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 960/1816] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:53:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:53:49.147285 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e546f36f-f578-4407-9cbb-e5890e53f0c0 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:53:49.147923 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e546f36f-f578-4407-9cbb-e5890e53f0c0 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:53:49.153686 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e546f36f-f578-4407-9cbb-e5890e53f0c0 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:49.154134 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e546f36f-f578-4407-9cbb-e5890e53f0c0 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:49.154891 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e546f36f-f578-4407-9cbb-e5890e53f0c0 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:49.155321 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e546f36f-f578-4407-9cbb-e5890e53f0c0 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:49.216135 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e546f36f-f578-4407-9cbb-e5890e53f0c0 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:53:49.223815 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e546f36f-f578-4407-9cbb-e5890e53f0c0 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.080188 Oct 15 03:53:49.224995 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 857/1817] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:53:49 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:53:50.241072 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f2f366c4-9978-4a33-88b0-3694386f6379 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:53:50.241758 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f2f366c4-9978-4a33-88b0-3694386f6379 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:53:50.247927 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f2f366c4-9978-4a33-88b0-3694386f6379 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:50.248370 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f2f366c4-9978-4a33-88b0-3694386f6379 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:50.249123 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f2f366c4-9978-4a33-88b0-3694386f6379 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:50.249547 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f2f366c4-9978-4a33-88b0-3694386f6379 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:50.309291 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f2f366c4-9978-4a33-88b0-3694386f6379 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:53:50.316795 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f2f366c4-9978-4a33-88b0-3694386f6379 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.080287 Oct 15 03:53:50.317332 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 961/1818] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:53:50 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:53:51.334142 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-63acd642-89ae-4807-892d-de019dc19b7e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:53:51.334750 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-63acd642-89ae-4807-892d-de019dc19b7e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:53:51.340669 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-63acd642-89ae-4807-892d-de019dc19b7e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:51.341115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-63acd642-89ae-4807-892d-de019dc19b7e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:51.341868 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-63acd642-89ae-4807-892d-de019dc19b7e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:51.342299 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-63acd642-89ae-4807-892d-de019dc19b7e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:51.400238 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-63acd642-89ae-4807-892d-de019dc19b7e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:53:51.407788 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-63acd642-89ae-4807-892d-de019dc19b7e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077358 Oct 15 03:53:51.408334 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 858/1819] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:53:51 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:53:52.425007 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0321d335-3afe-4dc6-a276-1f92a4902452 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:53:52.425620 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0321d335-3afe-4dc6-a276-1f92a4902452 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:53:52.431912 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0321d335-3afe-4dc6-a276-1f92a4902452 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:52.432360 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0321d335-3afe-4dc6-a276-1f92a4902452 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:52.433116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0321d335-3afe-4dc6-a276-1f92a4902452 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:52.433616 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0321d335-3afe-4dc6-a276-1f92a4902452 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:52.491491 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0321d335-3afe-4dc6-a276-1f92a4902452 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:53:52.499014 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0321d335-3afe-4dc6-a276-1f92a4902452 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077722 Oct 15 03:53:52.499509 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 962/1820] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:53:52 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:53:53.516091 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-723e4265-b114-4b50-985c-ab83fa1e8e2b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:53:53.516621 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-723e4265-b114-4b50-985c-ab83fa1e8e2b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:53:53.522872 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-723e4265-b114-4b50-985c-ab83fa1e8e2b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:53.523316 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-723e4265-b114-4b50-985c-ab83fa1e8e2b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:53.524093 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-723e4265-b114-4b50-985c-ab83fa1e8e2b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:53.524519 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-723e4265-b114-4b50-985c-ab83fa1e8e2b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:53.581325 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-723e4265-b114-4b50-985c-ab83fa1e8e2b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:53:53.589374 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-723e4265-b114-4b50-985c-ab83fa1e8e2b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077023 Oct 15 03:53:53.589920 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 859/1821] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:53:53 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:53:54.605701 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-150a10d1-185a-4ca6-b5ba-391fb7688fb7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:53:54.606282 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-150a10d1-185a-4ca6-b5ba-391fb7688fb7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:53:54.611977 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-150a10d1-185a-4ca6-b5ba-391fb7688fb7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:54.612424 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-150a10d1-185a-4ca6-b5ba-391fb7688fb7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:54.613169 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-150a10d1-185a-4ca6-b5ba-391fb7688fb7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:54.613596 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-150a10d1-185a-4ca6-b5ba-391fb7688fb7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:54.675028 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-150a10d1-185a-4ca6-b5ba-391fb7688fb7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:53:54.683175 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-150a10d1-185a-4ca6-b5ba-391fb7688fb7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.081170 Oct 15 03:53:54.683734 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 963/1822] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:53:54 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:53:55.699560 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1ad4b841-a2f7-4874-a87c-d6b276680f62 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:53:55.700111 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1ad4b841-a2f7-4874-a87c-d6b276680f62 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:53:55.706245 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1ad4b841-a2f7-4874-a87c-d6b276680f62 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:55.706697 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1ad4b841-a2f7-4874-a87c-d6b276680f62 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:55.707454 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1ad4b841-a2f7-4874-a87c-d6b276680f62 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:55.707915 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1ad4b841-a2f7-4874-a87c-d6b276680f62 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:55.767749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-1ad4b841-a2f7-4874-a87c-d6b276680f62 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:53:55.775933 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1ad4b841-a2f7-4874-a87c-d6b276680f62 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.080033 Oct 15 03:53:55.776492 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 860/1823] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:53:55 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:53:56.792387 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c502537c-fd04-4ffb-9c91-1b747369d833 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:53:56.792989 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c502537c-fd04-4ffb-9c91-1b747369d833 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:53:56.798788 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c502537c-fd04-4ffb-9c91-1b747369d833 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:56.799231 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c502537c-fd04-4ffb-9c91-1b747369d833 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:56.800006 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c502537c-fd04-4ffb-9c91-1b747369d833 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:56.800454 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c502537c-fd04-4ffb-9c91-1b747369d833 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:56.858860 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c502537c-fd04-4ffb-9c91-1b747369d833 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:53:56.867004 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c502537c-fd04-4ffb-9c91-1b747369d833 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.078227 Oct 15 03:53:56.867543 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 964/1824] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:53:56 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:53:57.883821 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ee671419-f950-4502-80d0-acf9e8063ead tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:53:57.884431 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ee671419-f950-4502-80d0-acf9e8063ead tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:53:57.890039 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee671419-f950-4502-80d0-acf9e8063ead tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:57.890487 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee671419-f950-4502-80d0-acf9e8063ead tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:57.891247 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee671419-f950-4502-80d0-acf9e8063ead tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:57.891709 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ee671419-f950-4502-80d0-acf9e8063ead tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:57.952888 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ee671419-f950-4502-80d0-acf9e8063ead tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:53:57.961341 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ee671419-f950-4502-80d0-acf9e8063ead tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.081839 Oct 15 03:53:57.962126 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 861/1825] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:53:57 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:53:58.978324 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fd130f6f-cace-4d16-a3dd-b08c2d9900b9 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:53:58.978928 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fd130f6f-cace-4d16-a3dd-b08c2d9900b9 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:53:58.984693 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fd130f6f-cace-4d16-a3dd-b08c2d9900b9 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:58.985130 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fd130f6f-cace-4d16-a3dd-b08c2d9900b9 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:58.985881 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fd130f6f-cace-4d16-a3dd-b08c2d9900b9 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:53:58.986313 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fd130f6f-cace-4d16-a3dd-b08c2d9900b9 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:53:59.044080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fd130f6f-cace-4d16-a3dd-b08c2d9900b9 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:53:59.051564 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fd130f6f-cace-4d16-a3dd-b08c2d9900b9 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077586 Oct 15 03:53:59.052139 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 965/1826] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:53:58 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:00.067799 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-58b57508-9a69-4691-9e74-1933354ea2d1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:00.068421 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-58b57508-9a69-4691-9e74-1933354ea2d1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:00.074129 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-58b57508-9a69-4691-9e74-1933354ea2d1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:00.074577 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-58b57508-9a69-4691-9e74-1933354ea2d1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:00.075327 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-58b57508-9a69-4691-9e74-1933354ea2d1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:00.075795 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-58b57508-9a69-4691-9e74-1933354ea2d1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:00.136832 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-58b57508-9a69-4691-9e74-1933354ea2d1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:00.144319 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-58b57508-9a69-4691-9e74-1933354ea2d1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.080264 Oct 15 03:54:00.144866 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 862/1827] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:00 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:01.161569 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-370e661a-64ac-44a7-8fae-f15140b62ad2 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:01.162172 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-370e661a-64ac-44a7-8fae-f15140b62ad2 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:01.167926 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-370e661a-64ac-44a7-8fae-f15140b62ad2 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:01.168369 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-370e661a-64ac-44a7-8fae-f15140b62ad2 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:01.169112 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-370e661a-64ac-44a7-8fae-f15140b62ad2 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:01.169540 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-370e661a-64ac-44a7-8fae-f15140b62ad2 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:01.230971 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-370e661a-64ac-44a7-8fae-f15140b62ad2 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:01.238705 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-370e661a-64ac-44a7-8fae-f15140b62ad2 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.081255 Oct 15 03:54:01.239314 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 966/1828] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:01 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:02.253894 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7dc80fc0-a950-48d8-b4fd-9ce7b0a8153d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:02.254498 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7dc80fc0-a950-48d8-b4fd-9ce7b0a8153d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:02.260213 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7dc80fc0-a950-48d8-b4fd-9ce7b0a8153d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:02.260661 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7dc80fc0-a950-48d8-b4fd-9ce7b0a8153d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:02.261421 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7dc80fc0-a950-48d8-b4fd-9ce7b0a8153d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:02.261855 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7dc80fc0-a950-48d8-b4fd-9ce7b0a8153d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:02.319670 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7dc80fc0-a950-48d8-b4fd-9ce7b0a8153d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:02.327168 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7dc80fc0-a950-48d8-b4fd-9ce7b0a8153d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076866 Oct 15 03:54:02.327734 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 863/1829] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:02 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:03.344336 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-763f9261-4dbc-4338-ad82-2aa7e7dc29dd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:03.344885 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-763f9261-4dbc-4338-ad82-2aa7e7dc29dd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:03.351091 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-763f9261-4dbc-4338-ad82-2aa7e7dc29dd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:03.351540 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-763f9261-4dbc-4338-ad82-2aa7e7dc29dd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:03.352351 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-763f9261-4dbc-4338-ad82-2aa7e7dc29dd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:03.352771 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-763f9261-4dbc-4338-ad82-2aa7e7dc29dd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:03.409967 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-763f9261-4dbc-4338-ad82-2aa7e7dc29dd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:03.418029 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-763f9261-4dbc-4338-ad82-2aa7e7dc29dd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077481 Oct 15 03:54:03.418577 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 967/1830] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:03 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:04.434907 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-44bd62c6-92c2-45dd-af39-f365a7e25c86 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:04.435421 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-44bd62c6-92c2-45dd-af39-f365a7e25c86 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:04.441091 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-44bd62c6-92c2-45dd-af39-f365a7e25c86 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:04.441531 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-44bd62c6-92c2-45dd-af39-f365a7e25c86 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:04.442894 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-44bd62c6-92c2-45dd-af39-f365a7e25c86 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:04.443326 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-44bd62c6-92c2-45dd-af39-f365a7e25c86 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:04.500614 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-44bd62c6-92c2-45dd-af39-f365a7e25c86 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:04.508777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-44bd62c6-92c2-45dd-af39-f365a7e25c86 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077577 Oct 15 03:54:04.509330 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 864/1831] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:04 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:05.525169 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-91c3f5d0-0f08-4b0a-bf37-316ecf623a47 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:05.525844 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-91c3f5d0-0f08-4b0a-bf37-316ecf623a47 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:05.531728 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-91c3f5d0-0f08-4b0a-bf37-316ecf623a47 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:05.532189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-91c3f5d0-0f08-4b0a-bf37-316ecf623a47 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:05.532951 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-91c3f5d0-0f08-4b0a-bf37-316ecf623a47 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:05.533391 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-91c3f5d0-0f08-4b0a-bf37-316ecf623a47 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:05.721552 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-91c3f5d0-0f08-4b0a-bf37-316ecf623a47 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:05.729773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-91c3f5d0-0f08-4b0a-bf37-316ecf623a47 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.208443 Oct 15 03:54:05.730318 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 968/1832] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:05 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:06.746677 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-cc1b0d04-e0e6-4d09-ba58-523be5722123 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:06.747279 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-cc1b0d04-e0e6-4d09-ba58-523be5722123 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:06.753136 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc1b0d04-e0e6-4d09-ba58-523be5722123 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:06.753577 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc1b0d04-e0e6-4d09-ba58-523be5722123 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:06.754328 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc1b0d04-e0e6-4d09-ba58-523be5722123 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:06.755389 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cc1b0d04-e0e6-4d09-ba58-523be5722123 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:06.859399 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-cc1b0d04-e0e6-4d09-ba58-523be5722123 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:06.867614 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-cc1b0d04-e0e6-4d09-ba58-523be5722123 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.124583 Oct 15 03:54:06.868195 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 865/1833] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:06 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:07.884779 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-96d81c97-5fd3-4724-babe-0781f1649e05 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:07.885307 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-96d81c97-5fd3-4724-babe-0781f1649e05 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:07.890962 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96d81c97-5fd3-4724-babe-0781f1649e05 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:07.891409 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96d81c97-5fd3-4724-babe-0781f1649e05 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:07.892196 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96d81c97-5fd3-4724-babe-0781f1649e05 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:07.892634 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96d81c97-5fd3-4724-babe-0781f1649e05 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:07.953156 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-96d81c97-5fd3-4724-babe-0781f1649e05 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:07.961615 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-96d81c97-5fd3-4724-babe-0781f1649e05 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.080599 Oct 15 03:54:07.962190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 969/1834] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:07 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:08.978170 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a4c5a7ef-f520-4fd1-ab6d-3fa27d2668bb tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:08.978686 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a4c5a7ef-f520-4fd1-ab6d-3fa27d2668bb tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:08.984529 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4c5a7ef-f520-4fd1-ab6d-3fa27d2668bb tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:08.984978 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4c5a7ef-f520-4fd1-ab6d-3fa27d2668bb tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:08.985736 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4c5a7ef-f520-4fd1-ab6d-3fa27d2668bb tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:08.986168 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a4c5a7ef-f520-4fd1-ab6d-3fa27d2668bb tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:09.043531 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-a4c5a7ef-f520-4fd1-ab6d-3fa27d2668bb tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:09.051063 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a4c5a7ef-f520-4fd1-ab6d-3fa27d2668bb tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076747 Oct 15 03:54:09.052164 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 866/1835] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:08 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:10.068712 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-300f73cb-fef2-4d0d-8ae3-951c73c1cd29 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:10.069316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-300f73cb-fef2-4d0d-8ae3-951c73c1cd29 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:10.075166 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-300f73cb-fef2-4d0d-8ae3-951c73c1cd29 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:10.075616 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-300f73cb-fef2-4d0d-8ae3-951c73c1cd29 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:10.076447 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-300f73cb-fef2-4d0d-8ae3-951c73c1cd29 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:10.076884 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-300f73cb-fef2-4d0d-8ae3-951c73c1cd29 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:10.134744 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-300f73cb-fef2-4d0d-8ae3-951c73c1cd29 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:10.142215 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-300f73cb-fef2-4d0d-8ae3-951c73c1cd29 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077841 Oct 15 03:54:10.142765 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 970/1836] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:10 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:11.159583 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7aecc4d8-573f-486b-a525-001c3c5738c3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:11.160281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7aecc4d8-573f-486b-a525-001c3c5738c3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:11.167455 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7aecc4d8-573f-486b-a525-001c3c5738c3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:11.168289 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7aecc4d8-573f-486b-a525-001c3c5738c3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:11.169239 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7aecc4d8-573f-486b-a525-001c3c5738c3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:11.169681 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7aecc4d8-573f-486b-a525-001c3c5738c3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:11.227548 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7aecc4d8-573f-486b-a525-001c3c5738c3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:11.235217 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7aecc4d8-573f-486b-a525-001c3c5738c3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.079307 Oct 15 03:54:11.235801 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 867/1837] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:11 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:12.252220 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e49a1dc7-ced6-490d-952e-28daa2ef992f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:12.252837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e49a1dc7-ced6-490d-952e-28daa2ef992f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:12.258576 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e49a1dc7-ced6-490d-952e-28daa2ef992f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:12.259021 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e49a1dc7-ced6-490d-952e-28daa2ef992f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:12.259798 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e49a1dc7-ced6-490d-952e-28daa2ef992f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:12.260227 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e49a1dc7-ced6-490d-952e-28daa2ef992f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:12.317156 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e49a1dc7-ced6-490d-952e-28daa2ef992f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:12.324736 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e49a1dc7-ced6-490d-952e-28daa2ef992f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076166 Oct 15 03:54:12.325288 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 971/1838] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:12 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:13.342048 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-28a8e788-b116-4af7-b509-3720b582f4e3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:13.342653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-28a8e788-b116-4af7-b509-3720b582f4e3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:13.348457 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-28a8e788-b116-4af7-b509-3720b582f4e3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:13.348905 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-28a8e788-b116-4af7-b509-3720b582f4e3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:13.349667 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-28a8e788-b116-4af7-b509-3720b582f4e3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:13.350099 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-28a8e788-b116-4af7-b509-3720b582f4e3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:13.407121 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-28a8e788-b116-4af7-b509-3720b582f4e3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:13.414699 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-28a8e788-b116-4af7-b509-3720b582f4e3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076310 Oct 15 03:54:13.415249 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 868/1839] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:13 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:14.431292 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c40fb092-fbe2-49d9-a5df-bb0ace1e0b82 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:14.431927 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c40fb092-fbe2-49d9-a5df-bb0ace1e0b82 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:14.437831 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c40fb092-fbe2-49d9-a5df-bb0ace1e0b82 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:14.438278 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c40fb092-fbe2-49d9-a5df-bb0ace1e0b82 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:14.439029 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c40fb092-fbe2-49d9-a5df-bb0ace1e0b82 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:14.439461 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c40fb092-fbe2-49d9-a5df-bb0ace1e0b82 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:14.499846 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c40fb092-fbe2-49d9-a5df-bb0ace1e0b82 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:14.507922 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c40fb092-fbe2-49d9-a5df-bb0ace1e0b82 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.080275 Oct 15 03:54:14.508469 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 972/1840] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:14 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:15.523426 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ae0e190a-6eba-4b5d-b4ac-2ddbad36557a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:15.524003 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ae0e190a-6eba-4b5d-b4ac-2ddbad36557a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:15.529795 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae0e190a-6eba-4b5d-b4ac-2ddbad36557a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:15.530242 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae0e190a-6eba-4b5d-b4ac-2ddbad36557a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:15.530993 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae0e190a-6eba-4b5d-b4ac-2ddbad36557a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:15.531437 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae0e190a-6eba-4b5d-b4ac-2ddbad36557a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:15.591969 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ae0e190a-6eba-4b5d-b4ac-2ddbad36557a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:15.599582 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ae0e190a-6eba-4b5d-b4ac-2ddbad36557a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.079843 Oct 15 03:54:15.600170 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 869/1841] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:15 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:16.616174 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-87436e27-ee51-4a9f-be1b-f39fbb8eed44 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:16.616738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-87436e27-ee51-4a9f-be1b-f39fbb8eed44 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:16.622464 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-87436e27-ee51-4a9f-be1b-f39fbb8eed44 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:16.622906 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-87436e27-ee51-4a9f-be1b-f39fbb8eed44 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:16.623655 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-87436e27-ee51-4a9f-be1b-f39fbb8eed44 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:16.624109 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-87436e27-ee51-4a9f-be1b-f39fbb8eed44 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:16.681733 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-87436e27-ee51-4a9f-be1b-f39fbb8eed44 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:16.689173 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-87436e27-ee51-4a9f-be1b-f39fbb8eed44 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076764 Oct 15 03:54:16.689716 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 973/1842] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:16 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:17.706427 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-65153b7e-9daf-47d0-af9f-45a8cfb18f78 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:17.706972 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-65153b7e-9daf-47d0-af9f-45a8cfb18f78 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:17.713133 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-65153b7e-9daf-47d0-af9f-45a8cfb18f78 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:17.713574 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-65153b7e-9daf-47d0-af9f-45a8cfb18f78 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:17.714324 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-65153b7e-9daf-47d0-af9f-45a8cfb18f78 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:17.714750 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-65153b7e-9daf-47d0-af9f-45a8cfb18f78 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:17.771912 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-65153b7e-9daf-47d0-af9f-45a8cfb18f78 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:17.780220 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-65153b7e-9daf-47d0-af9f-45a8cfb18f78 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077284 Oct 15 03:54:17.783998 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 870/1843] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:17 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:18.797648 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a4bcb620-4fa7-4608-b339-6768c6a87b73 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:18.798259 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a4bcb620-4fa7-4608-b339-6768c6a87b73 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:18.804705 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4bcb620-4fa7-4608-b339-6768c6a87b73 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:18.805157 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4bcb620-4fa7-4608-b339-6768c6a87b73 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:18.805926 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4bcb620-4fa7-4608-b339-6768c6a87b73 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:18.806356 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4bcb620-4fa7-4608-b339-6768c6a87b73 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:18.864931 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a4bcb620-4fa7-4608-b339-6768c6a87b73 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:18.873177 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a4bcb620-4fa7-4608-b339-6768c6a87b73 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.079194 Oct 15 03:54:18.873728 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 974/1844] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:18 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:19.889907 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e65e7ea9-9413-4606-8824-e5b7554cbfa1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:19.890514 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e65e7ea9-9413-4606-8824-e5b7554cbfa1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:19.896247 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e65e7ea9-9413-4606-8824-e5b7554cbfa1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:19.896692 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e65e7ea9-9413-4606-8824-e5b7554cbfa1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:19.897521 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e65e7ea9-9413-4606-8824-e5b7554cbfa1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:19.897872 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e65e7ea9-9413-4606-8824-e5b7554cbfa1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:19.956158 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e65e7ea9-9413-4606-8824-e5b7554cbfa1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:19.963787 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e65e7ea9-9413-4606-8824-e5b7554cbfa1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077479 Oct 15 03:54:19.964331 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 871/1845] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:19 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:20.980428 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ace84870-3446-444e-8387-bf98199f0a4f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:20.981073 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ace84870-3446-444e-8387-bf98199f0a4f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:20.986698 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ace84870-3446-444e-8387-bf98199f0a4f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:20.987153 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ace84870-3446-444e-8387-bf98199f0a4f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:20.987940 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ace84870-3446-444e-8387-bf98199f0a4f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:20.988380 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ace84870-3446-444e-8387-bf98199f0a4f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:21.048942 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ace84870-3446-444e-8387-bf98199f0a4f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:21.057047 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ace84870-3446-444e-8387-bf98199f0a4f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.080266 Oct 15 03:54:21.057600 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 975/1846] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:20 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:22.072229 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6edcf4fa-61be-4719-b9c2-544c8491af36 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:22.072855 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6edcf4fa-61be-4719-b9c2-544c8491af36 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:22.078476 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6edcf4fa-61be-4719-b9c2-544c8491af36 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:22.079190 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6edcf4fa-61be-4719-b9c2-544c8491af36 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:22.079965 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6edcf4fa-61be-4719-b9c2-544c8491af36 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:22.080391 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6edcf4fa-61be-4719-b9c2-544c8491af36 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:22.139336 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6edcf4fa-61be-4719-b9c2-544c8491af36 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:22.147580 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6edcf4fa-61be-4719-b9c2-544c8491af36 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.078935 Oct 15 03:54:22.148176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 872/1847] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:22 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:23.162774 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-96043732-c1c9-44dd-b461-0110db76d344 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:23.163378 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-96043732-c1c9-44dd-b461-0110db76d344 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:23.169081 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96043732-c1c9-44dd-b461-0110db76d344 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:23.169521 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96043732-c1c9-44dd-b461-0110db76d344 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:23.170263 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96043732-c1c9-44dd-b461-0110db76d344 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:23.170693 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96043732-c1c9-44dd-b461-0110db76d344 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:23.229153 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-96043732-c1c9-44dd-b461-0110db76d344 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:23.238226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-96043732-c1c9-44dd-b461-0110db76d344 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077873 Oct 15 03:54:23.238226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 976/1848] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:23 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:24.253756 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-374131d5-6c36-4e4c-ad22-3c6dabdb916b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:24.254357 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-374131d5-6c36-4e4c-ad22-3c6dabdb916b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:24.260753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-374131d5-6c36-4e4c-ad22-3c6dabdb916b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:24.261198 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-374131d5-6c36-4e4c-ad22-3c6dabdb916b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:24.261955 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-374131d5-6c36-4e4c-ad22-3c6dabdb916b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:24.262378 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-374131d5-6c36-4e4c-ad22-3c6dabdb916b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:24.320181 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-374131d5-6c36-4e4c-ad22-3c6dabdb916b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:24.327844 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-374131d5-6c36-4e4c-ad22-3c6dabdb916b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077580 Oct 15 03:54:24.328337 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 873/1849] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:24 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:25.345338 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b3e55807-2cfa-4eae-a4ec-2eb97967c854 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:25.345943 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b3e55807-2cfa-4eae-a4ec-2eb97967c854 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:25.352363 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b3e55807-2cfa-4eae-a4ec-2eb97967c854 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:25.352805 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b3e55807-2cfa-4eae-a4ec-2eb97967c854 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:25.353553 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b3e55807-2cfa-4eae-a4ec-2eb97967c854 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:25.354149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b3e55807-2cfa-4eae-a4ec-2eb97967c854 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:25.414447 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b3e55807-2cfa-4eae-a4ec-2eb97967c854 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:25.421864 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b3e55807-2cfa-4eae-a4ec-2eb97967c854 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.080184 Oct 15 03:54:25.422403 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 977/1850] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:25 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:26.438514 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5ae78dc1-6c1f-49e5-8634-4a9dead0a2b5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:26.439041 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5ae78dc1-6c1f-49e5-8634-4a9dead0a2b5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:26.444717 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ae78dc1-6c1f-49e5-8634-4a9dead0a2b5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:26.445158 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ae78dc1-6c1f-49e5-8634-4a9dead0a2b5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:26.445901 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ae78dc1-6c1f-49e5-8634-4a9dead0a2b5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:26.446325 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ae78dc1-6c1f-49e5-8634-4a9dead0a2b5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:26.504311 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5ae78dc1-6c1f-49e5-8634-4a9dead0a2b5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:26.511880 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5ae78dc1-6c1f-49e5-8634-4a9dead0a2b5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076944 Oct 15 03:54:26.512424 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 874/1851] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:26 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:27.528632 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d9bb0a5e-7bc5-4ca7-9678-8fe761bf6d4e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:27.529237 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d9bb0a5e-7bc5-4ca7-9678-8fe761bf6d4e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:27.534914 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d9bb0a5e-7bc5-4ca7-9678-8fe761bf6d4e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:27.535357 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d9bb0a5e-7bc5-4ca7-9678-8fe761bf6d4e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:27.536700 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d9bb0a5e-7bc5-4ca7-9678-8fe761bf6d4e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:27.537133 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d9bb0a5e-7bc5-4ca7-9678-8fe761bf6d4e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:27.596719 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d9bb0a5e-7bc5-4ca7-9678-8fe761bf6d4e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:27.604865 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d9bb0a5e-7bc5-4ca7-9678-8fe761bf6d4e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.079870 Oct 15 03:54:27.605410 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 978/1852] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:27 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:28.621488 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7c1b27af-84c2-41d0-a329-fecfa388f191 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:28.622035 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7c1b27af-84c2-41d0-a329-fecfa388f191 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:28.627818 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7c1b27af-84c2-41d0-a329-fecfa388f191 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:28.628270 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7c1b27af-84c2-41d0-a329-fecfa388f191 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:28.629028 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7c1b27af-84c2-41d0-a329-fecfa388f191 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:28.629463 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7c1b27af-84c2-41d0-a329-fecfa388f191 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:28.686497 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7c1b27af-84c2-41d0-a329-fecfa388f191 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:28.694628 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7c1b27af-84c2-41d0-a329-fecfa388f191 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076822 Oct 15 03:54:28.695177 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 875/1853] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:28 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:54:29.710220 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fa22ce21-9e86-435b-ab5c-d347d6a99a36 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:29.710825 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fa22ce21-9e86-435b-ab5c-d347d6a99a36 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:29.716515 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fa22ce21-9e86-435b-ab5c-d347d6a99a36 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:29.716959 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fa22ce21-9e86-435b-ab5c-d347d6a99a36 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:29.717706 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fa22ce21-9e86-435b-ab5c-d347d6a99a36 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:29.718135 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fa22ce21-9e86-435b-ab5c-d347d6a99a36 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:29.779620 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fa22ce21-9e86-435b-ab5c-d347d6a99a36 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:29.787790 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fa22ce21-9e86-435b-ab5c-d347d6a99a36 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.081181 Oct 15 03:54:29.788331 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 979/1854] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:29 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:30.804247 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e4e066e3-86d9-441a-a172-52a27d68851c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:30.804784 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e4e066e3-86d9-441a-a172-52a27d68851c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:30.810534 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4e066e3-86d9-441a-a172-52a27d68851c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:30.810980 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4e066e3-86d9-441a-a172-52a27d68851c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:30.811759 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4e066e3-86d9-441a-a172-52a27d68851c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:30.812257 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4e066e3-86d9-441a-a172-52a27d68851c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:30.873585 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e4e066e3-86d9-441a-a172-52a27d68851c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:30.881823 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e4e066e3-86d9-441a-a172-52a27d68851c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.081300 Oct 15 03:54:30.882375 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 876/1855] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:30 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:31.898084 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-afa28953-6566-445c-8700-caa9b9418d2e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:31.898952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-afa28953-6566-445c-8700-caa9b9418d2e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:31.904635 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-afa28953-6566-445c-8700-caa9b9418d2e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:31.905080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-afa28953-6566-445c-8700-caa9b9418d2e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:31.905840 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-afa28953-6566-445c-8700-caa9b9418d2e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:31.906264 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-afa28953-6566-445c-8700-caa9b9418d2e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:31.964643 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-afa28953-6566-445c-8700-caa9b9418d2e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:31.972117 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-afa28953-6566-445c-8700-caa9b9418d2e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077762 Oct 15 03:54:31.972662 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 980/1856] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:31 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:32.989131 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f3576f9f-9661-4e20-a9c2-70147e95398e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:32.989708 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f3576f9f-9661-4e20-a9c2-70147e95398e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:32.995489 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f3576f9f-9661-4e20-a9c2-70147e95398e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:32.995960 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f3576f9f-9661-4e20-a9c2-70147e95398e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:32.996719 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f3576f9f-9661-4e20-a9c2-70147e95398e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:32.997150 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f3576f9f-9661-4e20-a9c2-70147e95398e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:33.054739 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f3576f9f-9661-4e20-a9c2-70147e95398e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:33.062390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f3576f9f-9661-4e20-a9c2-70147e95398e tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076934 Oct 15 03:54:33.062951 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 877/1857] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:32 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:34.079862 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-287abd59-5e80-4b19-a92d-c7abb27a6323 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:34.080472 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-287abd59-5e80-4b19-a92d-c7abb27a6323 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:34.086908 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-287abd59-5e80-4b19-a92d-c7abb27a6323 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:34.087358 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-287abd59-5e80-4b19-a92d-c7abb27a6323 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:34.088208 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-287abd59-5e80-4b19-a92d-c7abb27a6323 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:34.088649 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-287abd59-5e80-4b19-a92d-c7abb27a6323 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:34.148709 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-287abd59-5e80-4b19-a92d-c7abb27a6323 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:34.156307 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-287abd59-5e80-4b19-a92d-c7abb27a6323 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.080481 Oct 15 03:54:34.156857 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 981/1858] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:34 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:35.173340 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2f38e46f-8320-49bd-b5b6-4dd178ddb570 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:35.173894 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2f38e46f-8320-49bd-b5b6-4dd178ddb570 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:35.180275 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2f38e46f-8320-49bd-b5b6-4dd178ddb570 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:35.180728 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2f38e46f-8320-49bd-b5b6-4dd178ddb570 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:35.181535 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2f38e46f-8320-49bd-b5b6-4dd178ddb570 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:35.181971 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2f38e46f-8320-49bd-b5b6-4dd178ddb570 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:35.240586 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2f38e46f-8320-49bd-b5b6-4dd178ddb570 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:35.250645 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2f38e46f-8320-49bd-b5b6-4dd178ddb570 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.080947 Oct 15 03:54:35.251208 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 878/1859] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:35 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:36.267221 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0167d6b4-94c0-4e36-b0d5-499fbd13cd44 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:36.267864 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0167d6b4-94c0-4e36-b0d5-499fbd13cd44 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:36.273590 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0167d6b4-94c0-4e36-b0d5-499fbd13cd44 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:36.274033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0167d6b4-94c0-4e36-b0d5-499fbd13cd44 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:36.274781 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0167d6b4-94c0-4e36-b0d5-499fbd13cd44 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:36.275208 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0167d6b4-94c0-4e36-b0d5-499fbd13cd44 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:36.332968 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0167d6b4-94c0-4e36-b0d5-499fbd13cd44 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:36.340383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0167d6b4-94c0-4e36-b0d5-499fbd13cd44 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076799 Oct 15 03:54:36.340925 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 982/1860] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:36 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:37.356727 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4b2e5e38-dda6-4565-91d9-7b2136410220 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:37.357330 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4b2e5e38-dda6-4565-91d9-7b2136410220 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:37.363031 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4b2e5e38-dda6-4565-91d9-7b2136410220 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:37.363470 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4b2e5e38-dda6-4565-91d9-7b2136410220 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:37.364258 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4b2e5e38-dda6-4565-91d9-7b2136410220 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:37.365311 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4b2e5e38-dda6-4565-91d9-7b2136410220 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:37.423873 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4b2e5e38-dda6-4565-91d9-7b2136410220 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:37.432059 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4b2e5e38-dda6-4565-91d9-7b2136410220 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.078963 Oct 15 03:54:37.432609 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 879/1861] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:37 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:38.448941 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c2093166-79da-4490-83b4-a3bbd802e04d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:38.449480 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c2093166-79da-4490-83b4-a3bbd802e04d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:38.455465 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c2093166-79da-4490-83b4-a3bbd802e04d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:38.455964 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c2093166-79da-4490-83b4-a3bbd802e04d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:38.456712 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c2093166-79da-4490-83b4-a3bbd802e04d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:38.457137 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c2093166-79da-4490-83b4-a3bbd802e04d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:38.514487 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c2093166-79da-4490-83b4-a3bbd802e04d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:38.521998 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c2093166-79da-4490-83b4-a3bbd802e04d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076766 Oct 15 03:54:38.522541 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 983/1862] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:38 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:39.538519 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-75248849-abb8-4b71-b23e-f60b5ff32b63 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:39.539067 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-75248849-abb8-4b71-b23e-f60b5ff32b63 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:39.544852 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-75248849-abb8-4b71-b23e-f60b5ff32b63 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:39.545309 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-75248849-abb8-4b71-b23e-f60b5ff32b63 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:39.546066 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-75248849-abb8-4b71-b23e-f60b5ff32b63 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:39.546502 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-75248849-abb8-4b71-b23e-f60b5ff32b63 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:39.603876 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-75248849-abb8-4b71-b23e-f60b5ff32b63 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:39.611367 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-75248849-abb8-4b71-b23e-f60b5ff32b63 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076579 Oct 15 03:54:39.611959 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 880/1863] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:39 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:40.626972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a30fa10b-d905-4261-b3f6-9504d7d4f3ed tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:40.627524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a30fa10b-d905-4261-b3f6-9504d7d4f3ed tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:40.633462 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a30fa10b-d905-4261-b3f6-9504d7d4f3ed tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:40.633910 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a30fa10b-d905-4261-b3f6-9504d7d4f3ed tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:40.634662 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a30fa10b-d905-4261-b3f6-9504d7d4f3ed tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:40.635094 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a30fa10b-d905-4261-b3f6-9504d7d4f3ed tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:40.697651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a30fa10b-d905-4261-b3f6-9504d7d4f3ed tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:40.705476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a30fa10b-d905-4261-b3f6-9504d7d4f3ed tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.082244 Oct 15 03:54:40.706018 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 984/1864] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:40 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:41.722213 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e8227e74-6b55-46d0-af9e-daaa41ddac3d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:41.722838 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e8227e74-6b55-46d0-af9e-daaa41ddac3d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:41.729109 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e8227e74-6b55-46d0-af9e-daaa41ddac3d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:41.729555 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e8227e74-6b55-46d0-af9e-daaa41ddac3d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:41.730309 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e8227e74-6b55-46d0-af9e-daaa41ddac3d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:41.730731 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e8227e74-6b55-46d0-af9e-daaa41ddac3d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:41.789009 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e8227e74-6b55-46d0-af9e-daaa41ddac3d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:41.796449 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e8227e74-6b55-46d0-af9e-daaa41ddac3d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077963 Oct 15 03:54:41.797002 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 881/1865] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:41 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:54:42.105055 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6641eda2-bed2-4e69-b4b6-fbc57d2ceb9b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:42.105555 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6641eda2-bed2-4e69-b4b6-fbc57d2ceb9b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:42.111146 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6641eda2-bed2-4e69-b4b6-fbc57d2ceb9b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:42.111585 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6641eda2-bed2-4e69-b4b6-fbc57d2ceb9b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:42.112377 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6641eda2-bed2-4e69-b4b6-fbc57d2ceb9b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:42.112808 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6641eda2-bed2-4e69-b4b6-fbc57d2ceb9b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:42.137308 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6641eda2-bed2-4e69-b4b6-fbc57d2ceb9b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Going to try to terminate instance {{(pid=120897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 15 03:54:42.212533 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6641eda2-bed2-4e69-b4b6-fbc57d2ceb9b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 204 len: 0 microversion: 2.20 time: 0.110534 Oct 15 03:54:42.213355 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 985/1866] 10.222.0.30 () {60 vars in 1279 bytes} [Fri Oct 15 03:54:42 2021] DELETE /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 15 03:54:42.221418 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8d82ceb3-2b00-4399-ba45-ee69fba98a1e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:42.222028 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8d82ceb3-2b00-4399-ba45-ee69fba98a1e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:42.227824 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8d82ceb3-2b00-4399-ba45-ee69fba98a1e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:42.228225 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8d82ceb3-2b00-4399-ba45-ee69fba98a1e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:42.228984 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8d82ceb3-2b00-4399-ba45-ee69fba98a1e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:42.229420 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8d82ceb3-2b00-4399-ba45-ee69fba98a1e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:42.345692 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8d82ceb3-2b00-4399-ba45-ee69fba98a1e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:42.353671 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8d82ceb3-2b00-4399-ba45-ee69fba98a1e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:42.355152 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8d82ceb3-2b00-4399-ba45-ee69fba98a1e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:42.356385 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8d82ceb3-2b00-4399-ba45-ee69fba98a1e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1800 microversion: 2.20 time: 0.138660 Oct 15 03:54:42.356925 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 882/1867] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:54:42 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1800 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:54:42.813382 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-522d0319-7139-464a-97ec-4000a946f18f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:42.814073 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-522d0319-7139-464a-97ec-4000a946f18f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:42.819894 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-522d0319-7139-464a-97ec-4000a946f18f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:42.820341 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-522d0319-7139-464a-97ec-4000a946f18f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:42.821129 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-522d0319-7139-464a-97ec-4000a946f18f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:42.821559 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-522d0319-7139-464a-97ec-4000a946f18f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:42.898183 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-522d0319-7139-464a-97ec-4000a946f18f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:42.905693 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-522d0319-7139-464a-97ec-4000a946f18f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.096278 Oct 15 03:54:42.906241 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 986/1868] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:42 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:43.374197 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8c2d31db-7fbc-4e35-bcef-ae9327f56561 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:43.374825 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8c2d31db-7fbc-4e35-bcef-ae9327f56561 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:43.380944 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8c2d31db-7fbc-4e35-bcef-ae9327f56561 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:43.381385 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8c2d31db-7fbc-4e35-bcef-ae9327f56561 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:43.382166 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8c2d31db-7fbc-4e35-bcef-ae9327f56561 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:43.382598 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8c2d31db-7fbc-4e35-bcef-ae9327f56561 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:43.449837 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8c2d31db-7fbc-4e35-bcef-ae9327f56561 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:43.458054 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8c2d31db-7fbc-4e35-bcef-ae9327f56561 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:43.460197 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8c2d31db-7fbc-4e35-bcef-ae9327f56561 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:43.461407 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8c2d31db-7fbc-4e35-bcef-ae9327f56561 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1733 microversion: 2.20 time: 0.090910 Oct 15 03:54:43.461959 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 883/1869] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:54:43 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1733 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:54:43.632367 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-993a3efc-f241-4da2-94c3-82fbd172b321 req-a8facf14-d967-4086-aae1-5b627cf1c5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3594fddd-dbb7-4731-8f30-b3512198e1a9", "name": "network-vif-deleted", "tag": "0ebbb249-fedc-46b3-94a7-8e70531c6d22"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:54:43.634251 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:54:43.634251 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:54:43.642088 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-993a3efc-f241-4da2-94c3-82fbd172b321 req-a8facf14-d967-4086-aae1-5b627cf1c5b5 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:43.642596 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-993a3efc-f241-4da2-94c3-82fbd172b321 req-a8facf14-d967-4086-aae1-5b627cf1c5b5 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:43.654412 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-993a3efc-f241-4da2-94c3-82fbd172b321 req-a8facf14-d967-4086-aae1-5b627cf1c5b5 service nova] Creating event network-vif-deleted:0ebbb249-fedc-46b3-94a7-8e70531c6d22 for instance 3594fddd-dbb7-4731-8f30-b3512198e1a9 on hv-cinder-81410 Oct 15 03:54:43.660020 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-993a3efc-f241-4da2-94c3-82fbd172b321 req-a8facf14-d967-4086-aae1-5b627cf1c5b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031877 Oct 15 03:54:43.660949 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 987/1870] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:54:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:54:43.923559 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-730a7d5b-9113-47aa-b3fc-dcbc4a314d1c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:43.924232 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-730a7d5b-9113-47aa-b3fc-dcbc4a314d1c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:43.930662 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-730a7d5b-9113-47aa-b3fc-dcbc4a314d1c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:43.931116 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-730a7d5b-9113-47aa-b3fc-dcbc4a314d1c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:43.931921 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-730a7d5b-9113-47aa-b3fc-dcbc4a314d1c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:43.932359 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-730a7d5b-9113-47aa-b3fc-dcbc4a314d1c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:43.992686 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-730a7d5b-9113-47aa-b3fc-dcbc4a314d1c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:44.000402 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-730a7d5b-9113-47aa-b3fc-dcbc4a314d1c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.080581 Oct 15 03:54:44.000967 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 884/1871] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:43 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:44.480558 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-038b93b7-6286-4bdc-96a8-25543d36b9f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:44.481255 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-038b93b7-6286-4bdc-96a8-25543d36b9f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:44.487584 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-038b93b7-6286-4bdc-96a8-25543d36b9f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:44.488063 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-038b93b7-6286-4bdc-96a8-25543d36b9f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:44.488861 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-038b93b7-6286-4bdc-96a8-25543d36b9f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:44.489287 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-038b93b7-6286-4bdc-96a8-25543d36b9f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:44.555055 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-038b93b7-6286-4bdc-96a8-25543d36b9f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:44.563508 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-038b93b7-6286-4bdc-96a8-25543d36b9f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:44.565052 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-038b93b7-6286-4bdc-96a8-25543d36b9f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:44.566192 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-038b93b7-6286-4bdc-96a8-25543d36b9f5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.089747 Oct 15 03:54:44.566953 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 988/1872] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:54:44 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:54:45.016871 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-69b7313b-1c4d-448f-9b06-bd478e75cbad tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:45.017487 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-69b7313b-1c4d-448f-9b06-bd478e75cbad tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:45.023131 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-69b7313b-1c4d-448f-9b06-bd478e75cbad tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:45.023583 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-69b7313b-1c4d-448f-9b06-bd478e75cbad tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:45.024376 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-69b7313b-1c4d-448f-9b06-bd478e75cbad tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:45.024812 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-69b7313b-1c4d-448f-9b06-bd478e75cbad tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:45.082349 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-69b7313b-1c4d-448f-9b06-bd478e75cbad tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:45.089874 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-69b7313b-1c4d-448f-9b06-bd478e75cbad tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076666 Oct 15 03:54:45.090434 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 885/1873] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:45 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:45.584514 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-deb12086-66b8-4993-9d72-864279777a14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:45.585122 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-deb12086-66b8-4993-9d72-864279777a14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:45.591482 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-deb12086-66b8-4993-9d72-864279777a14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:45.592201 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-deb12086-66b8-4993-9d72-864279777a14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:45.592975 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-deb12086-66b8-4993-9d72-864279777a14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:45.593411 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-deb12086-66b8-4993-9d72-864279777a14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:45.653438 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-deb12086-66b8-4993-9d72-864279777a14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:45.662145 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-deb12086-66b8-4993-9d72-864279777a14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:45.663659 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-deb12086-66b8-4993-9d72-864279777a14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:45.664811 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-deb12086-66b8-4993-9d72-864279777a14 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.084055 Oct 15 03:54:45.665357 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 989/1874] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:54:45 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:54:46.106579 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a86c7431-99e7-480e-8cca-795c5dfd22aa tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:46.107245 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a86c7431-99e7-480e-8cca-795c5dfd22aa tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:46.113010 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a86c7431-99e7-480e-8cca-795c5dfd22aa tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:46.113460 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a86c7431-99e7-480e-8cca-795c5dfd22aa tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:46.114221 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a86c7431-99e7-480e-8cca-795c5dfd22aa tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:46.114649 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a86c7431-99e7-480e-8cca-795c5dfd22aa tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:46.171890 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-a86c7431-99e7-480e-8cca-795c5dfd22aa tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:46.179486 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a86c7431-99e7-480e-8cca-795c5dfd22aa tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076588 Oct 15 03:54:46.180165 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 886/1875] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:46 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:46.682513 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c88a71db-3448-4956-a5d9-fd031abaa772 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:46.683117 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c88a71db-3448-4956-a5d9-fd031abaa772 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:46.688795 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c88a71db-3448-4956-a5d9-fd031abaa772 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:46.689236 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c88a71db-3448-4956-a5d9-fd031abaa772 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:46.689983 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c88a71db-3448-4956-a5d9-fd031abaa772 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:46.690407 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c88a71db-3448-4956-a5d9-fd031abaa772 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:46.747934 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c88a71db-3448-4956-a5d9-fd031abaa772 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:46.756527 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c88a71db-3448-4956-a5d9-fd031abaa772 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:46.758007 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c88a71db-3448-4956-a5d9-fd031abaa772 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:46.759132 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c88a71db-3448-4956-a5d9-fd031abaa772 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080283 Oct 15 03:54:46.759691 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 990/1876] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:54:46 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:54:47.196009 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-acdc6ddf-4556-4f80-9dc7-6f328154a51b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:47.196541 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-acdc6ddf-4556-4f80-9dc7-6f328154a51b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:47.202128 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-acdc6ddf-4556-4f80-9dc7-6f328154a51b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:47.202572 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-acdc6ddf-4556-4f80-9dc7-6f328154a51b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:47.203326 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-acdc6ddf-4556-4f80-9dc7-6f328154a51b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:47.204035 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-acdc6ddf-4556-4f80-9dc7-6f328154a51b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:47.261718 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-acdc6ddf-4556-4f80-9dc7-6f328154a51b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:47.269255 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-acdc6ddf-4556-4f80-9dc7-6f328154a51b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077054 Oct 15 03:54:47.269812 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 887/1877] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:47 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:47.777171 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ae2e3650-b46f-4e46-bc1e-80551a812a50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:47.777814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ae2e3650-b46f-4e46-bc1e-80551a812a50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:47.783843 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ae2e3650-b46f-4e46-bc1e-80551a812a50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:47.784292 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ae2e3650-b46f-4e46-bc1e-80551a812a50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:47.785048 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ae2e3650-b46f-4e46-bc1e-80551a812a50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:47.785483 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ae2e3650-b46f-4e46-bc1e-80551a812a50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:47.848421 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ae2e3650-b46f-4e46-bc1e-80551a812a50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:47.856416 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ae2e3650-b46f-4e46-bc1e-80551a812a50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:47.857906 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ae2e3650-b46f-4e46-bc1e-80551a812a50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:47.859033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ae2e3650-b46f-4e46-bc1e-80551a812a50 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.085555 Oct 15 03:54:47.859573 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 991/1878] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:54:47 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:54:48.285295 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f8f9f0e6-65b3-492a-be8b-ff119e26fb22 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:48.285899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f8f9f0e6-65b3-492a-be8b-ff119e26fb22 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:48.291705 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f8f9f0e6-65b3-492a-be8b-ff119e26fb22 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:48.292180 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f8f9f0e6-65b3-492a-be8b-ff119e26fb22 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:48.292941 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f8f9f0e6-65b3-492a-be8b-ff119e26fb22 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:48.293371 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f8f9f0e6-65b3-492a-be8b-ff119e26fb22 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:48.351045 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f8f9f0e6-65b3-492a-be8b-ff119e26fb22 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:48.358485 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f8f9f0e6-65b3-492a-be8b-ff119e26fb22 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076901 Oct 15 03:54:48.359034 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 888/1879] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:48 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:48.876432 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-984070c9-9cc1-4271-913f-8fa1e3717c59 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:48.877041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-984070c9-9cc1-4271-913f-8fa1e3717c59 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:48.883022 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-984070c9-9cc1-4271-913f-8fa1e3717c59 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:48.883473 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-984070c9-9cc1-4271-913f-8fa1e3717c59 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:48.884268 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-984070c9-9cc1-4271-913f-8fa1e3717c59 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:48.884704 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-984070c9-9cc1-4271-913f-8fa1e3717c59 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:48.942471 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-984070c9-9cc1-4271-913f-8fa1e3717c59 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:48.950560 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-984070c9-9cc1-4271-913f-8fa1e3717c59 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:48.952082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-984070c9-9cc1-4271-913f-8fa1e3717c59 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:48.953213 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-984070c9-9cc1-4271-913f-8fa1e3717c59 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080533 Oct 15 03:54:48.954036 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 992/1880] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:54:48 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:54:49.375240 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ed51f34f-c8dc-4b5d-a68e-c5e517170054 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:49.375881 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ed51f34f-c8dc-4b5d-a68e-c5e517170054 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:49.382247 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ed51f34f-c8dc-4b5d-a68e-c5e517170054 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:49.382697 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ed51f34f-c8dc-4b5d-a68e-c5e517170054 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:49.383455 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ed51f34f-c8dc-4b5d-a68e-c5e517170054 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:49.383920 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ed51f34f-c8dc-4b5d-a68e-c5e517170054 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:49.441082 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ed51f34f-c8dc-4b5d-a68e-c5e517170054 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:49.449233 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ed51f34f-c8dc-4b5d-a68e-c5e517170054 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077663 Oct 15 03:54:49.449795 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 889/1881] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:49 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:49.971102 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8a1a7865-a409-4251-bfd1-2aea1273e31a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:49.971735 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8a1a7865-a409-4251-bfd1-2aea1273e31a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:49.978016 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8a1a7865-a409-4251-bfd1-2aea1273e31a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:49.978458 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8a1a7865-a409-4251-bfd1-2aea1273e31a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:49.979209 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8a1a7865-a409-4251-bfd1-2aea1273e31a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:49.979638 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8a1a7865-a409-4251-bfd1-2aea1273e31a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:50.037602 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8a1a7865-a409-4251-bfd1-2aea1273e31a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:50.045679 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8a1a7865-a409-4251-bfd1-2aea1273e31a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:50.047174 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8a1a7865-a409-4251-bfd1-2aea1273e31a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:50.048356 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8a1a7865-a409-4251-bfd1-2aea1273e31a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.081013 Oct 15 03:54:50.048897 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 993/1882] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:54:49 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:54:50.466016 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-508252c4-a901-4cf4-9950-a99403760eaa tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:50.466619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-508252c4-a901-4cf4-9950-a99403760eaa tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:50.472470 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-508252c4-a901-4cf4-9950-a99403760eaa tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:50.472914 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-508252c4-a901-4cf4-9950-a99403760eaa tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:50.473659 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-508252c4-a901-4cf4-9950-a99403760eaa tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:50.474084 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-508252c4-a901-4cf4-9950-a99403760eaa tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:50.530869 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-508252c4-a901-4cf4-9950-a99403760eaa tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:50.538326 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-508252c4-a901-4cf4-9950-a99403760eaa tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.075953 Oct 15 03:54:50.538881 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 890/1883] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:50 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:51.065854 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f32bf2ce-f613-44e7-b8fe-8228451a5d12 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:51.066463 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f32bf2ce-f613-44e7-b8fe-8228451a5d12 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:51.072276 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f32bf2ce-f613-44e7-b8fe-8228451a5d12 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:51.072721 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f32bf2ce-f613-44e7-b8fe-8228451a5d12 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:51.073474 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f32bf2ce-f613-44e7-b8fe-8228451a5d12 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:51.073908 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f32bf2ce-f613-44e7-b8fe-8228451a5d12 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:51.133822 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f32bf2ce-f613-44e7-b8fe-8228451a5d12 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:51.141818 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f32bf2ce-f613-44e7-b8fe-8228451a5d12 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:51.143306 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f32bf2ce-f613-44e7-b8fe-8228451a5d12 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:51.144471 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f32bf2ce-f613-44e7-b8fe-8228451a5d12 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.082314 Oct 15 03:54:51.145009 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 994/1884] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:54:51 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:54:51.554096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a81f3d63-7565-400d-a63d-f22f3795b4bc tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:51.554698 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a81f3d63-7565-400d-a63d-f22f3795b4bc tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:51.560427 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a81f3d63-7565-400d-a63d-f22f3795b4bc tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:51.560867 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a81f3d63-7565-400d-a63d-f22f3795b4bc tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:51.561613 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a81f3d63-7565-400d-a63d-f22f3795b4bc tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:51.562038 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a81f3d63-7565-400d-a63d-f22f3795b4bc tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:51.619763 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-a81f3d63-7565-400d-a63d-f22f3795b4bc tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:51.627050 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a81f3d63-7565-400d-a63d-f22f3795b4bc tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076617 Oct 15 03:54:51.627599 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 891/1885] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:51 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:52.162362 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1b1da771-2e1b-4f79-aabd-195ea6153496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:52.162969 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1b1da771-2e1b-4f79-aabd-195ea6153496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:52.168749 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b1da771-2e1b-4f79-aabd-195ea6153496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:52.169190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b1da771-2e1b-4f79-aabd-195ea6153496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:52.169939 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b1da771-2e1b-4f79-aabd-195ea6153496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:52.170368 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1b1da771-2e1b-4f79-aabd-195ea6153496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:52.229974 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1b1da771-2e1b-4f79-aabd-195ea6153496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:52.238013 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1b1da771-2e1b-4f79-aabd-195ea6153496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:52.239672 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1b1da771-2e1b-4f79-aabd-195ea6153496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:52.241248 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1b1da771-2e1b-4f79-aabd-195ea6153496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.082643 Oct 15 03:54:52.242018 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 995/1886] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:54:52 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:54:52.643884 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1be067c7-4bcf-431f-aa34-a850fca68391 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:52.644490 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1be067c7-4bcf-431f-aa34-a850fca68391 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:52.650325 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1be067c7-4bcf-431f-aa34-a850fca68391 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:52.650763 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1be067c7-4bcf-431f-aa34-a850fca68391 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:52.651509 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1be067c7-4bcf-431f-aa34-a850fca68391 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:52.651961 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1be067c7-4bcf-431f-aa34-a850fca68391 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:52.709343 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-1be067c7-4bcf-431f-aa34-a850fca68391 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:52.716753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1be067c7-4bcf-431f-aa34-a850fca68391 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076487 Oct 15 03:54:52.717302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 892/1887] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:52 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:53.258075 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a82fc25e-b6a2-4922-989f-48936aa31a06 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:53.258684 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a82fc25e-b6a2-4922-989f-48936aa31a06 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:53.264473 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a82fc25e-b6a2-4922-989f-48936aa31a06 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:53.264920 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a82fc25e-b6a2-4922-989f-48936aa31a06 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:53.265675 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a82fc25e-b6a2-4922-989f-48936aa31a06 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:53.266107 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a82fc25e-b6a2-4922-989f-48936aa31a06 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:53.324808 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a82fc25e-b6a2-4922-989f-48936aa31a06 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:53.333213 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a82fc25e-b6a2-4922-989f-48936aa31a06 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:53.335293 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a82fc25e-b6a2-4922-989f-48936aa31a06 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:53.336455 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a82fc25e-b6a2-4922-989f-48936aa31a06 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.082083 Oct 15 03:54:53.337010 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 996/1888] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:54:53 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:54:53.733302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-bfdde286-2317-4674-ae2c-d802eb4393b5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:53.733842 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-bfdde286-2317-4674-ae2c-d802eb4393b5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:53.739517 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfdde286-2317-4674-ae2c-d802eb4393b5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:53.739987 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfdde286-2317-4674-ae2c-d802eb4393b5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:53.740735 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfdde286-2317-4674-ae2c-d802eb4393b5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:53.741162 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfdde286-2317-4674-ae2c-d802eb4393b5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:53.776866 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5cc85daf-8c99-49f7-9b26-c6658a21a2b7] AMQP server on 10.222.0.30:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Oct 15 03:54:53.798191 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-bfdde286-2317-4674-ae2c-d802eb4393b5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:53.805774 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-bfdde286-2317-4674-ae2c-d802eb4393b5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076184 Oct 15 03:54:53.806337 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 893/1889] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:53 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:54.354190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5be8c862-295c-4349-a2b0-08985e6b4139 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:54.354795 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5be8c862-295c-4349-a2b0-08985e6b4139 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:54.360620 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5be8c862-295c-4349-a2b0-08985e6b4139 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:54.361070 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5be8c862-295c-4349-a2b0-08985e6b4139 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:54.361822 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5be8c862-295c-4349-a2b0-08985e6b4139 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:54.362254 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5be8c862-295c-4349-a2b0-08985e6b4139 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:54.421937 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5be8c862-295c-4349-a2b0-08985e6b4139 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:54.430409 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5be8c862-295c-4349-a2b0-08985e6b4139 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:54.431931 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5be8c862-295c-4349-a2b0-08985e6b4139 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:54.433054 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5be8c862-295c-4349-a2b0-08985e6b4139 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.082641 Oct 15 03:54:54.433593 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 997/1890] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:54:54 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:54:54.822346 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-06a338cc-8871-4a21-8e94-8157a61c0d1b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:54.822869 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-06a338cc-8871-4a21-8e94-8157a61c0d1b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:54.840089 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-06a338cc-8871-4a21-8e94-8157a61c0d1b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:54.840541 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-06a338cc-8871-4a21-8e94-8157a61c0d1b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:54.841299 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-06a338cc-8871-4a21-8e94-8157a61c0d1b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:54.841730 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-06a338cc-8871-4a21-8e94-8157a61c0d1b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:54.856535 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] [5cc85daf-8c99-49f7-9b26-c6658a21a2b7] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 35724. Oct 15 03:54:54.901330 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-06a338cc-8871-4a21-8e94-8157a61c0d1b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:54.908946 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-06a338cc-8871-4a21-8e94-8157a61c0d1b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.090900 Oct 15 03:54:54.909505 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 894/1891] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:54 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:55.451227 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-288bb98b-b5c2-46b7-a255-9a72ed78a9b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:55.451862 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-288bb98b-b5c2-46b7-a255-9a72ed78a9b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:55.457867 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-288bb98b-b5c2-46b7-a255-9a72ed78a9b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:55.458341 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-288bb98b-b5c2-46b7-a255-9a72ed78a9b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:55.459070 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-288bb98b-b5c2-46b7-a255-9a72ed78a9b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:55.459499 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-288bb98b-b5c2-46b7-a255-9a72ed78a9b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:55.516803 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-288bb98b-b5c2-46b7-a255-9a72ed78a9b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:55.525331 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-288bb98b-b5c2-46b7-a255-9a72ed78a9b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:55.526810 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-288bb98b-b5c2-46b7-a255-9a72ed78a9b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:55.527956 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-288bb98b-b5c2-46b7-a255-9a72ed78a9b9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080386 Oct 15 03:54:55.528497 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 998/1892] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:54:55 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:54:55.925570 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-499b01fa-7856-4654-89f2-0a32f61d1b68 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:55.926106 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-499b01fa-7856-4654-89f2-0a32f61d1b68 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:55.932351 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-499b01fa-7856-4654-89f2-0a32f61d1b68 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:55.932798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-499b01fa-7856-4654-89f2-0a32f61d1b68 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:55.933546 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-499b01fa-7856-4654-89f2-0a32f61d1b68 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:55.933972 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-499b01fa-7856-4654-89f2-0a32f61d1b68 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:55.993724 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-499b01fa-7856-4654-89f2-0a32f61d1b68 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:56.001697 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-499b01fa-7856-4654-89f2-0a32f61d1b68 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.079859 Oct 15 03:54:56.002251 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 895/1893] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:55 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:56.544996 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f32fa016-0b45-471e-b4f5-47728bec6232 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:56.545596 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f32fa016-0b45-471e-b4f5-47728bec6232 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:56.551491 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f32fa016-0b45-471e-b4f5-47728bec6232 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:56.552537 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f32fa016-0b45-471e-b4f5-47728bec6232 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:56.553298 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f32fa016-0b45-471e-b4f5-47728bec6232 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:56.553727 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f32fa016-0b45-471e-b4f5-47728bec6232 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:56.610812 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f32fa016-0b45-471e-b4f5-47728bec6232 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:56.619304 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f32fa016-0b45-471e-b4f5-47728bec6232 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:56.620849 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f32fa016-0b45-471e-b4f5-47728bec6232 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:56.621965 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f32fa016-0b45-471e-b4f5-47728bec6232 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080639 Oct 15 03:54:56.622516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 999/1894] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:54:56 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:54:57.021902 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-08ad8466-1534-4f37-bd37-4c98883ecb42 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:57.022509 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-08ad8466-1534-4f37-bd37-4c98883ecb42 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:57.028218 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08ad8466-1534-4f37-bd37-4c98883ecb42 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:57.028663 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08ad8466-1534-4f37-bd37-4c98883ecb42 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:57.029408 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08ad8466-1534-4f37-bd37-4c98883ecb42 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:57.029832 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08ad8466-1534-4f37-bd37-4c98883ecb42 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:57.087151 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-08ad8466-1534-4f37-bd37-4c98883ecb42 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:57.094653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-08ad8466-1534-4f37-bd37-4c98883ecb42 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076444 Oct 15 03:54:57.095200 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 896/1895] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:57 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:57.640164 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-146b3415-ae46-459c-97df-003ef573fb1d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:57.640919 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-146b3415-ae46-459c-97df-003ef573fb1d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:57.647257 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-146b3415-ae46-459c-97df-003ef573fb1d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:57.647720 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-146b3415-ae46-459c-97df-003ef573fb1d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:57.648482 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-146b3415-ae46-459c-97df-003ef573fb1d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:57.648942 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-146b3415-ae46-459c-97df-003ef573fb1d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:57.708844 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-146b3415-ae46-459c-97df-003ef573fb1d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:57.716780 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-146b3415-ae46-459c-97df-003ef573fb1d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:57.718269 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-146b3415-ae46-459c-97df-003ef573fb1d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:57.719384 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-146b3415-ae46-459c-97df-003ef573fb1d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.082937 Oct 15 03:54:57.719976 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1000/1896] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:54:57 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:54:58.111935 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9391ff5f-8f4c-4628-90b5-afbfe3ae3453 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:58.112569 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9391ff5f-8f4c-4628-90b5-afbfe3ae3453 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:58.118180 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9391ff5f-8f4c-4628-90b5-afbfe3ae3453 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:58.118624 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9391ff5f-8f4c-4628-90b5-afbfe3ae3453 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:58.119377 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9391ff5f-8f4c-4628-90b5-afbfe3ae3453 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:58.119833 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9391ff5f-8f4c-4628-90b5-afbfe3ae3453 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:58.176798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-9391ff5f-8f4c-4628-90b5-afbfe3ae3453 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:58.184466 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9391ff5f-8f4c-4628-90b5-afbfe3ae3453 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076168 Oct 15 03:54:58.185011 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 897/1897] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:58 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:58.736881 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-de21a425-d7b9-4388-a227-7ed590efcbcc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:58.737479 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-de21a425-d7b9-4388-a227-7ed590efcbcc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:58.743783 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-de21a425-d7b9-4388-a227-7ed590efcbcc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:58.744168 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-de21a425-d7b9-4388-a227-7ed590efcbcc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:58.744912 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-de21a425-d7b9-4388-a227-7ed590efcbcc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:58.745337 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-de21a425-d7b9-4388-a227-7ed590efcbcc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:58.802634 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-de21a425-d7b9-4388-a227-7ed590efcbcc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:58.811025 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-de21a425-d7b9-4388-a227-7ed590efcbcc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:58.812544 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-de21a425-d7b9-4388-a227-7ed590efcbcc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:58.813720 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-de21a425-d7b9-4388-a227-7ed590efcbcc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080535 Oct 15 03:54:58.814256 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1001/1898] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:54:58 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:54:59.031466 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:54:59.031669 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 03:54:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:54:59.200608 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-266ab0ff-f70a-4c06-8635-0b837e1b4701 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:59.201236 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-266ab0ff-f70a-4c06-8635-0b837e1b4701 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:59.207162 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-266ab0ff-f70a-4c06-8635-0b837e1b4701 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:59.207605 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-266ab0ff-f70a-4c06-8635-0b837e1b4701 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:59.208987 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-266ab0ff-f70a-4c06-8635-0b837e1b4701 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:59.209422 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-266ab0ff-f70a-4c06-8635-0b837e1b4701 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:59.269704 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-266ab0ff-f70a-4c06-8635-0b837e1b4701 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:59.277901 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-266ab0ff-f70a-4c06-8635-0b837e1b4701 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.080758 Oct 15 03:54:59.278452 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 898/1899] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:54:59 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:54:59.832126 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ff34c272-f438-4020-9a64-8fef1ecd5714 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:54:59.832735 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ff34c272-f438-4020-9a64-8fef1ecd5714 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:54:59.839782 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff34c272-f438-4020-9a64-8fef1ecd5714 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:59.840231 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff34c272-f438-4020-9a64-8fef1ecd5714 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:59.840990 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff34c272-f438-4020-9a64-8fef1ecd5714 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:54:59.841419 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ff34c272-f438-4020-9a64-8fef1ecd5714 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:54:59.898601 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ff34c272-f438-4020-9a64-8fef1ecd5714 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:59.906601 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ff34c272-f438-4020-9a64-8fef1ecd5714 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:59.908125 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ff34c272-f438-4020-9a64-8fef1ecd5714 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:54:59.909253 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ff34c272-f438-4020-9a64-8fef1ecd5714 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.081177 Oct 15 03:54:59.909789 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1002/1900] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:54:59 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:00.294281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-aaa9e249-1228-4bc9-b565-3f8365754145 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:00.294889 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-aaa9e249-1228-4bc9-b565-3f8365754145 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:00.300708 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aaa9e249-1228-4bc9-b565-3f8365754145 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:00.301160 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aaa9e249-1228-4bc9-b565-3f8365754145 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:00.302427 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aaa9e249-1228-4bc9-b565-3f8365754145 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:00.302865 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aaa9e249-1228-4bc9-b565-3f8365754145 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:00.359229 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-aaa9e249-1228-4bc9-b565-3f8365754145 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:00.367225 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-aaa9e249-1228-4bc9-b565-3f8365754145 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076621 Oct 15 03:55:00.367798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 899/1901] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:00 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:00.925931 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-16cf43a3-908a-46b0-9317-3e366e2c77bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:00.926469 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-16cf43a3-908a-46b0-9317-3e366e2c77bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:00.932608 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16cf43a3-908a-46b0-9317-3e366e2c77bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:00.933058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16cf43a3-908a-46b0-9317-3e366e2c77bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:00.933814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16cf43a3-908a-46b0-9317-3e366e2c77bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:00.934254 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16cf43a3-908a-46b0-9317-3e366e2c77bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:00.995293 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-16cf43a3-908a-46b0-9317-3e366e2c77bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:01.003556 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-16cf43a3-908a-46b0-9317-3e366e2c77bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:01.005631 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-16cf43a3-908a-46b0-9317-3e366e2c77bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:01.006759 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-16cf43a3-908a-46b0-9317-3e366e2c77bb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.084645 Oct 15 03:55:01.007302 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1003/1902] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:00 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:01.383583 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2c974cb6-26db-4196-88e3-1b7e08094708 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:01.384232 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2c974cb6-26db-4196-88e3-1b7e08094708 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:01.390006 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2c974cb6-26db-4196-88e3-1b7e08094708 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:01.390449 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2c974cb6-26db-4196-88e3-1b7e08094708 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:01.391209 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2c974cb6-26db-4196-88e3-1b7e08094708 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:01.391642 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2c974cb6-26db-4196-88e3-1b7e08094708 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:01.448539 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2c974cb6-26db-4196-88e3-1b7e08094708 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:01.456200 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2c974cb6-26db-4196-88e3-1b7e08094708 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076274 Oct 15 03:55:01.456778 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 900/1903] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:01 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:02.025274 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-132b61fd-60e2-40de-ae8e-b27cc0eb79fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:02.025887 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-132b61fd-60e2-40de-ae8e-b27cc0eb79fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:02.031660 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-132b61fd-60e2-40de-ae8e-b27cc0eb79fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:02.032140 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-132b61fd-60e2-40de-ae8e-b27cc0eb79fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:02.032896 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-132b61fd-60e2-40de-ae8e-b27cc0eb79fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:02.033325 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-132b61fd-60e2-40de-ae8e-b27cc0eb79fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:02.090746 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-132b61fd-60e2-40de-ae8e-b27cc0eb79fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:02.098898 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-132b61fd-60e2-40de-ae8e-b27cc0eb79fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:02.100465 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-132b61fd-60e2-40de-ae8e-b27cc0eb79fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:02.101624 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-132b61fd-60e2-40de-ae8e-b27cc0eb79fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080784 Oct 15 03:55:02.102198 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1004/1904] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:02 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:55:02.474087 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-67c027d8-903e-485d-83db-17eb934e0862 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:02.474743 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-67c027d8-903e-485d-83db-17eb934e0862 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:02.480593 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-67c027d8-903e-485d-83db-17eb934e0862 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:02.481041 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-67c027d8-903e-485d-83db-17eb934e0862 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:02.481798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-67c027d8-903e-485d-83db-17eb934e0862 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:02.482228 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-67c027d8-903e-485d-83db-17eb934e0862 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:02.540261 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-67c027d8-903e-485d-83db-17eb934e0862 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:02.547707 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-67c027d8-903e-485d-83db-17eb934e0862 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077298 Oct 15 03:55:02.548264 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 901/1905] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:02 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:03.119580 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-449e5aae-84c3-4e5b-8a10-ff9c539fdc0d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:03.120226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-449e5aae-84c3-4e5b-8a10-ff9c539fdc0d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:03.126102 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-449e5aae-84c3-4e5b-8a10-ff9c539fdc0d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:03.126554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-449e5aae-84c3-4e5b-8a10-ff9c539fdc0d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:03.127314 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-449e5aae-84c3-4e5b-8a10-ff9c539fdc0d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:03.127779 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-449e5aae-84c3-4e5b-8a10-ff9c539fdc0d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:03.185175 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-449e5aae-84c3-4e5b-8a10-ff9c539fdc0d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:03.193919 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-449e5aae-84c3-4e5b-8a10-ff9c539fdc0d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:03.195426 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-449e5aae-84c3-4e5b-8a10-ff9c539fdc0d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:03.196592 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-449e5aae-84c3-4e5b-8a10-ff9c539fdc0d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080681 Oct 15 03:55:03.197138 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1005/1906] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:03 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:03.564660 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-964f6147-c0c4-42ab-9d92-b01e0d231e06 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:03.565262 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-964f6147-c0c4-42ab-9d92-b01e0d231e06 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:03.570986 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-964f6147-c0c4-42ab-9d92-b01e0d231e06 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:03.571426 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-964f6147-c0c4-42ab-9d92-b01e0d231e06 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:03.572215 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-964f6147-c0c4-42ab-9d92-b01e0d231e06 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:03.572636 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-964f6147-c0c4-42ab-9d92-b01e0d231e06 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:03.631802 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-964f6147-c0c4-42ab-9d92-b01e0d231e06 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:03.639546 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-964f6147-c0c4-42ab-9d92-b01e0d231e06 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.078602 Oct 15 03:55:03.640128 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 902/1907] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:03 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:04.215244 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cd81be75-a599-40c0-a5e1-c5a33c82b08b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:04.215881 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cd81be75-a599-40c0-a5e1-c5a33c82b08b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:04.221574 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd81be75-a599-40c0-a5e1-c5a33c82b08b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:04.222021 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd81be75-a599-40c0-a5e1-c5a33c82b08b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:04.222777 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd81be75-a599-40c0-a5e1-c5a33c82b08b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:04.223206 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cd81be75-a599-40c0-a5e1-c5a33c82b08b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:04.284235 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-cd81be75-a599-40c0-a5e1-c5a33c82b08b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:04.292231 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-cd81be75-a599-40c0-a5e1-c5a33c82b08b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:04.293698 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-cd81be75-a599-40c0-a5e1-c5a33c82b08b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:04.294804 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cd81be75-a599-40c0-a5e1-c5a33c82b08b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.083253 Oct 15 03:55:04.295348 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1006/1908] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:04 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:04.656090 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3e9f151e-ed8b-4362-8e4e-86122695abbd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:04.656737 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3e9f151e-ed8b-4362-8e4e-86122695abbd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:04.662529 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3e9f151e-ed8b-4362-8e4e-86122695abbd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:04.662988 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3e9f151e-ed8b-4362-8e4e-86122695abbd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:04.663780 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3e9f151e-ed8b-4362-8e4e-86122695abbd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:04.664220 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3e9f151e-ed8b-4362-8e4e-86122695abbd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:04.721481 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3e9f151e-ed8b-4362-8e4e-86122695abbd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:04.729085 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3e9f151e-ed8b-4362-8e4e-86122695abbd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076650 Oct 15 03:55:04.729647 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 903/1909] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:04 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:05.312264 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d2aaf25a-f18f-49ff-b763-1a1afca8bd8d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:05.312862 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d2aaf25a-f18f-49ff-b763-1a1afca8bd8d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:05.318569 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2aaf25a-f18f-49ff-b763-1a1afca8bd8d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:05.319010 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2aaf25a-f18f-49ff-b763-1a1afca8bd8d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:05.319792 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2aaf25a-f18f-49ff-b763-1a1afca8bd8d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:05.320219 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2aaf25a-f18f-49ff-b763-1a1afca8bd8d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:05.378577 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d2aaf25a-f18f-49ff-b763-1a1afca8bd8d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:05.386492 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d2aaf25a-f18f-49ff-b763-1a1afca8bd8d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:05.387996 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d2aaf25a-f18f-49ff-b763-1a1afca8bd8d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:05.389108 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d2aaf25a-f18f-49ff-b763-1a1afca8bd8d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080544 Oct 15 03:55:05.389649 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1007/1910] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:05 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:05.670016 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:55:05.670331 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 03:55:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:55:05.745448 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f7a441dd-9efd-435b-ad61-57de0ff5ebb1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:05.746052 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f7a441dd-9efd-435b-ad61-57de0ff5ebb1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:05.751809 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f7a441dd-9efd-435b-ad61-57de0ff5ebb1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:05.752253 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f7a441dd-9efd-435b-ad61-57de0ff5ebb1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:05.753000 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f7a441dd-9efd-435b-ad61-57de0ff5ebb1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:05.753441 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f7a441dd-9efd-435b-ad61-57de0ff5ebb1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:05.810433 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f7a441dd-9efd-435b-ad61-57de0ff5ebb1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:05.817877 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f7a441dd-9efd-435b-ad61-57de0ff5ebb1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076069 Oct 15 03:55:05.818941 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 904/1911] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:05 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:06.406650 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2d789738-23a5-4ab6-bf30-3f72bad249f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:06.407250 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2d789738-23a5-4ab6-bf30-3f72bad249f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:06.413069 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2d789738-23a5-4ab6-bf30-3f72bad249f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:06.413516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2d789738-23a5-4ab6-bf30-3f72bad249f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:06.414256 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2d789738-23a5-4ab6-bf30-3f72bad249f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:06.414678 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2d789738-23a5-4ab6-bf30-3f72bad249f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:06.472295 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2d789738-23a5-4ab6-bf30-3f72bad249f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:06.480696 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2d789738-23a5-4ab6-bf30-3f72bad249f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:06.482153 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2d789738-23a5-4ab6-bf30-3f72bad249f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:06.483254 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2d789738-23a5-4ab6-bf30-3f72bad249f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080339 Oct 15 03:55:06.483817 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1008/1912] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:06 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:06.835572 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a06aa86e-6ba2-47ad-bcb0-69f8169907a1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:06.836115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a06aa86e-6ba2-47ad-bcb0-69f8169907a1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:06.841876 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a06aa86e-6ba2-47ad-bcb0-69f8169907a1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:06.842323 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a06aa86e-6ba2-47ad-bcb0-69f8169907a1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:06.843084 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a06aa86e-6ba2-47ad-bcb0-69f8169907a1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:06.843520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a06aa86e-6ba2-47ad-bcb0-69f8169907a1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:06.900478 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-a06aa86e-6ba2-47ad-bcb0-69f8169907a1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:06.907965 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a06aa86e-6ba2-47ad-bcb0-69f8169907a1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076739 Oct 15 03:55:06.908523 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 905/1913] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:06 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:07.501197 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e20069ee-beac-4d1f-b32d-be921a6b336b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:07.501716 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e20069ee-beac-4d1f-b32d-be921a6b336b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:07.507939 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e20069ee-beac-4d1f-b32d-be921a6b336b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:07.508378 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e20069ee-beac-4d1f-b32d-be921a6b336b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:07.509125 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e20069ee-beac-4d1f-b32d-be921a6b336b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:07.509548 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e20069ee-beac-4d1f-b32d-be921a6b336b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:07.569683 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e20069ee-beac-4d1f-b32d-be921a6b336b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:07.577846 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e20069ee-beac-4d1f-b32d-be921a6b336b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:07.579596 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e20069ee-beac-4d1f-b32d-be921a6b336b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:07.580758 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e20069ee-beac-4d1f-b32d-be921a6b336b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.083320 Oct 15 03:55:07.581300 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1009/1914] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:07 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:07.925194 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-495d1b97-5cea-4bf8-ac20-d00722b21f1d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:07.925733 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-495d1b97-5cea-4bf8-ac20-d00722b21f1d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:07.931927 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-495d1b97-5cea-4bf8-ac20-d00722b21f1d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:07.932378 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-495d1b97-5cea-4bf8-ac20-d00722b21f1d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:07.933142 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-495d1b97-5cea-4bf8-ac20-d00722b21f1d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:07.933578 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-495d1b97-5cea-4bf8-ac20-d00722b21f1d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:07.993182 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-495d1b97-5cea-4bf8-ac20-d00722b21f1d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:08.000781 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-495d1b97-5cea-4bf8-ac20-d00722b21f1d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.079364 Oct 15 03:55:08.001341 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 906/1915] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:07 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:08.598130 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-96d77ce7-25ff-44f6-9a72-87b50f61ba66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:08.598738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-96d77ce7-25ff-44f6-9a72-87b50f61ba66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:08.604561 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96d77ce7-25ff-44f6-9a72-87b50f61ba66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:08.605014 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96d77ce7-25ff-44f6-9a72-87b50f61ba66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:08.605771 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96d77ce7-25ff-44f6-9a72-87b50f61ba66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:08.606201 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-96d77ce7-25ff-44f6-9a72-87b50f61ba66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:08.666344 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-96d77ce7-25ff-44f6-9a72-87b50f61ba66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:08.674415 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-96d77ce7-25ff-44f6-9a72-87b50f61ba66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:08.675940 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-96d77ce7-25ff-44f6-9a72-87b50f61ba66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:08.677065 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-96d77ce7-25ff-44f6-9a72-87b50f61ba66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.082631 Oct 15 03:55:08.678130 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1010/1916] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:08 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:09.017136 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-32d58275-6bbf-4775-9c63-77fdaaec1572 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:09.017745 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-32d58275-6bbf-4775-9c63-77fdaaec1572 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:09.023504 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-32d58275-6bbf-4775-9c63-77fdaaec1572 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:09.023993 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-32d58275-6bbf-4775-9c63-77fdaaec1572 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:09.024762 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-32d58275-6bbf-4775-9c63-77fdaaec1572 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:09.025199 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-32d58275-6bbf-4775-9c63-77fdaaec1572 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:09.082588 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-32d58275-6bbf-4775-9c63-77fdaaec1572 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:09.090578 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-32d58275-6bbf-4775-9c63-77fdaaec1572 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077126 Oct 15 03:55:09.091133 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 907/1917] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:09 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:09.694793 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-119eb779-2e90-4988-bccc-f3bf6744035d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:09.695398 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-119eb779-2e90-4988-bccc-f3bf6744035d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:09.701414 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-119eb779-2e90-4988-bccc-f3bf6744035d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:09.701860 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-119eb779-2e90-4988-bccc-f3bf6744035d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:09.702614 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-119eb779-2e90-4988-bccc-f3bf6744035d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:09.703044 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-119eb779-2e90-4988-bccc-f3bf6744035d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:09.760162 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-119eb779-2e90-4988-bccc-f3bf6744035d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:09.768049 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-119eb779-2e90-4988-bccc-f3bf6744035d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:09.769563 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-119eb779-2e90-4988-bccc-f3bf6744035d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:09.770677 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-119eb779-2e90-4988-bccc-f3bf6744035d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080197 Oct 15 03:55:09.771828 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1011/1918] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:09 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:10.106893 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-cd40340c-90e3-4d1c-8745-3ad1e2b230d3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:10.107527 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-cd40340c-90e3-4d1c-8745-3ad1e2b230d3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:10.113263 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cd40340c-90e3-4d1c-8745-3ad1e2b230d3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:10.113726 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cd40340c-90e3-4d1c-8745-3ad1e2b230d3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:10.114465 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cd40340c-90e3-4d1c-8745-3ad1e2b230d3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:10.115430 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cd40340c-90e3-4d1c-8745-3ad1e2b230d3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:10.171552 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-cd40340c-90e3-4d1c-8745-3ad1e2b230d3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:10.179408 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-cd40340c-90e3-4d1c-8745-3ad1e2b230d3 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076135 Oct 15 03:55:10.179992 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 908/1919] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:10 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:10.675216 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:55:10.675381 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 03:55:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:55:10.789443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2d96be42-d996-452a-b6d8-3e3d21952504 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:10.789977 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2d96be42-d996-452a-b6d8-3e3d21952504 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:10.795928 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2d96be42-d996-452a-b6d8-3e3d21952504 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:10.796376 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2d96be42-d996-452a-b6d8-3e3d21952504 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:10.797131 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2d96be42-d996-452a-b6d8-3e3d21952504 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:10.797563 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2d96be42-d996-452a-b6d8-3e3d21952504 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:10.816262 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:55:10.816436 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 03:55:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:55:10.858558 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2d96be42-d996-452a-b6d8-3e3d21952504 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:10.866764 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2d96be42-d996-452a-b6d8-3e3d21952504 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:10.868598 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2d96be42-d996-452a-b6d8-3e3d21952504 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:10.869919 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2d96be42-d996-452a-b6d8-3e3d21952504 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.084715 Oct 15 03:55:10.870491 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1012/1920] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:10 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:11.196231 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-bfc93879-318c-424d-ad60-22f656e6eaa1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:11.196758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-bfc93879-318c-424d-ad60-22f656e6eaa1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:11.202475 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfc93879-318c-424d-ad60-22f656e6eaa1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:11.202923 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfc93879-318c-424d-ad60-22f656e6eaa1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:11.203974 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfc93879-318c-424d-ad60-22f656e6eaa1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:11.204405 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfc93879-318c-424d-ad60-22f656e6eaa1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:11.262126 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-bfc93879-318c-424d-ad60-22f656e6eaa1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:11.269832 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-bfc93879-318c-424d-ad60-22f656e6eaa1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077898 Oct 15 03:55:11.270384 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 909/1921] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:11 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:11.887345 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-cbc48e7a-b799-4db0-836e-9a7756a763ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:11.887980 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-cbc48e7a-b799-4db0-836e-9a7756a763ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:11.893813 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cbc48e7a-b799-4db0-836e-9a7756a763ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:11.894261 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cbc48e7a-b799-4db0-836e-9a7756a763ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:11.895017 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cbc48e7a-b799-4db0-836e-9a7756a763ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:11.895446 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-cbc48e7a-b799-4db0-836e-9a7756a763ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:11.952431 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-cbc48e7a-b799-4db0-836e-9a7756a763ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:11.961190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-cbc48e7a-b799-4db0-836e-9a7756a763ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:11.962679 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-cbc48e7a-b799-4db0-836e-9a7756a763ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:11.963832 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-cbc48e7a-b799-4db0-836e-9a7756a763ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080171 Oct 15 03:55:11.964369 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1013/1922] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:11 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:12.286828 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-03053cc9-8cc4-4755-9e9b-8b29ea33c57c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:12.287433 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-03053cc9-8cc4-4755-9e9b-8b29ea33c57c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:12.293165 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-03053cc9-8cc4-4755-9e9b-8b29ea33c57c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:12.293610 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-03053cc9-8cc4-4755-9e9b-8b29ea33c57c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:12.294356 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-03053cc9-8cc4-4755-9e9b-8b29ea33c57c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:12.294782 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-03053cc9-8cc4-4755-9e9b-8b29ea33c57c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:12.351945 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-03053cc9-8cc4-4755-9e9b-8b29ea33c57c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:12.359571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-03053cc9-8cc4-4755-9e9b-8b29ea33c57c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076489 Oct 15 03:55:12.360208 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 910/1923] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:12 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:12.981242 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-42536edc-7091-470c-ae51-65954e3fd520 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:12.981789 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-42536edc-7091-470c-ae51-65954e3fd520 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:12.987800 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-42536edc-7091-470c-ae51-65954e3fd520 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:12.988251 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-42536edc-7091-470c-ae51-65954e3fd520 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:12.989011 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-42536edc-7091-470c-ae51-65954e3fd520 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:12.989444 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-42536edc-7091-470c-ae51-65954e3fd520 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:13.046776 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-42536edc-7091-470c-ae51-65954e3fd520 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:13.054696 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-42536edc-7091-470c-ae51-65954e3fd520 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:13.056227 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-42536edc-7091-470c-ae51-65954e3fd520 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:13.057347 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-42536edc-7091-470c-ae51-65954e3fd520 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.079866 Oct 15 03:55:13.057878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1014/1924] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:12 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:13.378288 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2617183f-3773-4f9c-a8a2-9455a4816e27 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:13.378901 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2617183f-3773-4f9c-a8a2-9455a4816e27 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:13.385215 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2617183f-3773-4f9c-a8a2-9455a4816e27 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:13.385663 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2617183f-3773-4f9c-a8a2-9455a4816e27 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:13.386419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2617183f-3773-4f9c-a8a2-9455a4816e27 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:13.386851 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2617183f-3773-4f9c-a8a2-9455a4816e27 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:13.445533 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2617183f-3773-4f9c-a8a2-9455a4816e27 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:13.453036 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2617183f-3773-4f9c-a8a2-9455a4816e27 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.078360 Oct 15 03:55:13.453842 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 911/1925] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:13 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:14.074685 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bd0fabba-0e74-4c0c-9c59-54886768e211 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:14.075281 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bd0fabba-0e74-4c0c-9c59-54886768e211 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:14.081232 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bd0fabba-0e74-4c0c-9c59-54886768e211 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:14.081674 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bd0fabba-0e74-4c0c-9c59-54886768e211 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:14.082423 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bd0fabba-0e74-4c0c-9c59-54886768e211 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:14.082850 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bd0fabba-0e74-4c0c-9c59-54886768e211 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:14.142624 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bd0fabba-0e74-4c0c-9c59-54886768e211 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:14.150871 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bd0fabba-0e74-4c0c-9c59-54886768e211 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:14.152423 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bd0fabba-0e74-4c0c-9c59-54886768e211 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:14.153547 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bd0fabba-0e74-4c0c-9c59-54886768e211 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.082567 Oct 15 03:55:14.154093 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1015/1926] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:14 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:55:14.470354 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-21a5aaf3-456e-4221-a74d-4c6be9a7e9f4 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:14.470909 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-21a5aaf3-456e-4221-a74d-4c6be9a7e9f4 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:14.477129 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-21a5aaf3-456e-4221-a74d-4c6be9a7e9f4 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:14.477570 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-21a5aaf3-456e-4221-a74d-4c6be9a7e9f4 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:14.478321 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-21a5aaf3-456e-4221-a74d-4c6be9a7e9f4 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:14.478742 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-21a5aaf3-456e-4221-a74d-4c6be9a7e9f4 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:14.535492 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-21a5aaf3-456e-4221-a74d-4c6be9a7e9f4 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:14.543794 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-21a5aaf3-456e-4221-a74d-4c6be9a7e9f4 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077083 Oct 15 03:55:14.544362 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 912/1927] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:14 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:15.171627 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-30f4edb2-693a-4df2-90b7-d0ecf959ce5b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:15.172322 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-30f4edb2-693a-4df2-90b7-d0ecf959ce5b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:15.178600 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-30f4edb2-693a-4df2-90b7-d0ecf959ce5b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:15.179046 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-30f4edb2-693a-4df2-90b7-d0ecf959ce5b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:15.179832 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-30f4edb2-693a-4df2-90b7-d0ecf959ce5b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:15.180265 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-30f4edb2-693a-4df2-90b7-d0ecf959ce5b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:15.237407 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-30f4edb2-693a-4df2-90b7-d0ecf959ce5b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:15.246038 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-30f4edb2-693a-4df2-90b7-d0ecf959ce5b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:15.247533 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-30f4edb2-693a-4df2-90b7-d0ecf959ce5b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:15.248696 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-30f4edb2-693a-4df2-90b7-d0ecf959ce5b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080791 Oct 15 03:55:15.249235 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1016/1928] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:15 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:15.560123 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d26ec31a-dc33-4ca7-ae3f-172b9a8c0286 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:15.560768 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d26ec31a-dc33-4ca7-ae3f-172b9a8c0286 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:15.566630 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d26ec31a-dc33-4ca7-ae3f-172b9a8c0286 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:15.567078 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d26ec31a-dc33-4ca7-ae3f-172b9a8c0286 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:15.567867 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d26ec31a-dc33-4ca7-ae3f-172b9a8c0286 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:15.568818 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d26ec31a-dc33-4ca7-ae3f-172b9a8c0286 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:15.626576 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d26ec31a-dc33-4ca7-ae3f-172b9a8c0286 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:15.634586 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d26ec31a-dc33-4ca7-ae3f-172b9a8c0286 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.078060 Oct 15 03:55:15.635135 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 913/1929] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:15 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:16.266043 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6a483b85-8e95-46fd-8ee5-c2584752445b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:16.266648 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6a483b85-8e95-46fd-8ee5-c2584752445b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:16.272385 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6a483b85-8e95-46fd-8ee5-c2584752445b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:16.272828 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6a483b85-8e95-46fd-8ee5-c2584752445b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:16.273582 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6a483b85-8e95-46fd-8ee5-c2584752445b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:16.274009 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6a483b85-8e95-46fd-8ee5-c2584752445b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:16.331372 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6a483b85-8e95-46fd-8ee5-c2584752445b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:16.339320 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6a483b85-8e95-46fd-8ee5-c2584752445b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:16.340835 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6a483b85-8e95-46fd-8ee5-c2584752445b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:16.341943 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6a483b85-8e95-46fd-8ee5-c2584752445b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.079576 Oct 15 03:55:16.342485 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1017/1930] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:16 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:16.651357 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-10be107c-3986-4c52-a5e3-1695323799e5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:16.651998 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-10be107c-3986-4c52-a5e3-1695323799e5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:16.657787 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10be107c-3986-4c52-a5e3-1695323799e5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:16.658245 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10be107c-3986-4c52-a5e3-1695323799e5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:16.659000 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10be107c-3986-4c52-a5e3-1695323799e5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:16.659429 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10be107c-3986-4c52-a5e3-1695323799e5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:16.717897 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-10be107c-3986-4c52-a5e3-1695323799e5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:16.726133 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-10be107c-3986-4c52-a5e3-1695323799e5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.078429 Oct 15 03:55:16.726684 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 914/1931] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:16 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:17.360128 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9b1c8efe-fc61-4d65-82da-88923a270f33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:17.360755 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9b1c8efe-fc61-4d65-82da-88923a270f33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:17.366535 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9b1c8efe-fc61-4d65-82da-88923a270f33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:17.366983 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9b1c8efe-fc61-4d65-82da-88923a270f33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:17.367763 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9b1c8efe-fc61-4d65-82da-88923a270f33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:17.368194 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9b1c8efe-fc61-4d65-82da-88923a270f33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:17.428445 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9b1c8efe-fc61-4d65-82da-88923a270f33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:17.436420 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9b1c8efe-fc61-4d65-82da-88923a270f33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:17.437898 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9b1c8efe-fc61-4d65-82da-88923a270f33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:17.439007 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9b1c8efe-fc61-4d65-82da-88923a270f33 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.082617 Oct 15 03:55:17.439545 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1018/1932] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:17 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:17.742087 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-51a13174-5f83-4d0b-9a2e-3fd218afdbcd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:17.742866 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-51a13174-5f83-4d0b-9a2e-3fd218afdbcd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:17.748686 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51a13174-5f83-4d0b-9a2e-3fd218afdbcd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:17.749127 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51a13174-5f83-4d0b-9a2e-3fd218afdbcd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:17.749880 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51a13174-5f83-4d0b-9a2e-3fd218afdbcd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:17.750306 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51a13174-5f83-4d0b-9a2e-3fd218afdbcd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:17.809008 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-51a13174-5f83-4d0b-9a2e-3fd218afdbcd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:17.816584 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-51a13174-5f83-4d0b-9a2e-3fd218afdbcd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.078147 Oct 15 03:55:17.817161 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 915/1933] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:17 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:18.456150 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d2aff9c3-602b-427e-bd30-78ff12f91e66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:18.456751 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d2aff9c3-602b-427e-bd30-78ff12f91e66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:18.463220 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2aff9c3-602b-427e-bd30-78ff12f91e66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:18.463671 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2aff9c3-602b-427e-bd30-78ff12f91e66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:18.464464 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2aff9c3-602b-427e-bd30-78ff12f91e66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:18.464907 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d2aff9c3-602b-427e-bd30-78ff12f91e66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:18.524343 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d2aff9c3-602b-427e-bd30-78ff12f91e66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:18.532812 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d2aff9c3-602b-427e-bd30-78ff12f91e66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:18.534287 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d2aff9c3-602b-427e-bd30-78ff12f91e66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:18.535399 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d2aff9c3-602b-427e-bd30-78ff12f91e66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.083256 Oct 15 03:55:18.536017 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1019/1934] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:18 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:18.834176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7cec03a7-812d-4794-a6a5-b3d8c15d10af tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:18.834689 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7cec03a7-812d-4794-a6a5-b3d8c15d10af tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:18.840853 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7cec03a7-812d-4794-a6a5-b3d8c15d10af tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:18.841302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7cec03a7-812d-4794-a6a5-b3d8c15d10af tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:18.842072 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7cec03a7-812d-4794-a6a5-b3d8c15d10af tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:18.842509 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7cec03a7-812d-4794-a6a5-b3d8c15d10af tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:18.900147 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7cec03a7-812d-4794-a6a5-b3d8c15d10af tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:18.907738 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7cec03a7-812d-4794-a6a5-b3d8c15d10af tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077307 Oct 15 03:55:18.908304 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 916/1935] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:18 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:19.552297 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9d06ce2c-c839-4b64-aeb9-bdfa75b561ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:19.553351 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9d06ce2c-c839-4b64-aeb9-bdfa75b561ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:19.559134 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d06ce2c-c839-4b64-aeb9-bdfa75b561ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:19.559574 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d06ce2c-c839-4b64-aeb9-bdfa75b561ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:19.560352 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d06ce2c-c839-4b64-aeb9-bdfa75b561ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:19.560779 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9d06ce2c-c839-4b64-aeb9-bdfa75b561ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:19.619041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9d06ce2c-c839-4b64-aeb9-bdfa75b561ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:19.626979 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9d06ce2c-c839-4b64-aeb9-bdfa75b561ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:19.628488 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9d06ce2c-c839-4b64-aeb9-bdfa75b561ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:19.629598 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9d06ce2c-c839-4b64-aeb9-bdfa75b561ea tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.081109 Oct 15 03:55:19.630151 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1020/1936] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:19 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:19.923331 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8ede4be9-8a6b-4b03-b119-8c99d6a1b766 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:19.923896 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8ede4be9-8a6b-4b03-b119-8c99d6a1b766 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:19.929729 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8ede4be9-8a6b-4b03-b119-8c99d6a1b766 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:19.930177 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8ede4be9-8a6b-4b03-b119-8c99d6a1b766 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:19.930938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8ede4be9-8a6b-4b03-b119-8c99d6a1b766 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:19.931375 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8ede4be9-8a6b-4b03-b119-8c99d6a1b766 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:19.989573 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8ede4be9-8a6b-4b03-b119-8c99d6a1b766 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:19.997080 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8ede4be9-8a6b-4b03-b119-8c99d6a1b766 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077470 Oct 15 03:55:19.997634 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 917/1937] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:19 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:20.647619 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0a055814-2deb-48e8-881a-44c60dad1cd9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:20.648248 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0a055814-2deb-48e8-881a-44c60dad1cd9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:20.653989 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0a055814-2deb-48e8-881a-44c60dad1cd9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:20.654437 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0a055814-2deb-48e8-881a-44c60dad1cd9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:20.655191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0a055814-2deb-48e8-881a-44c60dad1cd9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:20.655622 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0a055814-2deb-48e8-881a-44c60dad1cd9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:20.716296 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0a055814-2deb-48e8-881a-44c60dad1cd9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:20.724337 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0a055814-2deb-48e8-881a-44c60dad1cd9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:20.725824 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0a055814-2deb-48e8-881a-44c60dad1cd9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:20.726968 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0a055814-2deb-48e8-881a-44c60dad1cd9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.083501 Oct 15 03:55:20.727512 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1021/1938] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:20 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:21.014497 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e686f190-1324-4676-a3b5-a2c650c7dead tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:21.015092 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e686f190-1324-4676-a3b5-a2c650c7dead tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:21.020882 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e686f190-1324-4676-a3b5-a2c650c7dead tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:21.021949 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e686f190-1324-4676-a3b5-a2c650c7dead tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:21.022701 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e686f190-1324-4676-a3b5-a2c650c7dead tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:21.023131 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e686f190-1324-4676-a3b5-a2c650c7dead tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:21.080644 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e686f190-1324-4676-a3b5-a2c650c7dead tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:21.088297 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e686f190-1324-4676-a3b5-a2c650c7dead tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077437 Oct 15 03:55:21.088843 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 918/1939] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:21 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:21.746029 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b0bd4aad-41ff-4145-a614-a292489bd0df tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:21.746636 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b0bd4aad-41ff-4145-a614-a292489bd0df tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:21.752426 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b0bd4aad-41ff-4145-a614-a292489bd0df tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:21.752875 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b0bd4aad-41ff-4145-a614-a292489bd0df tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:21.753629 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b0bd4aad-41ff-4145-a614-a292489bd0df tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:21.754061 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b0bd4aad-41ff-4145-a614-a292489bd0df tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:21.812818 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b0bd4aad-41ff-4145-a614-a292489bd0df tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:21.820884 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b0bd4aad-41ff-4145-a614-a292489bd0df tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:21.822402 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b0bd4aad-41ff-4145-a614-a292489bd0df tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:21.823524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b0bd4aad-41ff-4145-a614-a292489bd0df tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.081196 Oct 15 03:55:21.824101 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1022/1940] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:21 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:22.105109 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-42b9acc1-b136-4a9b-b183-a88a174c30a0 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:22.105638 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-42b9acc1-b136-4a9b-b183-a88a174c30a0 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:22.111392 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-42b9acc1-b136-4a9b-b183-a88a174c30a0 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:22.111873 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-42b9acc1-b136-4a9b-b183-a88a174c30a0 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:22.112630 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-42b9acc1-b136-4a9b-b183-a88a174c30a0 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:22.113055 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-42b9acc1-b136-4a9b-b183-a88a174c30a0 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:22.169922 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-42b9acc1-b136-4a9b-b183-a88a174c30a0 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:22.177267 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-42b9acc1-b136-4a9b-b183-a88a174c30a0 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.075867 Oct 15 03:55:22.177847 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 919/1941] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:22 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:22.841570 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-83422cec-3110-439e-b9ca-bd259c919c8b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:22.842111 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-83422cec-3110-439e-b9ca-bd259c919c8b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:22.847951 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-83422cec-3110-439e-b9ca-bd259c919c8b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:22.848402 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-83422cec-3110-439e-b9ca-bd259c919c8b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:22.849165 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-83422cec-3110-439e-b9ca-bd259c919c8b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:22.849600 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-83422cec-3110-439e-b9ca-bd259c919c8b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:22.906530 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-83422cec-3110-439e-b9ca-bd259c919c8b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:22.914554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-83422cec-3110-439e-b9ca-bd259c919c8b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:22.916084 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-83422cec-3110-439e-b9ca-bd259c919c8b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:22.917215 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-83422cec-3110-439e-b9ca-bd259c919c8b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.079477 Oct 15 03:55:22.917759 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1023/1942] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:22 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:23.193607 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c6354bcf-138e-428c-b939-116132c4909c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:23.194216 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c6354bcf-138e-428c-b939-116132c4909c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:23.199934 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6354bcf-138e-428c-b939-116132c4909c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:23.200376 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6354bcf-138e-428c-b939-116132c4909c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:23.201123 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6354bcf-138e-428c-b939-116132c4909c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:23.201549 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c6354bcf-138e-428c-b939-116132c4909c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:23.259279 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c6354bcf-138e-428c-b939-116132c4909c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:23.266997 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c6354bcf-138e-428c-b939-116132c4909c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076978 Oct 15 03:55:23.267557 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 920/1943] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:23 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:23.934746 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7c073ff7-f952-447a-8453-0193f00b6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:23.935358 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7c073ff7-f952-447a-8453-0193f00b6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:23.941021 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7c073ff7-f952-447a-8453-0193f00b6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:23.941473 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7c073ff7-f952-447a-8453-0193f00b6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:23.942336 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7c073ff7-f952-447a-8453-0193f00b6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:23.942661 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7c073ff7-f952-447a-8453-0193f00b6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:24.004294 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7c073ff7-f952-447a-8453-0193f00b6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:24.012857 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7c073ff7-f952-447a-8453-0193f00b6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:24.014360 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7c073ff7-f952-447a-8453-0193f00b6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:24.015489 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7c073ff7-f952-447a-8453-0193f00b6cc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.084485 Oct 15 03:55:24.016067 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1024/1944] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:23 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:24.283433 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3c489b98-8bae-44d3-bef5-94ccb1fbdacd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:24.284064 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3c489b98-8bae-44d3-bef5-94ccb1fbdacd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:24.289858 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3c489b98-8bae-44d3-bef5-94ccb1fbdacd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:24.290298 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3c489b98-8bae-44d3-bef5-94ccb1fbdacd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:24.291056 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3c489b98-8bae-44d3-bef5-94ccb1fbdacd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:24.291482 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3c489b98-8bae-44d3-bef5-94ccb1fbdacd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:24.348966 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3c489b98-8bae-44d3-bef5-94ccb1fbdacd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:24.356625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3c489b98-8bae-44d3-bef5-94ccb1fbdacd tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076877 Oct 15 03:55:24.357172 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 921/1945] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:24 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:25.033626 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-93b30687-41b8-4834-ac37-9109ba4b241d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:25.034234 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-93b30687-41b8-4834-ac37-9109ba4b241d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:25.040460 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-93b30687-41b8-4834-ac37-9109ba4b241d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:25.040908 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-93b30687-41b8-4834-ac37-9109ba4b241d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:25.041663 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-93b30687-41b8-4834-ac37-9109ba4b241d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:25.042154 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-93b30687-41b8-4834-ac37-9109ba4b241d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:25.100135 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-93b30687-41b8-4834-ac37-9109ba4b241d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:25.108160 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-93b30687-41b8-4834-ac37-9109ba4b241d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:25.109648 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-93b30687-41b8-4834-ac37-9109ba4b241d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:25.110766 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-93b30687-41b8-4834-ac37-9109ba4b241d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080879 Oct 15 03:55:25.111307 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1025/1946] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:25 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:55:25.373501 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-be1a3b45-7ad5-4396-a8d2-c7488e045dd7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:25.374046 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-be1a3b45-7ad5-4396-a8d2-c7488e045dd7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:25.380074 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-be1a3b45-7ad5-4396-a8d2-c7488e045dd7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:25.381070 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-be1a3b45-7ad5-4396-a8d2-c7488e045dd7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:25.381867 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-be1a3b45-7ad5-4396-a8d2-c7488e045dd7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:25.382305 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-be1a3b45-7ad5-4396-a8d2-c7488e045dd7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:25.442200 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-be1a3b45-7ad5-4396-a8d2-c7488e045dd7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:25.450333 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-be1a3b45-7ad5-4396-a8d2-c7488e045dd7 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.080549 Oct 15 03:55:25.450893 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 922/1947] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:25 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:26.128206 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d1650a32-6ba2-44df-a4fa-d482ade9402a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:26.128810 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d1650a32-6ba2-44df-a4fa-d482ade9402a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:26.134542 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1650a32-6ba2-44df-a4fa-d482ade9402a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:26.134985 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1650a32-6ba2-44df-a4fa-d482ade9402a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:26.135764 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1650a32-6ba2-44df-a4fa-d482ade9402a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:26.136196 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1650a32-6ba2-44df-a4fa-d482ade9402a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:26.193226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d1650a32-6ba2-44df-a4fa-d482ade9402a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:26.201216 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d1650a32-6ba2-44df-a4fa-d482ade9402a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:26.202710 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d1650a32-6ba2-44df-a4fa-d482ade9402a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:26.204130 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d1650a32-6ba2-44df-a4fa-d482ade9402a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.079648 Oct 15 03:55:26.204658 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1026/1948] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:26 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:26.467609 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-06220408-d5ec-4591-958f-646dcaf28d60 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:26.468167 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-06220408-d5ec-4591-958f-646dcaf28d60 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:26.473835 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-06220408-d5ec-4591-958f-646dcaf28d60 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:26.474859 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-06220408-d5ec-4591-958f-646dcaf28d60 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:26.475615 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-06220408-d5ec-4591-958f-646dcaf28d60 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:26.476071 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-06220408-d5ec-4591-958f-646dcaf28d60 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:26.532685 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-06220408-d5ec-4591-958f-646dcaf28d60 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:26.540888 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-06220408-d5ec-4591-958f-646dcaf28d60 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077002 Oct 15 03:55:26.541437 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 923/1949] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:26 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:27.220984 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8606b653-1376-4578-8152-6c1647d96b98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:27.221589 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8606b653-1376-4578-8152-6c1647d96b98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:27.227141 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8606b653-1376-4578-8152-6c1647d96b98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:27.227585 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8606b653-1376-4578-8152-6c1647d96b98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:27.228367 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8606b653-1376-4578-8152-6c1647d96b98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:27.228797 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8606b653-1376-4578-8152-6c1647d96b98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:27.288304 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8606b653-1376-4578-8152-6c1647d96b98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:27.296236 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8606b653-1376-4578-8152-6c1647d96b98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:27.297703 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8606b653-1376-4578-8152-6c1647d96b98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:27.298811 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8606b653-1376-4578-8152-6c1647d96b98 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.081631 Oct 15 03:55:27.299354 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1027/1950] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:27 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:27.557196 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c547446f-0827-4d77-9f05-6e9687fed32f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:27.557809 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c547446f-0827-4d77-9f05-6e9687fed32f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:27.563541 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c547446f-0827-4d77-9f05-6e9687fed32f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:27.564021 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c547446f-0827-4d77-9f05-6e9687fed32f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:27.564779 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c547446f-0827-4d77-9f05-6e9687fed32f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:27.565209 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c547446f-0827-4d77-9f05-6e9687fed32f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:27.622582 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c547446f-0827-4d77-9f05-6e9687fed32f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:27.630052 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c547446f-0827-4d77-9f05-6e9687fed32f tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076532 Oct 15 03:55:27.631116 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 924/1951] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:27 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:28.316244 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e6d319db-a9ad-4e9c-8990-5a761ae1d496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:28.316866 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e6d319db-a9ad-4e9c-8990-5a761ae1d496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:28.322671 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e6d319db-a9ad-4e9c-8990-5a761ae1d496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:28.323112 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e6d319db-a9ad-4e9c-8990-5a761ae1d496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:28.323897 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e6d319db-a9ad-4e9c-8990-5a761ae1d496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:28.324327 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e6d319db-a9ad-4e9c-8990-5a761ae1d496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:28.381934 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e6d319db-a9ad-4e9c-8990-5a761ae1d496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:28.389869 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e6d319db-a9ad-4e9c-8990-5a761ae1d496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:28.391515 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e6d319db-a9ad-4e9c-8990-5a761ae1d496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:28.392747 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e6d319db-a9ad-4e9c-8990-5a761ae1d496 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080162 Oct 15 03:55:28.393295 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1028/1952] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:28 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:28.646670 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ada69beb-e90f-4cbd-9d33-fd0591b60036 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:28.647279 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ada69beb-e90f-4cbd-9d33-fd0591b60036 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:28.653120 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ada69beb-e90f-4cbd-9d33-fd0591b60036 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:28.653572 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ada69beb-e90f-4cbd-9d33-fd0591b60036 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:28.654327 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ada69beb-e90f-4cbd-9d33-fd0591b60036 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:28.654760 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ada69beb-e90f-4cbd-9d33-fd0591b60036 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:28.712258 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ada69beb-e90f-4cbd-9d33-fd0591b60036 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:28.719691 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ada69beb-e90f-4cbd-9d33-fd0591b60036 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076621 Oct 15 03:55:28.720258 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 925/1953] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:28 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:29.409563 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-16f5cad4-6235-47fa-b756-c2db7831715d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:29.410161 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-16f5cad4-6235-47fa-b756-c2db7831715d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:29.415921 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16f5cad4-6235-47fa-b756-c2db7831715d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:29.416361 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16f5cad4-6235-47fa-b756-c2db7831715d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:29.417108 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16f5cad4-6235-47fa-b756-c2db7831715d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:29.417542 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16f5cad4-6235-47fa-b756-c2db7831715d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:29.479480 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-16f5cad4-6235-47fa-b756-c2db7831715d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:29.487391 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-16f5cad4-6235-47fa-b756-c2db7831715d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:29.488907 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-16f5cad4-6235-47fa-b756-c2db7831715d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:29.490531 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-16f5cad4-6235-47fa-b756-c2db7831715d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.084224 Oct 15 03:55:29.491068 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1029/1954] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:29 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:29.736172 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ed86cefe-bafe-472b-ad68-c45eb91bd6a1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:29.736684 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ed86cefe-bafe-472b-ad68-c45eb91bd6a1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:29.743051 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ed86cefe-bafe-472b-ad68-c45eb91bd6a1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:29.743519 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ed86cefe-bafe-472b-ad68-c45eb91bd6a1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:29.744301 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ed86cefe-bafe-472b-ad68-c45eb91bd6a1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:29.744727 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ed86cefe-bafe-472b-ad68-c45eb91bd6a1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:29.800579 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ed86cefe-bafe-472b-ad68-c45eb91bd6a1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:29.808635 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ed86cefe-bafe-472b-ad68-c45eb91bd6a1 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076184 Oct 15 03:55:29.809183 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 926/1955] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:29 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:30.508665 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a158bd0c-e0e1-4cba-87df-44850e646627 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:30.509188 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a158bd0c-e0e1-4cba-87df-44850e646627 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:30.514968 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a158bd0c-e0e1-4cba-87df-44850e646627 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:30.515370 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a158bd0c-e0e1-4cba-87df-44850e646627 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:30.516157 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a158bd0c-e0e1-4cba-87df-44850e646627 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:30.516585 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a158bd0c-e0e1-4cba-87df-44850e646627 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:30.576768 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a158bd0c-e0e1-4cba-87df-44850e646627 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:30.585555 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a158bd0c-e0e1-4cba-87df-44850e646627 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:30.587011 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a158bd0c-e0e1-4cba-87df-44850e646627 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:30.588141 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a158bd0c-e0e1-4cba-87df-44850e646627 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.083828 Oct 15 03:55:30.588689 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1030/1956] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:30 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:30.824963 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f0ce395d-029f-42b0-9470-e3e47cb1b256 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:30.825504 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f0ce395d-029f-42b0-9470-e3e47cb1b256 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:30.831487 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f0ce395d-029f-42b0-9470-e3e47cb1b256 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:30.831971 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f0ce395d-029f-42b0-9470-e3e47cb1b256 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:30.832729 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f0ce395d-029f-42b0-9470-e3e47cb1b256 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:30.833160 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f0ce395d-029f-42b0-9470-e3e47cb1b256 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:30.891647 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f0ce395d-029f-42b0-9470-e3e47cb1b256 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:30.899247 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f0ce395d-029f-42b0-9470-e3e47cb1b256 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.078015 Oct 15 03:55:30.899830 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 927/1957] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:30 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:31.606181 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-53f42c61-0a37-4548-942b-f35b02ab1dc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:31.606710 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-53f42c61-0a37-4548-942b-f35b02ab1dc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:31.612472 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53f42c61-0a37-4548-942b-f35b02ab1dc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:31.612914 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53f42c61-0a37-4548-942b-f35b02ab1dc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:31.613701 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53f42c61-0a37-4548-942b-f35b02ab1dc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:31.614130 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53f42c61-0a37-4548-942b-f35b02ab1dc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:31.671831 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-53f42c61-0a37-4548-942b-f35b02ab1dc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:31.679898 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-53f42c61-0a37-4548-942b-f35b02ab1dc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:31.681390 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-53f42c61-0a37-4548-942b-f35b02ab1dc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:31.682516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-53f42c61-0a37-4548-942b-f35b02ab1dc4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080079 Oct 15 03:55:31.683057 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1031/1958] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:31 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:31.916517 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-62080904-4977-4be4-b11e-978b07513215 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:31.917133 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-62080904-4977-4be4-b11e-978b07513215 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:31.922849 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-62080904-4977-4be4-b11e-978b07513215 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:31.923309 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-62080904-4977-4be4-b11e-978b07513215 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:31.924304 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-62080904-4977-4be4-b11e-978b07513215 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:31.924744 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-62080904-4977-4be4-b11e-978b07513215 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:31.982725 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-62080904-4977-4be4-b11e-978b07513215 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:31.990312 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-62080904-4977-4be4-b11e-978b07513215 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077426 Oct 15 03:55:31.990879 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 928/1959] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:31 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:32.700134 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-126a52cc-7d78-4193-976f-827962f5e6fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:32.700731 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-126a52cc-7d78-4193-976f-827962f5e6fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:32.706699 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-126a52cc-7d78-4193-976f-827962f5e6fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:32.707142 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-126a52cc-7d78-4193-976f-827962f5e6fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:32.708036 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-126a52cc-7d78-4193-976f-827962f5e6fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:32.708468 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-126a52cc-7d78-4193-976f-827962f5e6fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:32.765414 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-126a52cc-7d78-4193-976f-827962f5e6fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:32.773257 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-126a52cc-7d78-4193-976f-827962f5e6fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:32.774724 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-126a52cc-7d78-4193-976f-827962f5e6fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:32.775877 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-126a52cc-7d78-4193-976f-827962f5e6fd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.079380 Oct 15 03:55:32.776413 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1032/1960] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:32 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:33.006610 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-cd66924e-209a-416d-9596-8e9258b710ed tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:33.007220 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-cd66924e-209a-416d-9596-8e9258b710ed tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:33.013063 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cd66924e-209a-416d-9596-8e9258b710ed tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:33.013513 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cd66924e-209a-416d-9596-8e9258b710ed tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:33.014282 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cd66924e-209a-416d-9596-8e9258b710ed tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:33.014742 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cd66924e-209a-416d-9596-8e9258b710ed tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:33.072726 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-cd66924e-209a-416d-9596-8e9258b710ed tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:33.080506 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-cd66924e-209a-416d-9596-8e9258b710ed tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077639 Oct 15 03:55:33.081056 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 929/1961] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:33 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:33.793434 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9cd88cef-f8d8-4dfb-9156-9086d96a8463 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:33.794039 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9cd88cef-f8d8-4dfb-9156-9086d96a8463 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:33.799963 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9cd88cef-f8d8-4dfb-9156-9086d96a8463 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:33.800408 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9cd88cef-f8d8-4dfb-9156-9086d96a8463 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:33.801151 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9cd88cef-f8d8-4dfb-9156-9086d96a8463 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:33.801579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9cd88cef-f8d8-4dfb-9156-9086d96a8463 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:33.861486 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9cd88cef-f8d8-4dfb-9156-9086d96a8463 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:33.869424 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9cd88cef-f8d8-4dfb-9156-9086d96a8463 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:33.870895 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9cd88cef-f8d8-4dfb-9156-9086d96a8463 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:33.872036 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9cd88cef-f8d8-4dfb-9156-9086d96a8463 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.082253 Oct 15 03:55:33.872580 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1033/1962] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:33 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:34.097427 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-51b8ce87-7e11-489c-b79f-d019498dea4d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:34.097961 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-51b8ce87-7e11-489c-b79f-d019498dea4d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:34.104290 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51b8ce87-7e11-489c-b79f-d019498dea4d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:34.104732 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51b8ce87-7e11-489c-b79f-d019498dea4d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:34.105480 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51b8ce87-7e11-489c-b79f-d019498dea4d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:34.105907 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51b8ce87-7e11-489c-b79f-d019498dea4d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:34.162941 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-51b8ce87-7e11-489c-b79f-d019498dea4d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:34.170594 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-51b8ce87-7e11-489c-b79f-d019498dea4d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076847 Oct 15 03:55:34.171143 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 930/1963] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:34 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:34.888672 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f5ca290a-b984-42dc-a469-cad05db99eb5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:34.889275 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f5ca290a-b984-42dc-a469-cad05db99eb5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:34.894995 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f5ca290a-b984-42dc-a469-cad05db99eb5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:34.895441 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f5ca290a-b984-42dc-a469-cad05db99eb5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:34.896372 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f5ca290a-b984-42dc-a469-cad05db99eb5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:34.896805 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f5ca290a-b984-42dc-a469-cad05db99eb5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:34.956001 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f5ca290a-b984-42dc-a469-cad05db99eb5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:34.964094 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f5ca290a-b984-42dc-a469-cad05db99eb5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:34.965577 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f5ca290a-b984-42dc-a469-cad05db99eb5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:34.966690 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f5ca290a-b984-42dc-a469-cad05db99eb5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.081764 Oct 15 03:55:34.967235 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1034/1964] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:34 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:35.186760 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1a676c19-4b77-43d1-8a6f-6671c2c6b497 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:35.187302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1a676c19-4b77-43d1-8a6f-6671c2c6b497 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:35.192887 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1a676c19-4b77-43d1-8a6f-6671c2c6b497 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:35.193324 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1a676c19-4b77-43d1-8a6f-6671c2c6b497 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:35.194066 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1a676c19-4b77-43d1-8a6f-6671c2c6b497 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:35.194489 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1a676c19-4b77-43d1-8a6f-6671c2c6b497 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:35.252363 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-1a676c19-4b77-43d1-8a6f-6671c2c6b497 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:35.259934 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1a676c19-4b77-43d1-8a6f-6671c2c6b497 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076852 Oct 15 03:55:35.260484 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 931/1965] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:35 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:35.984387 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-41b67ebb-fcce-435c-b3d8-6ab04f84b873 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:35.984997 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-41b67ebb-fcce-435c-b3d8-6ab04f84b873 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:35.990734 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-41b67ebb-fcce-435c-b3d8-6ab04f84b873 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:35.991191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-41b67ebb-fcce-435c-b3d8-6ab04f84b873 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:35.991987 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-41b67ebb-fcce-435c-b3d8-6ab04f84b873 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:35.992434 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-41b67ebb-fcce-435c-b3d8-6ab04f84b873 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:36.050814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-41b67ebb-fcce-435c-b3d8-6ab04f84b873 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:36.059472 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-41b67ebb-fcce-435c-b3d8-6ab04f84b873 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:36.061001 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-41b67ebb-fcce-435c-b3d8-6ab04f84b873 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:36.062131 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-41b67ebb-fcce-435c-b3d8-6ab04f84b873 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.081463 Oct 15 03:55:36.062671 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1035/1966] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:35 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:36.278384 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e4f5e5fe-8bc5-40e7-9a7c-dce53794f100 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:36.279474 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e4f5e5fe-8bc5-40e7-9a7c-dce53794f100 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:36.285353 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4f5e5fe-8bc5-40e7-9a7c-dce53794f100 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:36.285829 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4f5e5fe-8bc5-40e7-9a7c-dce53794f100 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:36.286586 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4f5e5fe-8bc5-40e7-9a7c-dce53794f100 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:36.287015 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e4f5e5fe-8bc5-40e7-9a7c-dce53794f100 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:36.344223 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e4f5e5fe-8bc5-40e7-9a7c-dce53794f100 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:36.351591 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e4f5e5fe-8bc5-40e7-9a7c-dce53794f100 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.078715 Oct 15 03:55:36.352176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 932/1967] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:36 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:37.080475 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0510c5dd-0b59-411d-8221-40c4faca554d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:37.081108 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0510c5dd-0b59-411d-8221-40c4faca554d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:37.087357 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0510c5dd-0b59-411d-8221-40c4faca554d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:37.087851 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0510c5dd-0b59-411d-8221-40c4faca554d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:37.088609 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0510c5dd-0b59-411d-8221-40c4faca554d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:37.089042 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0510c5dd-0b59-411d-8221-40c4faca554d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:37.148202 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0510c5dd-0b59-411d-8221-40c4faca554d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:37.156167 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0510c5dd-0b59-411d-8221-40c4faca554d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:37.157652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0510c5dd-0b59-411d-8221-40c4faca554d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:37.158772 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0510c5dd-0b59-411d-8221-40c4faca554d tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.082232 Oct 15 03:55:37.159313 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1036/1968] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:37 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:37.368059 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0a32b3af-3322-466f-a11a-eb33a57f350d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:37.368590 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0a32b3af-3322-466f-a11a-eb33a57f350d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:37.374306 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0a32b3af-3322-466f-a11a-eb33a57f350d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:37.374751 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0a32b3af-3322-466f-a11a-eb33a57f350d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:37.375509 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0a32b3af-3322-466f-a11a-eb33a57f350d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:37.375958 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0a32b3af-3322-466f-a11a-eb33a57f350d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:37.437435 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0a32b3af-3322-466f-a11a-eb33a57f350d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:37.445471 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0a32b3af-3322-466f-a11a-eb33a57f350d tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.081130 Oct 15 03:55:37.446019 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 933/1969] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:37 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:38.177594 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-48a54b58-cc1e-4677-a4df-9661a8b3fecb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:38.178211 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-48a54b58-cc1e-4677-a4df-9661a8b3fecb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:38.184138 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-48a54b58-cc1e-4677-a4df-9661a8b3fecb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:38.184580 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-48a54b58-cc1e-4677-a4df-9661a8b3fecb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:38.185329 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-48a54b58-cc1e-4677-a4df-9661a8b3fecb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:38.185754 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-48a54b58-cc1e-4677-a4df-9661a8b3fecb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:38.243637 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-48a54b58-cc1e-4677-a4df-9661a8b3fecb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:38.251725 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-48a54b58-cc1e-4677-a4df-9661a8b3fecb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:38.253204 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-48a54b58-cc1e-4677-a4df-9661a8b3fecb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:38.254314 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-48a54b58-cc1e-4677-a4df-9661a8b3fecb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.081017 Oct 15 03:55:38.254849 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1037/1970] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:38 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:38.462608 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0b70b43e-bf6a-4d9f-b68e-95a78e819768 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:38.463133 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0b70b43e-bf6a-4d9f-b68e-95a78e819768 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:38.468836 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0b70b43e-bf6a-4d9f-b68e-95a78e819768 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:38.469277 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0b70b43e-bf6a-4d9f-b68e-95a78e819768 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:38.470039 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0b70b43e-bf6a-4d9f-b68e-95a78e819768 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:38.470462 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0b70b43e-bf6a-4d9f-b68e-95a78e819768 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:38.527822 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0b70b43e-bf6a-4d9f-b68e-95a78e819768 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:38.535378 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0b70b43e-bf6a-4d9f-b68e-95a78e819768 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076988 Oct 15 03:55:38.535972 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 934/1971] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:38 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:39.271878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-480b30f9-39da-4bf6-af0e-05cf31926bfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:39.272496 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-480b30f9-39da-4bf6-af0e-05cf31926bfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:39.278285 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-480b30f9-39da-4bf6-af0e-05cf31926bfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:39.278736 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-480b30f9-39da-4bf6-af0e-05cf31926bfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:39.279489 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-480b30f9-39da-4bf6-af0e-05cf31926bfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:39.279951 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-480b30f9-39da-4bf6-af0e-05cf31926bfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:39.337452 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-480b30f9-39da-4bf6-af0e-05cf31926bfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:39.345401 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-480b30f9-39da-4bf6-af0e-05cf31926bfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:39.346884 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-480b30f9-39da-4bf6-af0e-05cf31926bfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:39.348033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-480b30f9-39da-4bf6-af0e-05cf31926bfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080034 Oct 15 03:55:39.348581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1038/1972] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:39 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:39.553651 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b747c03a-3d79-41c0-80c3-44e5f5432cd5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:39.554158 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b747c03a-3d79-41c0-80c3-44e5f5432cd5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:39.559871 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b747c03a-3d79-41c0-80c3-44e5f5432cd5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:39.560319 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b747c03a-3d79-41c0-80c3-44e5f5432cd5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:39.561069 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b747c03a-3d79-41c0-80c3-44e5f5432cd5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:39.561498 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b747c03a-3d79-41c0-80c3-44e5f5432cd5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:39.618897 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b747c03a-3d79-41c0-80c3-44e5f5432cd5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:39.626493 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b747c03a-3d79-41c0-80c3-44e5f5432cd5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077197 Oct 15 03:55:39.627053 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 935/1973] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:39 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:40.365545 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8f5fd6c3-80e4-44be-91f2-798af710060a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:40.366149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-8f5fd6c3-80e4-44be-91f2-798af710060a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:40.371934 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8f5fd6c3-80e4-44be-91f2-798af710060a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:40.372380 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8f5fd6c3-80e4-44be-91f2-798af710060a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:40.373133 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8f5fd6c3-80e4-44be-91f2-798af710060a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:40.373568 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-8f5fd6c3-80e4-44be-91f2-798af710060a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:40.432434 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8f5fd6c3-80e4-44be-91f2-798af710060a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:40.440421 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8f5fd6c3-80e4-44be-91f2-798af710060a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:40.441911 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-8f5fd6c3-80e4-44be-91f2-798af710060a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:40.443595 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8f5fd6c3-80e4-44be-91f2-798af710060a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.081784 Oct 15 03:55:40.444176 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1039/1974] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:40 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:40.642875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d5d19ec2-bb1c-4a57-ae07-79f10aa3514b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:40.643470 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d5d19ec2-bb1c-4a57-ae07-79f10aa3514b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:40.649328 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d5d19ec2-bb1c-4a57-ae07-79f10aa3514b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:40.649775 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d5d19ec2-bb1c-4a57-ae07-79f10aa3514b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:40.650522 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d5d19ec2-bb1c-4a57-ae07-79f10aa3514b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:40.650951 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d5d19ec2-bb1c-4a57-ae07-79f10aa3514b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:40.937815 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d5d19ec2-bb1c-4a57-ae07-79f10aa3514b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:40.946154 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d5d19ec2-bb1c-4a57-ae07-79f10aa3514b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.306925 Oct 15 03:55:40.946704 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 936/1975] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:40 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:41.462548 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5a16a45b-897b-4453-863e-14909f2035dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:41.463155 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5a16a45b-897b-4453-863e-14909f2035dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:41.468999 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a16a45b-897b-4453-863e-14909f2035dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:41.469445 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a16a45b-897b-4453-863e-14909f2035dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:41.470198 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a16a45b-897b-4453-863e-14909f2035dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:41.470629 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5a16a45b-897b-4453-863e-14909f2035dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:41.528653 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5a16a45b-897b-4453-863e-14909f2035dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:41.537503 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5a16a45b-897b-4453-863e-14909f2035dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:41.538993 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5a16a45b-897b-4453-863e-14909f2035dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:41.540155 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5a16a45b-897b-4453-863e-14909f2035dc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.081908 Oct 15 03:55:41.540704 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1040/1976] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:41 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:41.962699 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6cfe3ae1-f937-4aec-9cb2-724c3f1a664b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:41.963218 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6cfe3ae1-f937-4aec-9cb2-724c3f1a664b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:41.968913 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6cfe3ae1-f937-4aec-9cb2-724c3f1a664b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:41.969359 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6cfe3ae1-f937-4aec-9cb2-724c3f1a664b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:41.970108 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6cfe3ae1-f937-4aec-9cb2-724c3f1a664b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:41.970535 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6cfe3ae1-f937-4aec-9cb2-724c3f1a664b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:42.026686 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6cfe3ae1-f937-4aec-9cb2-724c3f1a664b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:42.034008 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6cfe3ae1-f937-4aec-9cb2-724c3f1a664b tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.075672 Oct 15 03:55:42.034556 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 937/1977] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:41 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:42.558105 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-856d7499-037d-4979-a2b9-3400dda90226 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:42.558715 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-856d7499-037d-4979-a2b9-3400dda90226 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:42.564460 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-856d7499-037d-4979-a2b9-3400dda90226 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:42.564907 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-856d7499-037d-4979-a2b9-3400dda90226 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:42.565659 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-856d7499-037d-4979-a2b9-3400dda90226 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:42.566093 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-856d7499-037d-4979-a2b9-3400dda90226 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:42.623212 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-856d7499-037d-4979-a2b9-3400dda90226 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:42.631201 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-856d7499-037d-4979-a2b9-3400dda90226 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:42.632770 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-856d7499-037d-4979-a2b9-3400dda90226 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:42.633897 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-856d7499-037d-4979-a2b9-3400dda90226 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.079478 Oct 15 03:55:42.634441 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1041/1978] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:42 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:43.050406 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f4e4560b-18aa-4f6f-9954-74541bbe9886 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:43.051034 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f4e4560b-18aa-4f6f-9954-74541bbe9886 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:43.056901 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f4e4560b-18aa-4f6f-9954-74541bbe9886 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:43.057344 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f4e4560b-18aa-4f6f-9954-74541bbe9886 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:43.058094 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f4e4560b-18aa-4f6f-9954-74541bbe9886 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:43.058518 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f4e4560b-18aa-4f6f-9954-74541bbe9886 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:43.117659 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f4e4560b-18aa-4f6f-9954-74541bbe9886 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:43.125164 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f4e4560b-18aa-4f6f-9954-74541bbe9886 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.078383 Oct 15 03:55:43.125730 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 938/1979] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:43 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:43.652491 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-99da0a85-7a0e-4b18-9429-bc68787135f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:43.653098 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-99da0a85-7a0e-4b18-9429-bc68787135f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:43.658844 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-99da0a85-7a0e-4b18-9429-bc68787135f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:43.659293 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-99da0a85-7a0e-4b18-9429-bc68787135f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:43.660080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-99da0a85-7a0e-4b18-9429-bc68787135f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:43.660515 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-99da0a85-7a0e-4b18-9429-bc68787135f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:43.719443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-99da0a85-7a0e-4b18-9429-bc68787135f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:43.727585 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-99da0a85-7a0e-4b18-9429-bc68787135f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:43.729098 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-99da0a85-7a0e-4b18-9429-bc68787135f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:43.730211 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-99da0a85-7a0e-4b18-9429-bc68787135f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.081446 Oct 15 03:55:43.730761 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1042/1980] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:43 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:44.141442 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-08384c5e-5ad1-4b1b-a99e-9814a04c27d5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:44.142054 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-08384c5e-5ad1-4b1b-a99e-9814a04c27d5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:44.147810 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08384c5e-5ad1-4b1b-a99e-9814a04c27d5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:44.148265 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08384c5e-5ad1-4b1b-a99e-9814a04c27d5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:44.149023 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08384c5e-5ad1-4b1b-a99e-9814a04c27d5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:44.149454 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08384c5e-5ad1-4b1b-a99e-9814a04c27d5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:44.206610 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-08384c5e-5ad1-4b1b-a99e-9814a04c27d5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:44.214081 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-08384c5e-5ad1-4b1b-a99e-9814a04c27d5 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076365 Oct 15 03:55:44.214666 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 939/1981] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:44 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:44.748196 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-53efdc64-118c-42d7-aabf-a0eb9133ea09 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:44.748803 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-53efdc64-118c-42d7-aabf-a0eb9133ea09 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:44.754584 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53efdc64-118c-42d7-aabf-a0eb9133ea09 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:44.755545 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53efdc64-118c-42d7-aabf-a0eb9133ea09 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:44.756328 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53efdc64-118c-42d7-aabf-a0eb9133ea09 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:44.756762 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-53efdc64-118c-42d7-aabf-a0eb9133ea09 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:44.814238 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-53efdc64-118c-42d7-aabf-a0eb9133ea09 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:44.823327 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-53efdc64-118c-42d7-aabf-a0eb9133ea09 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:44.824861 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-53efdc64-118c-42d7-aabf-a0eb9133ea09 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:44.825981 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-53efdc64-118c-42d7-aabf-a0eb9133ea09 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.081448 Oct 15 03:55:44.826524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1043/1982] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:44 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:45.230040 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-86c92a71-80dc-41e5-a2b7-4dadcd668d0c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:45.230594 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-86c92a71-80dc-41e5-a2b7-4dadcd668d0c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:45.236439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-86c92a71-80dc-41e5-a2b7-4dadcd668d0c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:45.236917 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-86c92a71-80dc-41e5-a2b7-4dadcd668d0c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:45.237692 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-86c92a71-80dc-41e5-a2b7-4dadcd668d0c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:45.238128 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-86c92a71-80dc-41e5-a2b7-4dadcd668d0c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:45.295906 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-86c92a71-80dc-41e5-a2b7-4dadcd668d0c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:45.303905 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-86c92a71-80dc-41e5-a2b7-4dadcd668d0c tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.077743 Oct 15 03:55:45.304462 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 940/1983] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:45 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:45.844397 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2bf5ea92-8d35-4e4a-a72a-b587b623fea3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:45.845013 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2bf5ea92-8d35-4e4a-a72a-b587b623fea3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:45.850786 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2bf5ea92-8d35-4e4a-a72a-b587b623fea3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:45.851230 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2bf5ea92-8d35-4e4a-a72a-b587b623fea3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:45.852011 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2bf5ea92-8d35-4e4a-a72a-b587b623fea3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:45.852446 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2bf5ea92-8d35-4e4a-a72a-b587b623fea3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:45.915424 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2bf5ea92-8d35-4e4a-a72a-b587b623fea3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:45.925025 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2bf5ea92-8d35-4e4a-a72a-b587b623fea3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:45.926562 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2bf5ea92-8d35-4e4a-a72a-b587b623fea3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:45.928251 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2bf5ea92-8d35-4e4a-a72a-b587b623fea3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.087545 Oct 15 03:55:45.928801 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1044/1984] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:45 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:46.320230 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3809572d-d159-4cde-b7f7-45593b7ad05a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:46.320834 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3809572d-d159-4cde-b7f7-45593b7ad05a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:46.326563 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3809572d-d159-4cde-b7f7-45593b7ad05a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:46.327003 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3809572d-d159-4cde-b7f7-45593b7ad05a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:46.328041 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3809572d-d159-4cde-b7f7-45593b7ad05a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:46.328475 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3809572d-d159-4cde-b7f7-45593b7ad05a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:46.388939 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3809572d-d159-4cde-b7f7-45593b7ad05a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:46.396360 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3809572d-d159-4cde-b7f7-45593b7ad05a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.079721 Oct 15 03:55:46.396909 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 941/1985] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:46 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:46.945531 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d7bfdd96-fffe-4bce-920a-c9216c667570 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:46.946073 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d7bfdd96-fffe-4bce-920a-c9216c667570 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:46.951926 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7bfdd96-fffe-4bce-920a-c9216c667570 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:46.952379 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7bfdd96-fffe-4bce-920a-c9216c667570 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:46.953415 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7bfdd96-fffe-4bce-920a-c9216c667570 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:46.953843 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7bfdd96-fffe-4bce-920a-c9216c667570 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:47.010853 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d7bfdd96-fffe-4bce-920a-c9216c667570 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:47.018738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d7bfdd96-fffe-4bce-920a-c9216c667570 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:47.020266 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d7bfdd96-fffe-4bce-920a-c9216c667570 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:47.022033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d7bfdd96-fffe-4bce-920a-c9216c667570 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080872 Oct 15 03:55:47.022573 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1045/1986] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:46 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:47.413121 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f4517c8e-7fe4-43f0-865c-d3df649df36a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:47.413720 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f4517c8e-7fe4-43f0-865c-d3df649df36a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:47.419387 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f4517c8e-7fe4-43f0-865c-d3df649df36a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:47.419869 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f4517c8e-7fe4-43f0-865c-d3df649df36a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:47.420622 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f4517c8e-7fe4-43f0-865c-d3df649df36a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:47.421046 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f4517c8e-7fe4-43f0-865c-d3df649df36a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:47.477820 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f4517c8e-7fe4-43f0-865c-d3df649df36a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:47.485416 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f4517c8e-7fe4-43f0-865c-d3df649df36a tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076515 Oct 15 03:55:47.485959 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 942/1987] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:47 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:48.039435 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-75523649-4b94-41db-b80a-9ccf7a1ebede tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:48.040064 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-75523649-4b94-41db-b80a-9ccf7a1ebede tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:48.045828 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-75523649-4b94-41db-b80a-9ccf7a1ebede tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:48.046276 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-75523649-4b94-41db-b80a-9ccf7a1ebede tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:48.047032 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-75523649-4b94-41db-b80a-9ccf7a1ebede tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:48.047462 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-75523649-4b94-41db-b80a-9ccf7a1ebede tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:48.104618 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-75523649-4b94-41db-b80a-9ccf7a1ebede tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:48.112546 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-75523649-4b94-41db-b80a-9ccf7a1ebede tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:48.114030 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-75523649-4b94-41db-b80a-9ccf7a1ebede tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:48.115643 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-75523649-4b94-41db-b80a-9ccf7a1ebede tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.079903 Oct 15 03:55:48.116220 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1046/1988] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:48 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:48.501284 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-14b70276-ec20-4ad9-aed1-c5e54cbb1efb tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:48.501899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-14b70276-ec20-4ad9-aed1-c5e54cbb1efb tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:48.508278 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-14b70276-ec20-4ad9-aed1-c5e54cbb1efb tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:48.508720 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-14b70276-ec20-4ad9-aed1-c5e54cbb1efb tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:48.509465 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-14b70276-ec20-4ad9-aed1-c5e54cbb1efb tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:48.509887 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-14b70276-ec20-4ad9-aed1-c5e54cbb1efb tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:48.566253 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-14b70276-ec20-4ad9-aed1-c5e54cbb1efb tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a90e3068213436498812ad167bcb19f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6065f66d6938444d868fb5b3225ce1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:48.574164 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-14b70276-ec20-4ad9-aed1-c5e54cbb1efb tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 200 len: 1350 microversion: 2.1 time: 0.076516 Oct 15 03:55:48.574705 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 943/1989] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:48 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:55:49.134339 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3524fb9e-33c4-45f1-b51e-2c672fb9bb27 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:49.135811 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3524fb9e-33c4-45f1-b51e-2c672fb9bb27 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:49.142120 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3524fb9e-33c4-45f1-b51e-2c672fb9bb27 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:49.142700 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3524fb9e-33c4-45f1-b51e-2c672fb9bb27 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:49.143696 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3524fb9e-33c4-45f1-b51e-2c672fb9bb27 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:49.144157 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3524fb9e-33c4-45f1-b51e-2c672fb9bb27 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:49.204567 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3524fb9e-33c4-45f1-b51e-2c672fb9bb27 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:49.212782 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3524fb9e-33c4-45f1-b51e-2c672fb9bb27 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:49.214303 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3524fb9e-33c4-45f1-b51e-2c672fb9bb27 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:49.215433 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3524fb9e-33c4-45f1-b51e-2c672fb9bb27 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.085403 Oct 15 03:55:49.216019 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1047/1990] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:49 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:55:49.590572 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3dbf5cbb-e284-4c52-91f7-b3d045a46cc9 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:49.591310 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3dbf5cbb-e284-4c52-91f7-b3d045a46cc9 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] [instance: 828d646d-36c6-41b2-9e74-56a8ac3c1a73] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:49.597089 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3dbf5cbb-e284-4c52-91f7-b3d045a46cc9 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:49.597534 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3dbf5cbb-e284-4c52-91f7-b3d045a46cc9 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:49.598287 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3dbf5cbb-e284-4c52-91f7-b3d045a46cc9 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:49.599382 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3dbf5cbb-e284-4c52-91f7-b3d045a46cc9 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:49.615193 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-3dbf5cbb-e284-4c52-91f7-b3d045a46cc9 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] HTTP exception thrown: Instance 828d646d-36c6-41b2-9e74-56a8ac3c1a73 could not be found. Oct 15 03:55:49.616095 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3dbf5cbb-e284-4c52-91f7-b3d045a46cc9 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] Returning 404 to user: Instance 828d646d-36c6-41b2-9e74-56a8ac3c1a73 could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:55:49.617023 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3dbf5cbb-e284-4c52-91f7-b3d045a46cc9 tempest-VolumesSnapshotTestJSON-62384871 tempest-VolumesSnapshotTestJSON-62384871-project] 10.222.0.30 "GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73" status: 404 len: 111 microversion: 2.1 time: 0.030082 Oct 15 03:55:49.617566 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 944/1991] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 03:55:49 2021] GET /compute/v2.1/servers/828d646d-36c6-41b2-9e74-56a8ac3c1a73 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 03:55:50.233940 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9ec07de6-504f-4b89-9c2a-69a903f20492 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:50.234476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9ec07de6-504f-4b89-9c2a-69a903f20492 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:50.241517 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9ec07de6-504f-4b89-9c2a-69a903f20492 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:50.241959 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9ec07de6-504f-4b89-9c2a-69a903f20492 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:50.242718 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9ec07de6-504f-4b89-9c2a-69a903f20492 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:50.243143 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9ec07de6-504f-4b89-9c2a-69a903f20492 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:50.303986 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9ec07de6-504f-4b89-9c2a-69a903f20492 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:50.311972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9ec07de6-504f-4b89-9c2a-69a903f20492 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:50.313443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9ec07de6-504f-4b89-9c2a-69a903f20492 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:50.314543 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9ec07de6-504f-4b89-9c2a-69a903f20492 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.084563 Oct 15 03:55:50.315083 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1048/1992] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:50 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:51.335169 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-02d3db36-8a8b-4796-8b49-4edad0635f66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:51.335802 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-02d3db36-8a8b-4796-8b49-4edad0635f66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:51.341607 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-02d3db36-8a8b-4796-8b49-4edad0635f66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:51.342065 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-02d3db36-8a8b-4796-8b49-4edad0635f66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:51.342820 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-02d3db36-8a8b-4796-8b49-4edad0635f66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:51.343252 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-02d3db36-8a8b-4796-8b49-4edad0635f66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:51.400900 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-02d3db36-8a8b-4796-8b49-4edad0635f66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:51.409073 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-02d3db36-8a8b-4796-8b49-4edad0635f66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:51.410601 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-02d3db36-8a8b-4796-8b49-4edad0635f66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:51.411771 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-02d3db36-8a8b-4796-8b49-4edad0635f66 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080441 Oct 15 03:55:51.412346 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 945/1993] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:51 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:52.429253 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d643fbe3-d3b7-4e47-8ffd-e9f5e5bf78b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:52.429890 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d643fbe3-d3b7-4e47-8ffd-e9f5e5bf78b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:52.436120 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d643fbe3-d3b7-4e47-8ffd-e9f5e5bf78b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:52.436551 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d643fbe3-d3b7-4e47-8ffd-e9f5e5bf78b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:52.437303 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d643fbe3-d3b7-4e47-8ffd-e9f5e5bf78b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:52.437732 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d643fbe3-d3b7-4e47-8ffd-e9f5e5bf78b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:52.496903 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d643fbe3-d3b7-4e47-8ffd-e9f5e5bf78b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:52.505391 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d643fbe3-d3b7-4e47-8ffd-e9f5e5bf78b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:52.506874 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d643fbe3-d3b7-4e47-8ffd-e9f5e5bf78b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:52.508014 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d643fbe3-d3b7-4e47-8ffd-e9f5e5bf78b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.082417 Oct 15 03:55:52.508556 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1049/1994] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:52 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:53.526145 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3dd4aa11-cf42-4791-bd39-d8b9dbda2c9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:53.526768 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3dd4aa11-cf42-4791-bd39-d8b9dbda2c9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:53.532488 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3dd4aa11-cf42-4791-bd39-d8b9dbda2c9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:53.532943 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3dd4aa11-cf42-4791-bd39-d8b9dbda2c9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:53.533698 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3dd4aa11-cf42-4791-bd39-d8b9dbda2c9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:53.534128 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3dd4aa11-cf42-4791-bd39-d8b9dbda2c9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:53.591799 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3dd4aa11-cf42-4791-bd39-d8b9dbda2c9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:53.600419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3dd4aa11-cf42-4791-bd39-d8b9dbda2c9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:53.601906 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3dd4aa11-cf42-4791-bd39-d8b9dbda2c9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:53.603022 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3dd4aa11-cf42-4791-bd39-d8b9dbda2c9f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080710 Oct 15 03:55:53.603563 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 946/1995] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:53 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:54.620300 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5654cf02-e33f-45ea-a819-414121cf5e9a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:54.620944 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5654cf02-e33f-45ea-a819-414121cf5e9a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:54.626668 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5654cf02-e33f-45ea-a819-414121cf5e9a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:54.627120 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5654cf02-e33f-45ea-a819-414121cf5e9a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:54.627911 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5654cf02-e33f-45ea-a819-414121cf5e9a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:54.628353 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5654cf02-e33f-45ea-a819-414121cf5e9a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:54.686493 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5654cf02-e33f-45ea-a819-414121cf5e9a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:54.695050 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5654cf02-e33f-45ea-a819-414121cf5e9a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:54.696650 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5654cf02-e33f-45ea-a819-414121cf5e9a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:54.697768 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5654cf02-e33f-45ea-a819-414121cf5e9a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.081146 Oct 15 03:55:54.698309 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1050/1996] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:54 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:55.716126 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d0b87dcf-202c-45b3-865e-7a3811a098fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:55.716730 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d0b87dcf-202c-45b3-865e-7a3811a098fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:55.722390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d0b87dcf-202c-45b3-865e-7a3811a098fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:55.722857 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d0b87dcf-202c-45b3-865e-7a3811a098fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:55.724209 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d0b87dcf-202c-45b3-865e-7a3811a098fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:55.724641 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d0b87dcf-202c-45b3-865e-7a3811a098fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:55.780853 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d0b87dcf-202c-45b3-865e-7a3811a098fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:55.789604 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d0b87dcf-202c-45b3-865e-7a3811a098fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:55.791076 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d0b87dcf-202c-45b3-865e-7a3811a098fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:55.792256 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d0b87dcf-202c-45b3-865e-7a3811a098fe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.079926 Oct 15 03:55:55.792792 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 947/1997] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:55 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:56.809756 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-959564b6-baaa-44cb-bad0-89990701ee88 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:56.810273 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-959564b6-baaa-44cb-bad0-89990701ee88 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:56.816092 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-959564b6-baaa-44cb-bad0-89990701ee88 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:56.816541 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-959564b6-baaa-44cb-bad0-89990701ee88 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:56.817293 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-959564b6-baaa-44cb-bad0-89990701ee88 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:56.817725 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-959564b6-baaa-44cb-bad0-89990701ee88 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:56.878001 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-959564b6-baaa-44cb-bad0-89990701ee88 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:56.886206 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-959564b6-baaa-44cb-bad0-89990701ee88 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:56.887721 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-959564b6-baaa-44cb-bad0-89990701ee88 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:56.888842 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-959564b6-baaa-44cb-bad0-89990701ee88 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.082866 Oct 15 03:55:56.889377 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1051/1998] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:56 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:57.905878 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-645d1cd2-7ec2-475e-b2fd-437e2816e0b2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:57.906476 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-645d1cd2-7ec2-475e-b2fd-437e2816e0b2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:57.912833 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-645d1cd2-7ec2-475e-b2fd-437e2816e0b2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:57.913277 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-645d1cd2-7ec2-475e-b2fd-437e2816e0b2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:57.914026 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-645d1cd2-7ec2-475e-b2fd-437e2816e0b2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:57.914451 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-645d1cd2-7ec2-475e-b2fd-437e2816e0b2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:57.976849 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-645d1cd2-7ec2-475e-b2fd-437e2816e0b2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:57.985331 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-645d1cd2-7ec2-475e-b2fd-437e2816e0b2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:57.986835 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-645d1cd2-7ec2-475e-b2fd-437e2816e0b2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:57.988055 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-645d1cd2-7ec2-475e-b2fd-437e2816e0b2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.085740 Oct 15 03:55:57.988696 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 948/1999] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:57 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:55:59.005412 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e33546d1-e386-44bb-a91d-bf5ec4656bde tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:55:59.006083 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e33546d1-e386-44bb-a91d-bf5ec4656bde tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:55:59.011761 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e33546d1-e386-44bb-a91d-bf5ec4656bde tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:59.012227 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e33546d1-e386-44bb-a91d-bf5ec4656bde tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:59.012981 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e33546d1-e386-44bb-a91d-bf5ec4656bde tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:55:59.013411 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e33546d1-e386-44bb-a91d-bf5ec4656bde tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:55:59.070661 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e33546d1-e386-44bb-a91d-bf5ec4656bde tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:59.079005 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e33546d1-e386-44bb-a91d-bf5ec4656bde tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:59.080530 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e33546d1-e386-44bb-a91d-bf5ec4656bde tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:55:59.081655 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e33546d1-e386-44bb-a91d-bf5ec4656bde tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.079944 Oct 15 03:55:59.082198 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1052/2000] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:55:59 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:00.099398 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b4a30f22-2ac8-4871-aa0f-ad284aae0051 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:00.100040 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b4a30f22-2ac8-4871-aa0f-ad284aae0051 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:00.105721 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b4a30f22-2ac8-4871-aa0f-ad284aae0051 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:00.106169 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b4a30f22-2ac8-4871-aa0f-ad284aae0051 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:00.106929 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b4a30f22-2ac8-4871-aa0f-ad284aae0051 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:00.107363 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b4a30f22-2ac8-4871-aa0f-ad284aae0051 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:00.164832 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b4a30f22-2ac8-4871-aa0f-ad284aae0051 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:00.172975 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b4a30f22-2ac8-4871-aa0f-ad284aae0051 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:00.174467 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b4a30f22-2ac8-4871-aa0f-ad284aae0051 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:00.175580 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b4a30f22-2ac8-4871-aa0f-ad284aae0051 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.079824 Oct 15 03:56:00.176151 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 949/2001] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:00 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:01.194143 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3180482b-3110-4e4e-9f56-bea452e0714e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:01.194747 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3180482b-3110-4e4e-9f56-bea452e0714e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:01.200491 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3180482b-3110-4e4e-9f56-bea452e0714e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:01.200931 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3180482b-3110-4e4e-9f56-bea452e0714e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:01.201678 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3180482b-3110-4e4e-9f56-bea452e0714e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:01.202109 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3180482b-3110-4e4e-9f56-bea452e0714e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:01.260263 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3180482b-3110-4e4e-9f56-bea452e0714e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:01.268333 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3180482b-3110-4e4e-9f56-bea452e0714e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:01.269802 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3180482b-3110-4e4e-9f56-bea452e0714e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:01.270912 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3180482b-3110-4e4e-9f56-bea452e0714e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.081092 Oct 15 03:56:01.271455 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1053/2002] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:01 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:02.288298 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-cf5ec729-9ea1-493e-afd3-1d19eeb087a6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:02.288896 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-cf5ec729-9ea1-493e-afd3-1d19eeb087a6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:02.294621 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cf5ec729-9ea1-493e-afd3-1d19eeb087a6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:02.295061 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cf5ec729-9ea1-493e-afd3-1d19eeb087a6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:02.295838 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cf5ec729-9ea1-493e-afd3-1d19eeb087a6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:02.296260 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-cf5ec729-9ea1-493e-afd3-1d19eeb087a6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:02.353583 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-cf5ec729-9ea1-493e-afd3-1d19eeb087a6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:02.361598 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-cf5ec729-9ea1-493e-afd3-1d19eeb087a6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:02.362998 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-cf5ec729-9ea1-493e-afd3-1d19eeb087a6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:02.364683 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-cf5ec729-9ea1-493e-afd3-1d19eeb087a6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.079548 Oct 15 03:56:02.365228 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 950/2003] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:02 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:03.382476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a9f82cb8-7e74-4c07-9151-8bf61c3a7e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:03.383081 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a9f82cb8-7e74-4c07-9151-8bf61c3a7e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:03.388872 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a9f82cb8-7e74-4c07-9151-8bf61c3a7e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:03.389324 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a9f82cb8-7e74-4c07-9151-8bf61c3a7e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:03.390078 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a9f82cb8-7e74-4c07-9151-8bf61c3a7e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:03.390511 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a9f82cb8-7e74-4c07-9151-8bf61c3a7e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:03.452243 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a9f82cb8-7e74-4c07-9151-8bf61c3a7e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:03.460609 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a9f82cb8-7e74-4c07-9151-8bf61c3a7e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:03.462106 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a9f82cb8-7e74-4c07-9151-8bf61c3a7e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:03.463226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a9f82cb8-7e74-4c07-9151-8bf61c3a7e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.085022 Oct 15 03:56:03.463805 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1054/2004] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:03 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:04.480720 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6b53aa28-6f68-48b5-8bef-f105790e8878 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:04.481231 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6b53aa28-6f68-48b5-8bef-f105790e8878 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:04.486949 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b53aa28-6f68-48b5-8bef-f105790e8878 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:04.487400 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b53aa28-6f68-48b5-8bef-f105790e8878 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:04.488206 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b53aa28-6f68-48b5-8bef-f105790e8878 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:04.488641 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b53aa28-6f68-48b5-8bef-f105790e8878 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:04.550844 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6b53aa28-6f68-48b5-8bef-f105790e8878 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:04.559479 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6b53aa28-6f68-48b5-8bef-f105790e8878 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:04.561000 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6b53aa28-6f68-48b5-8bef-f105790e8878 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:04.562117 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6b53aa28-6f68-48b5-8bef-f105790e8878 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.085203 Oct 15 03:56:04.562671 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 951/2005] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:04 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:05.580627 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d5b0699e-c2a7-4b87-8e20-04650cbff7f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:05.581226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d5b0699e-c2a7-4b87-8e20-04650cbff7f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:05.587470 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d5b0699e-c2a7-4b87-8e20-04650cbff7f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:05.587944 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d5b0699e-c2a7-4b87-8e20-04650cbff7f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:05.588692 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d5b0699e-c2a7-4b87-8e20-04650cbff7f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:05.589116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d5b0699e-c2a7-4b87-8e20-04650cbff7f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:05.646070 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d5b0699e-c2a7-4b87-8e20-04650cbff7f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:05.653941 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d5b0699e-c2a7-4b87-8e20-04650cbff7f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:05.655424 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d5b0699e-c2a7-4b87-8e20-04650cbff7f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:05.656558 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d5b0699e-c2a7-4b87-8e20-04650cbff7f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.079922 Oct 15 03:56:05.657096 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1055/2006] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:05 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:06.674832 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-947a9e19-bfc1-488c-aecb-7c65431a3f3a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:06.675433 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-947a9e19-bfc1-488c-aecb-7c65431a3f3a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:06.681356 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-947a9e19-bfc1-488c-aecb-7c65431a3f3a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:06.681804 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-947a9e19-bfc1-488c-aecb-7c65431a3f3a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:06.682562 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-947a9e19-bfc1-488c-aecb-7c65431a3f3a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:06.682992 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-947a9e19-bfc1-488c-aecb-7c65431a3f3a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:06.740420 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-947a9e19-bfc1-488c-aecb-7c65431a3f3a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:06.748324 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-947a9e19-bfc1-488c-aecb-7c65431a3f3a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:06.749818 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-947a9e19-bfc1-488c-aecb-7c65431a3f3a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:06.750925 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-947a9e19-bfc1-488c-aecb-7c65431a3f3a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.079809 Oct 15 03:56:06.751467 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 952/2007] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:06 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:07.769058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f1a8ad71-492d-4e8d-bd9b-ae7f5c7926f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:07.769665 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f1a8ad71-492d-4e8d-bd9b-ae7f5c7926f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:07.775927 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f1a8ad71-492d-4e8d-bd9b-ae7f5c7926f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:07.776370 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f1a8ad71-492d-4e8d-bd9b-ae7f5c7926f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:07.777120 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f1a8ad71-492d-4e8d-bd9b-ae7f5c7926f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:07.777547 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f1a8ad71-492d-4e8d-bd9b-ae7f5c7926f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:07.836517 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f1a8ad71-492d-4e8d-bd9b-ae7f5c7926f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:07.844537 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f1a8ad71-492d-4e8d-bd9b-ae7f5c7926f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:07.846019 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f1a8ad71-492d-4e8d-bd9b-ae7f5c7926f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:07.847141 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f1a8ad71-492d-4e8d-bd9b-ae7f5c7926f7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.081804 Oct 15 03:56:07.847705 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1056/2008] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:07 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:08.866640 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fe9b332e-2dd8-4fe1-a0b6-12a91ec50f57 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:08.867243 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fe9b332e-2dd8-4fe1-a0b6-12a91ec50f57 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:08.872890 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe9b332e-2dd8-4fe1-a0b6-12a91ec50f57 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:08.873341 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe9b332e-2dd8-4fe1-a0b6-12a91ec50f57 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:08.874089 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe9b332e-2dd8-4fe1-a0b6-12a91ec50f57 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:08.874515 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe9b332e-2dd8-4fe1-a0b6-12a91ec50f57 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:08.933708 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fe9b332e-2dd8-4fe1-a0b6-12a91ec50f57 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:08.941553 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fe9b332e-2dd8-4fe1-a0b6-12a91ec50f57 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:08.943065 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fe9b332e-2dd8-4fe1-a0b6-12a91ec50f57 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:08.944213 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fe9b332e-2dd8-4fe1-a0b6-12a91ec50f57 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.081879 Oct 15 03:56:08.944753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 953/2009] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:08 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:09.959458 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: ERROR oslo.messaging._drivers.impl_rabbit [-] [62b4e7dd-437c-4699-815c-b81f4b01b864] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 15 03:56:09.962705 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a6cb89f1-9de2-42b1-956a-949610deadcf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:09.963306 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a6cb89f1-9de2-42b1-956a-949610deadcf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:09.969018 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a6cb89f1-9de2-42b1-956a-949610deadcf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:09.969458 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a6cb89f1-9de2-42b1-956a-949610deadcf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:09.970200 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a6cb89f1-9de2-42b1-956a-949610deadcf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:09.970625 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a6cb89f1-9de2-42b1-956a-949610deadcf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:10.030606 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a6cb89f1-9de2-42b1-956a-949610deadcf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:10.038556 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a6cb89f1-9de2-42b1-956a-949610deadcf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:10.040054 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a6cb89f1-9de2-42b1-956a-949610deadcf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:10.041148 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a6cb89f1-9de2-42b1-956a-949610deadcf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.083039 Oct 15 03:56:10.041690 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1057/2010] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:09 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:11.058031 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4aeb72ab-9f46-467d-8ecc-566bf8d4d268 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:11.058636 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4aeb72ab-9f46-467d-8ecc-566bf8d4d268 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:11.064400 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4aeb72ab-9f46-467d-8ecc-566bf8d4d268 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:11.064847 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4aeb72ab-9f46-467d-8ecc-566bf8d4d268 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:11.065607 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4aeb72ab-9f46-467d-8ecc-566bf8d4d268 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:11.066038 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4aeb72ab-9f46-467d-8ecc-566bf8d4d268 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:11.275390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4aeb72ab-9f46-467d-8ecc-566bf8d4d268 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:11.283480 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4aeb72ab-9f46-467d-8ecc-566bf8d4d268 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:11.285002 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4aeb72ab-9f46-467d-8ecc-566bf8d4d268 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:11.286125 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4aeb72ab-9f46-467d-8ecc-566bf8d4d268 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.231755 Oct 15 03:56:11.287278 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 954/2011] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:11 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:12.303902 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e50f2d0d-ee0d-4d7a-aedb-e3be34389362 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:12.304544 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e50f2d0d-ee0d-4d7a-aedb-e3be34389362 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:12.320777 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e50f2d0d-ee0d-4d7a-aedb-e3be34389362 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:12.321220 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e50f2d0d-ee0d-4d7a-aedb-e3be34389362 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:12.321985 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e50f2d0d-ee0d-4d7a-aedb-e3be34389362 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:12.322418 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e50f2d0d-ee0d-4d7a-aedb-e3be34389362 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:12.337958 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] [62b4e7dd-437c-4699-815c-b81f4b01b864] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 36136. Oct 15 03:56:12.382212 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e50f2d0d-ee0d-4d7a-aedb-e3be34389362 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:12.390288 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e50f2d0d-ee0d-4d7a-aedb-e3be34389362 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:12.391797 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e50f2d0d-ee0d-4d7a-aedb-e3be34389362 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:12.392919 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e50f2d0d-ee0d-4d7a-aedb-e3be34389362 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.093218 Oct 15 03:56:12.393467 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1058/2012] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:12 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:13.410091 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4a9b70b6-36b0-40e3-ada8-1c83c968c0b0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:13.410747 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4a9b70b6-36b0-40e3-ada8-1c83c968c0b0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:13.416453 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4a9b70b6-36b0-40e3-ada8-1c83c968c0b0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:13.416899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4a9b70b6-36b0-40e3-ada8-1c83c968c0b0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:13.417655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4a9b70b6-36b0-40e3-ada8-1c83c968c0b0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:13.418086 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4a9b70b6-36b0-40e3-ada8-1c83c968c0b0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:13.476002 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4a9b70b6-36b0-40e3-ada8-1c83c968c0b0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:13.484094 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4a9b70b6-36b0-40e3-ada8-1c83c968c0b0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:13.485575 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4a9b70b6-36b0-40e3-ada8-1c83c968c0b0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:13.486688 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4a9b70b6-36b0-40e3-ada8-1c83c968c0b0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080263 Oct 15 03:56:13.487228 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 955/2013] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:13 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:14.504173 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-18ba4d30-7676-4da7-9e34-7c053a8a3f25 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:14.505339 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-18ba4d30-7676-4da7-9e34-7c053a8a3f25 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:14.511007 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18ba4d30-7676-4da7-9e34-7c053a8a3f25 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:14.511455 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18ba4d30-7676-4da7-9e34-7c053a8a3f25 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:14.512240 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18ba4d30-7676-4da7-9e34-7c053a8a3f25 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:14.512676 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18ba4d30-7676-4da7-9e34-7c053a8a3f25 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:14.569721 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-18ba4d30-7676-4da7-9e34-7c053a8a3f25 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:14.577966 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-18ba4d30-7676-4da7-9e34-7c053a8a3f25 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:14.579454 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-18ba4d30-7676-4da7-9e34-7c053a8a3f25 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:14.580608 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-18ba4d30-7676-4da7-9e34-7c053a8a3f25 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080194 Oct 15 03:56:14.581151 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1059/2014] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:14 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:15.597932 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e2fd2576-1f24-4a07-9ea0-8f20e078984f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:15.598708 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e2fd2576-1f24-4a07-9ea0-8f20e078984f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:15.605134 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e2fd2576-1f24-4a07-9ea0-8f20e078984f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:15.605578 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e2fd2576-1f24-4a07-9ea0-8f20e078984f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:15.606329 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e2fd2576-1f24-4a07-9ea0-8f20e078984f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:15.606755 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e2fd2576-1f24-4a07-9ea0-8f20e078984f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:15.663915 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e2fd2576-1f24-4a07-9ea0-8f20e078984f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:15.671760 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e2fd2576-1f24-4a07-9ea0-8f20e078984f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:15.673229 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e2fd2576-1f24-4a07-9ea0-8f20e078984f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:15.674339 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e2fd2576-1f24-4a07-9ea0-8f20e078984f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080140 Oct 15 03:56:15.674878 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 956/2015] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:15 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:16.691912 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9f17c715-0396-4b96-a20d-9b64b28274fc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:16.692519 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9f17c715-0396-4b96-a20d-9b64b28274fc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:16.698335 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9f17c715-0396-4b96-a20d-9b64b28274fc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:16.698765 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9f17c715-0396-4b96-a20d-9b64b28274fc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:16.699510 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9f17c715-0396-4b96-a20d-9b64b28274fc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:16.699972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9f17c715-0396-4b96-a20d-9b64b28274fc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:16.760099 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9f17c715-0396-4b96-a20d-9b64b28274fc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:16.768441 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9f17c715-0396-4b96-a20d-9b64b28274fc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:16.770463 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9f17c715-0396-4b96-a20d-9b64b28274fc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:16.771574 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9f17c715-0396-4b96-a20d-9b64b28274fc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.083419 Oct 15 03:56:16.772230 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1060/2016] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:16 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:17.789276 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-36fa36e5-41fe-42d4-a0ba-40447eca6e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:17.789818 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-36fa36e5-41fe-42d4-a0ba-40447eca6e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:17.795488 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-36fa36e5-41fe-42d4-a0ba-40447eca6e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:17.795963 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-36fa36e5-41fe-42d4-a0ba-40447eca6e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:17.796712 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-36fa36e5-41fe-42d4-a0ba-40447eca6e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:17.797139 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-36fa36e5-41fe-42d4-a0ba-40447eca6e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:17.859397 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-36fa36e5-41fe-42d4-a0ba-40447eca6e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:17.868295 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-36fa36e5-41fe-42d4-a0ba-40447eca6e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:17.869777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-36fa36e5-41fe-42d4-a0ba-40447eca6e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:17.870890 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-36fa36e5-41fe-42d4-a0ba-40447eca6e4c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.085948 Oct 15 03:56:17.871424 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 957/2017] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:17 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:18.888714 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5c5fc363-3130-42ad-8455-109fe8f79d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:18.889347 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5c5fc363-3130-42ad-8455-109fe8f79d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:18.895036 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c5fc363-3130-42ad-8455-109fe8f79d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:18.895512 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c5fc363-3130-42ad-8455-109fe8f79d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:18.896340 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c5fc363-3130-42ad-8455-109fe8f79d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:18.896771 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5c5fc363-3130-42ad-8455-109fe8f79d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:18.954617 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5c5fc363-3130-42ad-8455-109fe8f79d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:18.962589 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5c5fc363-3130-42ad-8455-109fe8f79d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:18.964104 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5c5fc363-3130-42ad-8455-109fe8f79d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:18.965217 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5c5fc363-3130-42ad-8455-109fe8f79d15 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080253 Oct 15 03:56:18.965763 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1061/2018] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:18 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:19.981862 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-83359fd5-e5b5-4353-a56b-5153c21fa11a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:19.982572 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-83359fd5-e5b5-4353-a56b-5153c21fa11a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:19.988277 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-83359fd5-e5b5-4353-a56b-5153c21fa11a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:19.988717 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-83359fd5-e5b5-4353-a56b-5153c21fa11a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:19.989591 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-83359fd5-e5b5-4353-a56b-5153c21fa11a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:19.990023 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-83359fd5-e5b5-4353-a56b-5153c21fa11a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:20.047365 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-83359fd5-e5b5-4353-a56b-5153c21fa11a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:20.055241 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-83359fd5-e5b5-4353-a56b-5153c21fa11a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:20.056735 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-83359fd5-e5b5-4353-a56b-5153c21fa11a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:20.057840 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-83359fd5-e5b5-4353-a56b-5153c21fa11a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.079586 Oct 15 03:56:20.058368 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 958/2019] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:19 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:21.075605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-61c12884-ebf7-4b68-8a1d-f7cb05037427 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:21.076242 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-61c12884-ebf7-4b68-8a1d-f7cb05037427 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:21.082174 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-61c12884-ebf7-4b68-8a1d-f7cb05037427 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:21.082605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-61c12884-ebf7-4b68-8a1d-f7cb05037427 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:21.083903 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-61c12884-ebf7-4b68-8a1d-f7cb05037427 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:21.084339 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-61c12884-ebf7-4b68-8a1d-f7cb05037427 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:21.140776 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-61c12884-ebf7-4b68-8a1d-f7cb05037427 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:21.149141 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-61c12884-ebf7-4b68-8a1d-f7cb05037427 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:21.150624 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-61c12884-ebf7-4b68-8a1d-f7cb05037427 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:21.151763 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-61c12884-ebf7-4b68-8a1d-f7cb05037427 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.079810 Oct 15 03:56:21.152304 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1062/2020] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:21 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:22.169557 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5e8b1327-ecdc-4b3f-9770-a07e98c4350c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:22.170155 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5e8b1327-ecdc-4b3f-9770-a07e98c4350c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:22.175883 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5e8b1327-ecdc-4b3f-9770-a07e98c4350c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:22.176328 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5e8b1327-ecdc-4b3f-9770-a07e98c4350c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:22.177072 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5e8b1327-ecdc-4b3f-9770-a07e98c4350c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:22.177500 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5e8b1327-ecdc-4b3f-9770-a07e98c4350c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:22.234902 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5e8b1327-ecdc-4b3f-9770-a07e98c4350c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:22.243022 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5e8b1327-ecdc-4b3f-9770-a07e98c4350c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:22.244527 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5e8b1327-ecdc-4b3f-9770-a07e98c4350c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:22.245648 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5e8b1327-ecdc-4b3f-9770-a07e98c4350c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.079771 Oct 15 03:56:22.246177 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 959/2021] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:22 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:23.263402 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6416b6ad-d67f-4770-b2f7-39d88c1c1e46 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:23.264040 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6416b6ad-d67f-4770-b2f7-39d88c1c1e46 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:23.270075 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6416b6ad-d67f-4770-b2f7-39d88c1c1e46 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:23.270517 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6416b6ad-d67f-4770-b2f7-39d88c1c1e46 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:23.271443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6416b6ad-d67f-4770-b2f7-39d88c1c1e46 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:23.272393 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6416b6ad-d67f-4770-b2f7-39d88c1c1e46 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:23.338205 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6416b6ad-d67f-4770-b2f7-39d88c1c1e46 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:23.346316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6416b6ad-d67f-4770-b2f7-39d88c1c1e46 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:23.347856 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6416b6ad-d67f-4770-b2f7-39d88c1c1e46 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:23.348962 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6416b6ad-d67f-4770-b2f7-39d88c1c1e46 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.089247 Oct 15 03:56:23.349504 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1063/2022] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:23 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:24.366483 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-03a776f5-5932-479e-a85a-883ee5caf0f1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:24.367000 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-03a776f5-5932-479e-a85a-883ee5caf0f1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:24.372851 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-03a776f5-5932-479e-a85a-883ee5caf0f1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:24.373293 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-03a776f5-5932-479e-a85a-883ee5caf0f1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:24.374041 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-03a776f5-5932-479e-a85a-883ee5caf0f1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:24.374469 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-03a776f5-5932-479e-a85a-883ee5caf0f1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:24.432782 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-03a776f5-5932-479e-a85a-883ee5caf0f1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:24.440722 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-03a776f5-5932-479e-a85a-883ee5caf0f1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:24.442195 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-03a776f5-5932-479e-a85a-883ee5caf0f1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:24.443929 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-03a776f5-5932-479e-a85a-883ee5caf0f1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.081305 Oct 15 03:56:24.444470 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 960/2023] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:24 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:56:25.461330 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a954b37e-e4fc-40f0-8dad-41f04c65d467 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:25.461841 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a954b37e-e4fc-40f0-8dad-41f04c65d467 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:25.467765 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a954b37e-e4fc-40f0-8dad-41f04c65d467 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:25.468261 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a954b37e-e4fc-40f0-8dad-41f04c65d467 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:25.469025 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a954b37e-e4fc-40f0-8dad-41f04c65d467 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:25.469457 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a954b37e-e4fc-40f0-8dad-41f04c65d467 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:25.527149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a954b37e-e4fc-40f0-8dad-41f04c65d467 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:25.535107 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a954b37e-e4fc-40f0-8dad-41f04c65d467 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:25.536632 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a954b37e-e4fc-40f0-8dad-41f04c65d467 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:25.538412 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a954b37e-e4fc-40f0-8dad-41f04c65d467 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080832 Oct 15 03:56:25.538952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1064/2024] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:25 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:26.556735 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-17af9b9f-ce8d-4661-9897-e1b8c779f704 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:26.557375 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-17af9b9f-ce8d-4661-9897-e1b8c779f704 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:26.563120 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-17af9b9f-ce8d-4661-9897-e1b8c779f704 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:26.563573 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-17af9b9f-ce8d-4661-9897-e1b8c779f704 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:26.564374 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-17af9b9f-ce8d-4661-9897-e1b8c779f704 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:26.564816 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-17af9b9f-ce8d-4661-9897-e1b8c779f704 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:26.623328 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-17af9b9f-ce8d-4661-9897-e1b8c779f704 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:26.632059 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-17af9b9f-ce8d-4661-9897-e1b8c779f704 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:26.633584 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-17af9b9f-ce8d-4661-9897-e1b8c779f704 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:26.634724 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-17af9b9f-ce8d-4661-9897-e1b8c779f704 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.082333 Oct 15 03:56:26.635268 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 961/2025] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:26 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:27.652902 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9c1ab676-4cb9-41b1-bcc2-0187ef0459c5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:27.653451 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9c1ab676-4cb9-41b1-bcc2-0187ef0459c5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:27.661801 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9c1ab676-4cb9-41b1-bcc2-0187ef0459c5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:27.662255 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9c1ab676-4cb9-41b1-bcc2-0187ef0459c5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:27.663011 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9c1ab676-4cb9-41b1-bcc2-0187ef0459c5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:27.663445 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9c1ab676-4cb9-41b1-bcc2-0187ef0459c5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:27.722501 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9c1ab676-4cb9-41b1-bcc2-0187ef0459c5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:27.730617 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9c1ab676-4cb9-41b1-bcc2-0187ef0459c5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:27.732146 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9c1ab676-4cb9-41b1-bcc2-0187ef0459c5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:27.733308 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9c1ab676-4cb9-41b1-bcc2-0187ef0459c5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.084263 Oct 15 03:56:27.733846 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1065/2026] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:27 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:28.750825 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2e489c64-dc9b-4a05-a5af-5db00a0f2ece tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:28.751493 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2e489c64-dc9b-4a05-a5af-5db00a0f2ece tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:28.757439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2e489c64-dc9b-4a05-a5af-5db00a0f2ece tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:28.757891 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2e489c64-dc9b-4a05-a5af-5db00a0f2ece tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:28.758651 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2e489c64-dc9b-4a05-a5af-5db00a0f2ece tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:28.759086 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2e489c64-dc9b-4a05-a5af-5db00a0f2ece tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:28.817244 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2e489c64-dc9b-4a05-a5af-5db00a0f2ece tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:28.825565 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2e489c64-dc9b-4a05-a5af-5db00a0f2ece tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:28.827085 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2e489c64-dc9b-4a05-a5af-5db00a0f2ece tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:28.828544 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2e489c64-dc9b-4a05-a5af-5db00a0f2ece tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.081439 Oct 15 03:56:28.829085 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 962/2027] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:28 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:29.846406 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2ae5d390-3f02-45dc-9dfb-a7c15e3d3e73 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:29.847018 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2ae5d390-3f02-45dc-9dfb-a7c15e3d3e73 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:29.853333 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2ae5d390-3f02-45dc-9dfb-a7c15e3d3e73 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:29.853777 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2ae5d390-3f02-45dc-9dfb-a7c15e3d3e73 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:29.854525 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2ae5d390-3f02-45dc-9dfb-a7c15e3d3e73 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:29.854954 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2ae5d390-3f02-45dc-9dfb-a7c15e3d3e73 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:29.914646 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2ae5d390-3f02-45dc-9dfb-a7c15e3d3e73 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:29.922733 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2ae5d390-3f02-45dc-9dfb-a7c15e3d3e73 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:29.924245 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2ae5d390-3f02-45dc-9dfb-a7c15e3d3e73 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:29.925492 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2ae5d390-3f02-45dc-9dfb-a7c15e3d3e73 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.082750 Oct 15 03:56:29.926092 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1066/2028] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:29 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:30.944411 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b8f90d74-7f85-4c53-8b61-6f28d49e80a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:30.944975 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b8f90d74-7f85-4c53-8b61-6f28d49e80a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:30.950577 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b8f90d74-7f85-4c53-8b61-6f28d49e80a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:30.951026 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b8f90d74-7f85-4c53-8b61-6f28d49e80a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:30.951814 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b8f90d74-7f85-4c53-8b61-6f28d49e80a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:30.952256 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b8f90d74-7f85-4c53-8b61-6f28d49e80a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:31.012631 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b8f90d74-7f85-4c53-8b61-6f28d49e80a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:31.020574 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b8f90d74-7f85-4c53-8b61-6f28d49e80a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:31.022086 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b8f90d74-7f85-4c53-8b61-6f28d49e80a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:31.023210 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b8f90d74-7f85-4c53-8b61-6f28d49e80a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.083271 Oct 15 03:56:31.023770 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 963/2029] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:30 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:32.040230 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a774bf70-7ae0-4590-8684-23b463ae56b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:32.040840 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a774bf70-7ae0-4590-8684-23b463ae56b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:32.046534 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a774bf70-7ae0-4590-8684-23b463ae56b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:32.047053 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a774bf70-7ae0-4590-8684-23b463ae56b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:32.047838 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a774bf70-7ae0-4590-8684-23b463ae56b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:32.048276 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a774bf70-7ae0-4590-8684-23b463ae56b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:32.106085 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a774bf70-7ae0-4590-8684-23b463ae56b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:32.114124 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a774bf70-7ae0-4590-8684-23b463ae56b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:32.115607 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a774bf70-7ae0-4590-8684-23b463ae56b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:32.116778 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a774bf70-7ae0-4590-8684-23b463ae56b5 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080301 Oct 15 03:56:32.117331 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1067/2030] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:32 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:33.134233 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fbc28afe-e1fe-4c2c-8d41-0d08fa554cfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:33.134841 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fbc28afe-e1fe-4c2c-8d41-0d08fa554cfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:33.140574 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fbc28afe-e1fe-4c2c-8d41-0d08fa554cfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:33.141024 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fbc28afe-e1fe-4c2c-8d41-0d08fa554cfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:33.141782 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fbc28afe-e1fe-4c2c-8d41-0d08fa554cfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:33.142214 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fbc28afe-e1fe-4c2c-8d41-0d08fa554cfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:33.199963 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fbc28afe-e1fe-4c2c-8d41-0d08fa554cfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:33.208229 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fbc28afe-e1fe-4c2c-8d41-0d08fa554cfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:33.210220 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fbc28afe-e1fe-4c2c-8d41-0d08fa554cfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:33.211346 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fbc28afe-e1fe-4c2c-8d41-0d08fa554cfd tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080824 Oct 15 03:56:33.211993 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 964/2031] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:33 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:34.229640 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d1d91645-d7ea-4ed0-aeaa-952be215a505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:34.230167 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d1d91645-d7ea-4ed0-aeaa-952be215a505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:34.236006 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1d91645-d7ea-4ed0-aeaa-952be215a505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:34.236452 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1d91645-d7ea-4ed0-aeaa-952be215a505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:34.237211 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1d91645-d7ea-4ed0-aeaa-952be215a505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:34.237650 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1d91645-d7ea-4ed0-aeaa-952be215a505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:34.296465 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d1d91645-d7ea-4ed0-aeaa-952be215a505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:34.305261 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d1d91645-d7ea-4ed0-aeaa-952be215a505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:34.306750 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d1d91645-d7ea-4ed0-aeaa-952be215a505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:34.307914 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d1d91645-d7ea-4ed0-aeaa-952be215a505 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.082319 Oct 15 03:56:34.308449 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1068/2032] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:34 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:35.324845 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-eaa080bd-580c-4059-86a2-21d9427dada3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:35.325450 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-eaa080bd-580c-4059-86a2-21d9427dada3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:35.331384 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eaa080bd-580c-4059-86a2-21d9427dada3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:35.331944 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eaa080bd-580c-4059-86a2-21d9427dada3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:35.332713 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eaa080bd-580c-4059-86a2-21d9427dada3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:35.333150 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eaa080bd-580c-4059-86a2-21d9427dada3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:35.390892 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-eaa080bd-580c-4059-86a2-21d9427dada3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:35.398934 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-eaa080bd-580c-4059-86a2-21d9427dada3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:35.400472 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-eaa080bd-580c-4059-86a2-21d9427dada3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:35.401661 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-eaa080bd-580c-4059-86a2-21d9427dada3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080479 Oct 15 03:56:35.402205 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 965/2033] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:35 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:36.418561 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9b712d6e-6205-48b8-9396-8d05354000d2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:36.419165 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9b712d6e-6205-48b8-9396-8d05354000d2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:36.424897 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9b712d6e-6205-48b8-9396-8d05354000d2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:36.425343 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9b712d6e-6205-48b8-9396-8d05354000d2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:36.426092 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9b712d6e-6205-48b8-9396-8d05354000d2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:36.426520 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9b712d6e-6205-48b8-9396-8d05354000d2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:36.487294 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9b712d6e-6205-48b8-9396-8d05354000d2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:36.495301 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9b712d6e-6205-48b8-9396-8d05354000d2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:36.496752 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-9b712d6e-6205-48b8-9396-8d05354000d2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:36.497856 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9b712d6e-6205-48b8-9396-8d05354000d2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.082949 Oct 15 03:56:36.498418 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1069/2034] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:36 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 03:56:37.515716 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-080ce19a-ecab-4b36-b229-becdf034f8e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:37.516239 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-080ce19a-ecab-4b36-b229-becdf034f8e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:37.522434 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-080ce19a-ecab-4b36-b229-becdf034f8e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:37.522938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-080ce19a-ecab-4b36-b229-becdf034f8e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:37.523768 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-080ce19a-ecab-4b36-b229-becdf034f8e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:37.524205 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-080ce19a-ecab-4b36-b229-becdf034f8e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:37.581662 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-080ce19a-ecab-4b36-b229-becdf034f8e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:37.590987 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-080ce19a-ecab-4b36-b229-becdf034f8e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:37.592515 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-080ce19a-ecab-4b36-b229-becdf034f8e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:37.593651 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-080ce19a-ecab-4b36-b229-becdf034f8e3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.081734 Oct 15 03:56:37.594194 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 966/2035] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:37 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:38.125710 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:56:38.126265 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 03:56:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:56:38.611869 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1731e5e2-5c08-4200-8b5d-3bf27d4d53a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:38.612480 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1731e5e2-5c08-4200-8b5d-3bf27d4d53a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:38.618751 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1731e5e2-5c08-4200-8b5d-3bf27d4d53a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:38.619204 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1731e5e2-5c08-4200-8b5d-3bf27d4d53a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:38.620000 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1731e5e2-5c08-4200-8b5d-3bf27d4d53a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:38.620437 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1731e5e2-5c08-4200-8b5d-3bf27d4d53a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:38.679423 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1731e5e2-5c08-4200-8b5d-3bf27d4d53a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:38.687423 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1731e5e2-5c08-4200-8b5d-3bf27d4d53a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:38.688957 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1731e5e2-5c08-4200-8b5d-3bf27d4d53a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:38.690080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1731e5e2-5c08-4200-8b5d-3bf27d4d53a4 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.082008 Oct 15 03:56:38.690623 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1070/2036] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:38 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:39.707884 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-456bfdcb-37bb-4f61-9d16-0720034cbf70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:39.708496 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-456bfdcb-37bb-4f61-9d16-0720034cbf70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:39.714972 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-456bfdcb-37bb-4f61-9d16-0720034cbf70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:39.715365 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-456bfdcb-37bb-4f61-9d16-0720034cbf70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:39.716148 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-456bfdcb-37bb-4f61-9d16-0720034cbf70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:39.716584 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-456bfdcb-37bb-4f61-9d16-0720034cbf70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:39.774100 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-456bfdcb-37bb-4f61-9d16-0720034cbf70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:39.782017 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-456bfdcb-37bb-4f61-9d16-0720034cbf70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:39.783493 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-456bfdcb-37bb-4f61-9d16-0720034cbf70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:39.784650 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-456bfdcb-37bb-4f61-9d16-0720034cbf70 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080440 Oct 15 03:56:39.785192 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 967/2037] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:39 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:40.802055 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c17dc303-2a36-456c-813e-10a927c31445 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:40.803170 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c17dc303-2a36-456c-813e-10a927c31445 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:40.808991 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c17dc303-2a36-456c-813e-10a927c31445 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:40.809428 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c17dc303-2a36-456c-813e-10a927c31445 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:40.810180 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c17dc303-2a36-456c-813e-10a927c31445 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:40.810605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c17dc303-2a36-456c-813e-10a927c31445 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:40.867707 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c17dc303-2a36-456c-813e-10a927c31445 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:40.875925 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c17dc303-2a36-456c-813e-10a927c31445 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:40.877424 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c17dc303-2a36-456c-813e-10a927c31445 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:40.878547 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c17dc303-2a36-456c-813e-10a927c31445 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.080298 Oct 15 03:56:40.879087 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1071/2038] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:40 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:41.897485 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5fe2a6e5-e095-4027-8f9a-f2a36d207b03 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:41.898005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5fe2a6e5-e095-4027-8f9a-f2a36d207b03 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:41.903746 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5fe2a6e5-e095-4027-8f9a-f2a36d207b03 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:41.904199 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5fe2a6e5-e095-4027-8f9a-f2a36d207b03 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:41.904953 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5fe2a6e5-e095-4027-8f9a-f2a36d207b03 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:41.905384 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5fe2a6e5-e095-4027-8f9a-f2a36d207b03 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:41.967088 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5fe2a6e5-e095-4027-8f9a-f2a36d207b03 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:41.975360 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5fe2a6e5-e095-4027-8f9a-f2a36d207b03 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:41.976944 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5fe2a6e5-e095-4027-8f9a-f2a36d207b03 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:41.978079 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5fe2a6e5-e095-4027-8f9a-f2a36d207b03 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.085098 Oct 15 03:56:41.978620 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 968/2039] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:41 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:42.995610 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3f356c84-33e8-4848-8e1e-a0e86ce7912c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:42.996247 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3f356c84-33e8-4848-8e1e-a0e86ce7912c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:43.002089 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3f356c84-33e8-4848-8e1e-a0e86ce7912c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:43.002539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3f356c84-33e8-4848-8e1e-a0e86ce7912c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:43.003298 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3f356c84-33e8-4848-8e1e-a0e86ce7912c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:43.003755 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3f356c84-33e8-4848-8e1e-a0e86ce7912c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:43.062275 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3f356c84-33e8-4848-8e1e-a0e86ce7912c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:43.071308 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3f356c84-33e8-4848-8e1e-a0e86ce7912c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:43.072830 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3f356c84-33e8-4848-8e1e-a0e86ce7912c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:43.073954 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3f356c84-33e8-4848-8e1e-a0e86ce7912c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1444 microversion: 2.20 time: 0.082017 Oct 15 03:56:43.074490 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1072/2040] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:42 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:44.091602 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1d4d9693-ebd5-4a22-9427-a782c59c4420 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:44.092248 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1d4d9693-ebd5-4a22-9427-a782c59c4420 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:44.097908 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1d4d9693-ebd5-4a22-9427-a782c59c4420 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:44.098362 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1d4d9693-ebd5-4a22-9427-a782c59c4420 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:44.099134 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1d4d9693-ebd5-4a22-9427-a782c59c4420 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:44.099574 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1d4d9693-ebd5-4a22-9427-a782c59c4420 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:44.128644 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1d4d9693-ebd5-4a22-9427-a782c59c4420 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:44.129087 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1d4d9693-ebd5-4a22-9427-a782c59c4420 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:44.129655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.objects.instance [None req-1d4d9693-ebd5-4a22-9427-a782c59c4420 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lazy-loading 'fault' on Instance uuid 3594fddd-dbb7-4731-8f30-b3512198e1a9 {{(pid=120899) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 03:56:44.169860 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-1d4d9693-ebd5-4a22-9427-a782c59c4420 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:44.178086 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-1d4d9693-ebd5-4a22-9427-a782c59c4420 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:44.179568 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-1d4d9693-ebd5-4a22-9427-a782c59c4420 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:44.180750 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1d4d9693-ebd5-4a22-9427-a782c59c4420 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 200 len: 1538 microversion: 2.20 time: 0.092844 Oct 15 03:56:44.181290 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 969/2041] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:44 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 1538 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:45.197976 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ebc24ace-71ec-4fa1-b660-634ac622e69c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:45.198537 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ebc24ace-71ec-4fa1-b660-634ac622e69c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:45.204492 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ebc24ace-71ec-4fa1-b660-634ac622e69c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:45.204936 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ebc24ace-71ec-4fa1-b660-634ac622e69c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:45.205684 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ebc24ace-71ec-4fa1-b660-634ac622e69c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:45.206113 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ebc24ace-71ec-4fa1-b660-634ac622e69c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:45.220343 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.wsgi [None req-ebc24ace-71ec-4fa1-b660-634ac622e69c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] HTTP exception thrown: Instance 3594fddd-dbb7-4731-8f30-b3512198e1a9 could not be found. Oct 15 03:56:45.220944 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ebc24ace-71ec-4fa1-b660-634ac622e69c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Returning 404 to user: Instance 3594fddd-dbb7-4731-8f30-b3512198e1a9 could not be found. {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 03:56:45.221748 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ebc24ace-71ec-4fa1-b660-634ac622e69c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 404 len: 111 microversion: 2.20 time: 0.027442 Oct 15 03:56:45.222258 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1073/2042] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:45 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 15 03:56:45.230961 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ca397021-1cfc-4abf-b420-8e3e68171f7e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '.version_select at 0x7f4ac181c9d0>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:45.250542 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ca397021-1cfc-4abf-b420-8e3e68171f7e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027734471" status: 204 len: 0 microversion: 2.20 time: 0.023149 Oct 15 03:56:45.251096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 970/2043] 10.222.0.30 () {60 vars in 1261 bytes} [Fri Oct 15 03:56:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027734471 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 15 03:56:46.023735 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5309009d-ed67-49de-9a30-30bd7d9a7d04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'create', calling method: .version_select at 0x7f4abccc9f70>, body: {"keypair": {"name": "tempest-keypair-1448836334"}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:56:46.041263 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-5309009d-ed67-49de-9a30-30bd7d9a7d04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Getting quotas for project 5b4923cacd2a4baea3b5dcf9522e9b54. Resources: {'key_pairs'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:56:46.045198 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-5309009d-ed67-49de-9a30-30bd7d9a7d04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Getting quotas for user d795b4264cbe4aff82f5a2b0275ca972 and project 5b4923cacd2a4baea3b5dcf9522e9b54. Resources: {'key_pairs'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:56:46.268585 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-5309009d-ed67-49de-9a30-30bd7d9a7d04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Getting quotas for project 5b4923cacd2a4baea3b5dcf9522e9b54. Resources: {'key_pairs'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:56:46.272215 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-5309009d-ed67-49de-9a30-30bd7d9a7d04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Getting quotas for user d795b4264cbe4aff82f5a2b0275ca972 and project 5b4923cacd2a4baea3b5dcf9522e9b54. Resources: {'key_pairs'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:56:46.284595 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5309009d-ed67-49de-9a30-30bd7d9a7d04 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.266035 Oct 15 03:56:46.285157 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1074/2044] 10.222.0.30 () {62 vars in 1198 bytes} [Fri Oct 15 03:56:46 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 267 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 15 03:56:47.486205 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2b6bd99e-3420-4570-af37-1da0a7bdc0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2144578378", "imageRef": "0ec12dbd-23ec-4d58-b215-4e3cd5f17594", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "830c2be1-af32-4eca-80bf-988a2f30d468"}], "security_groups": [{"name": "tempest-securitygroup--1349661869"}], "key_name": "tempest-keypair-1448836334", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:56:47.576509 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.network.neutron [None req-2b6bd99e-3420-4570-af37-1da0a7bdc0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] validate_networks() for [('830c2be1-af32-4eca-80bf-988a2f30d468', None, None, None, None, None)] {{(pid=120899) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 15 03:56:48.003471 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-2b6bd99e-3420-4570-af37-1da0a7bdc0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Flavor limits 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 03:56:48.003941 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-2b6bd99e-3420-4570-af37-1da0a7bdc0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Image limits 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 03:56:48.004425 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-2b6bd99e-3420-4570-af37-1da0a7bdc0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Flavor pref 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 03:56:48.004832 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-2b6bd99e-3420-4570-af37-1da0a7bdc0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Image pref 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 03:56:48.005299 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-2b6bd99e-3420-4570-af37-1da0a7bdc0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 03:56:48.013813 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b6bd99e-3420-4570-af37-1da0a7bdc0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:48.014261 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b6bd99e-3420-4570-af37-1da0a7bdc0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:48.015058 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b6bd99e-3420-4570-af37-1da0a7bdc0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:48.015519 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b6bd99e-3420-4570-af37-1da0a7bdc0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:48.031506 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-2b6bd99e-3420-4570-af37-1da0a7bdc0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Getting quotas for project 5b4923cacd2a4baea3b5dcf9522e9b54. Resources: {'cores', 'instances', 'ram'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 03:56:48.035294 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-2b6bd99e-3420-4570-af37-1da0a7bdc0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Getting quotas for user d795b4264cbe4aff82f5a2b0275ca972 and project 5b4923cacd2a4baea3b5dcf9522e9b54. Resources: {'cores', 'instances', 'ram'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 03:56:48.046236 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2b6bd99e-3420-4570-af37-1da0a7bdc0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Going to run 1 instances... {{(pid=120899) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 15 03:56:48.048581 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2b6bd99e-3420-4570-af37-1da0a7bdc0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ec12dbd-23ec-4d58-b215-4e3cd5f17594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120899) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 15 03:56:48.094952 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2b6bd99e-3420-4570-af37-1da0a7bdc0ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.612764 Oct 15 03:56:48.095571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 971/2045] 10.222.0.30 () {62 vars in 1187 bytes} [Fri Oct 15 03:56:47 2021] POST /compute/v2.1/servers => generated 402 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 15 03:56:48.106881 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-217036b5-3981-40d4-b706-59e423184fa3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:48.107493 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-217036b5-3981-40d4-b706-59e423184fa3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:48.164775 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-217036b5-3981-40d4-b706-59e423184fa3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:48.172510 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-217036b5-3981-40d4-b706-59e423184fa3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:48.174041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-217036b5-3981-40d4-b706-59e423184fa3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:48.175110 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-217036b5-3981-40d4-b706-59e423184fa3 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc" status: 200 len: 1282 microversion: 2.20 time: 0.071938 Oct 15 03:56:48.175652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1075/2046] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:48 2021] GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:49.193303 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3fcaaaa7-b6e7-4a09-b7d7-edb2423eacf0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:49.194164 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3fcaaaa7-b6e7-4a09-b7d7-edb2423eacf0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:49.203346 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3fcaaaa7-b6e7-4a09-b7d7-edb2423eacf0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:49.203914 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3fcaaaa7-b6e7-4a09-b7d7-edb2423eacf0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:49.204758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3fcaaaa7-b6e7-4a09-b7d7-edb2423eacf0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:49.205270 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3fcaaaa7-b6e7-4a09-b7d7-edb2423eacf0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:49.286290 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3fcaaaa7-b6e7-4a09-b7d7-edb2423eacf0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:49.295779 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3fcaaaa7-b6e7-4a09-b7d7-edb2423eacf0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:49.297678 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3fcaaaa7-b6e7-4a09-b7d7-edb2423eacf0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:49.299001 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3fcaaaa7-b6e7-4a09-b7d7-edb2423eacf0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc" status: 200 len: 1340 microversion: 2.20 time: 0.109774 Oct 15 03:56:49.300398 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 972/2047] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:49 2021] GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc => generated 1340 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:50.319600 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-28f0d191-9b3b-42db-bbea-83b3895888e6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:50.320252 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-28f0d191-9b3b-42db-bbea-83b3895888e6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:50.332364 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28f0d191-9b3b-42db-bbea-83b3895888e6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:50.332907 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28f0d191-9b3b-42db-bbea-83b3895888e6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:50.333918 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28f0d191-9b3b-42db-bbea-83b3895888e6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:50.334515 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-28f0d191-9b3b-42db-bbea-83b3895888e6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:50.465383 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-e80dea6a-9a36-4cb8-9d1e-3e7c41038565 req-8fc0966c-e21a-4b8d-b390-ba444a4cd13c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "371d7064-a347-4a52-8bae-af61850faddc", "tag": "0c3a60a6-15ff-4a74-a593-ad48e184fbd1"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:56:50.467121 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:56:50.467121 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 03:56:50.476048 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-e80dea6a-9a36-4cb8-9d1e-3e7c41038565 req-8fc0966c-e21a-4b8d-b390-ba444a4cd13c service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:50.476771 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-e80dea6a-9a36-4cb8-9d1e-3e7c41038565 req-8fc0966c-e21a-4b8d-b390-ba444a4cd13c service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:50.489152 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-e80dea6a-9a36-4cb8-9d1e-3e7c41038565 req-8fc0966c-e21a-4b8d-b390-ba444a4cd13c service nova] Creating event network-changed:0c3a60a6-15ff-4a74-a593-ad48e184fbd1 for instance 371d7064-a347-4a52-8bae-af61850faddc on hv-cinder-81410 Oct 15 03:56:50.497829 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-e80dea6a-9a36-4cb8-9d1e-3e7c41038565 req-8fc0966c-e21a-4b8d-b390-ba444a4cd13c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124572 Oct 15 03:56:50.498655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 973/2048] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:56:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:56:50.602314 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-28f0d191-9b3b-42db-bbea-83b3895888e6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:50.609844 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-28f0d191-9b3b-42db-bbea-83b3895888e6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:50.611321 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-28f0d191-9b3b-42db-bbea-83b3895888e6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:50.612415 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-28f0d191-9b3b-42db-bbea-83b3895888e6 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc" status: 200 len: 1408 microversion: 2.20 time: 0.297788 Oct 15 03:56:50.612954 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1076/2049] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:50 2021] GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc => generated 1408 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:51.033259 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:56:51.033784 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 03:56:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:56:51.630380 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-078806d7-3465-476a-b91a-029bf2371d08 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:51.631617 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-078806d7-3465-476a-b91a-029bf2371d08 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:51.637606 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-078806d7-3465-476a-b91a-029bf2371d08 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:51.638059 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-078806d7-3465-476a-b91a-029bf2371d08 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:51.638821 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-078806d7-3465-476a-b91a-029bf2371d08 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:51.639253 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-078806d7-3465-476a-b91a-029bf2371d08 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:51.760247 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-078806d7-3465-476a-b91a-029bf2371d08 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:51.767732 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-078806d7-3465-476a-b91a-029bf2371d08 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:51.769212 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-078806d7-3465-476a-b91a-029bf2371d08 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:51.770289 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-078806d7-3465-476a-b91a-029bf2371d08 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc" status: 200 len: 1408 microversion: 2.20 time: 0.144009 Oct 15 03:56:51.770821 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 974/2050] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:51 2021] GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc => generated 1408 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:52.788093 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-22f58ef1-29f0-4a4e-ba4a-181b5c5faa2c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:52.788699 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-22f58ef1-29f0-4a4e-ba4a-181b5c5faa2c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:52.794464 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-22f58ef1-29f0-4a4e-ba4a-181b5c5faa2c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:52.794905 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-22f58ef1-29f0-4a4e-ba4a-181b5c5faa2c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:52.795646 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-22f58ef1-29f0-4a4e-ba4a-181b5c5faa2c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:52.796094 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-22f58ef1-29f0-4a4e-ba4a-181b5c5faa2c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:52.915191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-22f58ef1-29f0-4a4e-ba4a-181b5c5faa2c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:52.922667 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-22f58ef1-29f0-4a4e-ba4a-181b5c5faa2c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:52.924170 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-22f58ef1-29f0-4a4e-ba4a-181b5c5faa2c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:52.925250 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-22f58ef1-29f0-4a4e-ba4a-181b5c5faa2c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc" status: 200 len: 1408 microversion: 2.20 time: 0.141516 Oct 15 03:56:52.925793 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1077/2051] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:52 2021] GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc => generated 1408 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:53.942607 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-338f4f36-ff99-4afe-a2a6-5a01681872e7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:53.943212 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-338f4f36-ff99-4afe-a2a6-5a01681872e7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:53.949065 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-338f4f36-ff99-4afe-a2a6-5a01681872e7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:53.949514 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-338f4f36-ff99-4afe-a2a6-5a01681872e7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:53.950278 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-338f4f36-ff99-4afe-a2a6-5a01681872e7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:53.950709 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-338f4f36-ff99-4afe-a2a6-5a01681872e7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:54.071914 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-338f4f36-ff99-4afe-a2a6-5a01681872e7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:54.079947 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-338f4f36-ff99-4afe-a2a6-5a01681872e7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:54.081438 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-338f4f36-ff99-4afe-a2a6-5a01681872e7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:54.082532 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-338f4f36-ff99-4afe-a2a6-5a01681872e7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc" status: 200 len: 1408 microversion: 2.20 time: 0.143685 Oct 15 03:56:54.083079 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 975/2052] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:53 2021] GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc => generated 1408 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:55.099972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a03bcb82-42f0-4685-9ca2-25aa07a8befe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:55.100579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a03bcb82-42f0-4685-9ca2-25aa07a8befe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:55.106306 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a03bcb82-42f0-4685-9ca2-25aa07a8befe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:55.106754 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a03bcb82-42f0-4685-9ca2-25aa07a8befe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:55.107538 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a03bcb82-42f0-4685-9ca2-25aa07a8befe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:55.107999 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a03bcb82-42f0-4685-9ca2-25aa07a8befe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:55.223066 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a03bcb82-42f0-4685-9ca2-25aa07a8befe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:55.231187 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a03bcb82-42f0-4685-9ca2-25aa07a8befe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:55.232712 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a03bcb82-42f0-4685-9ca2-25aa07a8befe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:55.233799 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a03bcb82-42f0-4685-9ca2-25aa07a8befe tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc" status: 200 len: 1408 microversion: 2.20 time: 0.137540 Oct 15 03:56:55.234335 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1078/2053] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:55 2021] GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc => generated 1408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:55.516193 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-cc2c3b8e-9d0a-4241-a6af-3e2b272f0dad req-287d3f59-42f1-4fb5-aea3-2daa6dd3a3e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "371d7064-a347-4a52-8bae-af61850faddc", "name": "network-vif-plugged", "status": "completed", "tag": "0c3a60a6-15ff-4a74-a593-ad48e184fbd1"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:56:55.518625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:56:55.518625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 03:56:55.526217 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-cc2c3b8e-9d0a-4241-a6af-3e2b272f0dad req-287d3f59-42f1-4fb5-aea3-2daa6dd3a3e5 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:55.526654 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-cc2c3b8e-9d0a-4241-a6af-3e2b272f0dad req-287d3f59-42f1-4fb5-aea3-2daa6dd3a3e5 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:55.537610 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-cc2c3b8e-9d0a-4241-a6af-3e2b272f0dad req-287d3f59-42f1-4fb5-aea3-2daa6dd3a3e5 service nova] Creating event network-vif-plugged:0c3a60a6-15ff-4a74-a593-ad48e184fbd1 for instance 371d7064-a347-4a52-8bae-af61850faddc on hv-cinder-81410 Oct 15 03:56:55.542570 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-cc2c3b8e-9d0a-4241-a6af-3e2b272f0dad req-287d3f59-42f1-4fb5-aea3-2daa6dd3a3e5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087966 Oct 15 03:56:55.543125 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 976/2054] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:56:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:56:56.251835 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-87a626bc-c39b-40f3-8c96-140eee0e2124 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:56.252443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-87a626bc-c39b-40f3-8c96-140eee0e2124 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:56.258798 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-87a626bc-c39b-40f3-8c96-140eee0e2124 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:56.259247 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-87a626bc-c39b-40f3-8c96-140eee0e2124 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:56.260094 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-87a626bc-c39b-40f3-8c96-140eee0e2124 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:56.260529 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-87a626bc-c39b-40f3-8c96-140eee0e2124 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:56.376397 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-87a626bc-c39b-40f3-8c96-140eee0e2124 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:56.384544 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-87a626bc-c39b-40f3-8c96-140eee0e2124 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:56.386032 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-87a626bc-c39b-40f3-8c96-140eee0e2124 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:56.387110 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-87a626bc-c39b-40f3-8c96-140eee0e2124 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc" status: 200 len: 1408 microversion: 2.20 time: 0.139034 Oct 15 03:56:56.387650 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1079/2055] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:56 2021] GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc => generated 1408 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:57.404847 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ab15edf9-0282-47bd-8c5f-06f114524831 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:57.405537 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ab15edf9-0282-47bd-8c5f-06f114524831 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:57.411435 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ab15edf9-0282-47bd-8c5f-06f114524831 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:57.411940 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ab15edf9-0282-47bd-8c5f-06f114524831 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:57.412690 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ab15edf9-0282-47bd-8c5f-06f114524831 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:57.413116 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ab15edf9-0282-47bd-8c5f-06f114524831 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:57.529841 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ab15edf9-0282-47bd-8c5f-06f114524831 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:57.537393 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ab15edf9-0282-47bd-8c5f-06f114524831 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:57.538871 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ab15edf9-0282-47bd-8c5f-06f114524831 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 03:56:57.540060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ab15edf9-0282-47bd-8c5f-06f114524831 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc" status: 200 len: 1600 microversion: 2.20 time: 0.139224 Oct 15 03:56:57.540602 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 977/2056] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 03:56:57 2021] GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc => generated 1600 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:56:57.556740 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-126730ad-f6af-43b4-b0c7-d99264cfe03c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:56:57.557230 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-126730ad-f6af-43b4-b0c7-d99264cfe03c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:57.562788 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-126730ad-f6af-43b4-b0c7-d99264cfe03c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:57.563229 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-126730ad-f6af-43b4-b0c7-d99264cfe03c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:57.564006 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-126730ad-f6af-43b4-b0c7-d99264cfe03c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:57.564437 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-126730ad-f6af-43b4-b0c7-d99264cfe03c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:57.639743 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-126730ad-f6af-43b4-b0c7-d99264cfe03c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.086549 Oct 15 03:56:57.640308 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1080/2057] 10.222.0.30 () {60 vars in 1315 bytes} [Fri Oct 15 03:56:57 2021] GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:56:58.785153 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7e0f9a6f-fddd-48e4-8795-0351f3025291 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:56:58.786308 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7e0f9a6f-fddd-48e4-8795-0351f3025291 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:58.787269 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-ee251394-2ff9-4141-b5f4-5522f8cda03b req-fc11f50a-cbdd-4dc6-bb46-4abf80ff916b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "371d7064-a347-4a52-8bae-af61850faddc", "tag": "0c3a60a6-15ff-4a74-a593-ad48e184fbd1"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:56:58.788796 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:56:58.788796 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 03:56:58.792721 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7e0f9a6f-fddd-48e4-8795-0351f3025291 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:58.793238 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7e0f9a6f-fddd-48e4-8795-0351f3025291 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:58.794079 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7e0f9a6f-fddd-48e4-8795-0351f3025291 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:58.794585 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7e0f9a6f-fddd-48e4-8795-0351f3025291 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:58.798393 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-ee251394-2ff9-4141-b5f4-5522f8cda03b req-fc11f50a-cbdd-4dc6-bb46-4abf80ff916b service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:58.799861 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-ee251394-2ff9-4141-b5f4-5522f8cda03b req-fc11f50a-cbdd-4dc6-bb46-4abf80ff916b service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:58.812933 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-ee251394-2ff9-4141-b5f4-5522f8cda03b req-fc11f50a-cbdd-4dc6-bb46-4abf80ff916b service nova] Creating event network-changed:0c3a60a6-15ff-4a74-a593-ad48e184fbd1 for instance 371d7064-a347-4a52-8bae-af61850faddc on hv-cinder-81410 Oct 15 03:56:58.820121 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-ee251394-2ff9-4141-b5f4-5522f8cda03b req-fc11f50a-cbdd-4dc6-bb46-4abf80ff916b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036190 Oct 15 03:56:58.821278 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1081/2058] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 03:56:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 03:56:58.862450 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7e0f9a6f-fddd-48e4-8795-0351f3025291 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 14 microversion: 2.20 time: 0.081114 Oct 15 03:56:58.863394 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 978/2059] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:56:58 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:56:59.874625 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c9abed1b-ac1f-4147-98e0-fa72a546bf49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:56:59.875788 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c9abed1b-ac1f-4147-98e0-fa72a546bf49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:56:59.883417 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c9abed1b-ac1f-4147-98e0-fa72a546bf49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:59.884838 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c9abed1b-ac1f-4147-98e0-fa72a546bf49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:59.885871 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c9abed1b-ac1f-4147-98e0-fa72a546bf49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:56:59.886359 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c9abed1b-ac1f-4147-98e0-fa72a546bf49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:56:59.942605 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c9abed1b-ac1f-4147-98e0-fa72a546bf49 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 14 microversion: 2.20 time: 0.072428 Oct 15 03:56:59.943965 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1082/2060] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:56:59 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 03:57:00.954146 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c7abe4bf-3171-46e6-b1ca-f6e07b5921b2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:00.955133 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c7abe4bf-3171-46e6-b1ca-f6e07b5921b2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:00.961515 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c7abe4bf-3171-46e6-b1ca-f6e07b5921b2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:00.961959 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c7abe4bf-3171-46e6-b1ca-f6e07b5921b2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:00.962706 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c7abe4bf-3171-46e6-b1ca-f6e07b5921b2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:00.963131 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c7abe4bf-3171-46e6-b1ca-f6e07b5921b2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:01.037901 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c7abe4bf-3171-46e6-b1ca-f6e07b5921b2 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 14 microversion: 2.20 time: 0.087825 Oct 15 03:57:01.038750 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 979/2061] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:00 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:57:02.049329 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-12f4758b-7281-49cb-a542-06a102632bbc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:02.050265 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-12f4758b-7281-49cb-a542-06a102632bbc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:02.056691 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-12f4758b-7281-49cb-a542-06a102632bbc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:02.057145 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-12f4758b-7281-49cb-a542-06a102632bbc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:02.057902 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-12f4758b-7281-49cb-a542-06a102632bbc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:02.058338 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-12f4758b-7281-49cb-a542-06a102632bbc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:02.116628 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-12f4758b-7281-49cb-a542-06a102632bbc tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 14 microversion: 2.20 time: 0.071323 Oct 15 03:57:02.117205 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1083/2062] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:02 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:57:03.127543 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d0e56f39-6fdf-4cc7-beb5-1d6448939749 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:03.128562 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d0e56f39-6fdf-4cc7-beb5-1d6448939749 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:03.134563 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d0e56f39-6fdf-4cc7-beb5-1d6448939749 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:03.135005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d0e56f39-6fdf-4cc7-beb5-1d6448939749 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:03.135785 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d0e56f39-6fdf-4cc7-beb5-1d6448939749 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:03.136218 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d0e56f39-6fdf-4cc7-beb5-1d6448939749 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:03.193541 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d0e56f39-6fdf-4cc7-beb5-1d6448939749 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 14 microversion: 2.20 time: 0.069854 Oct 15 03:57:03.194108 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 980/2063] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:03 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:57:04.205068 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-95e5e71e-e4f9-4225-beba-646869485c8a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:04.206136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-95e5e71e-e4f9-4225-beba-646869485c8a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:04.213064 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-95e5e71e-e4f9-4225-beba-646869485c8a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:04.213520 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-95e5e71e-e4f9-4225-beba-646869485c8a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:04.214280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-95e5e71e-e4f9-4225-beba-646869485c8a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:04.214718 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-95e5e71e-e4f9-4225-beba-646869485c8a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:04.270074 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-95e5e71e-e4f9-4225-beba-646869485c8a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 14 microversion: 2.20 time: 0.069157 Oct 15 03:57:04.270962 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1084/2064] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:04 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:57:05.281884 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-bfda4750-6ee0-4274-8051-e27e6d01ba5e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:05.282891 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-bfda4750-6ee0-4274-8051-e27e6d01ba5e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:05.289880 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfda4750-6ee0-4274-8051-e27e6d01ba5e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:05.290321 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfda4750-6ee0-4274-8051-e27e6d01ba5e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:05.291071 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfda4750-6ee0-4274-8051-e27e6d01ba5e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:05.291496 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bfda4750-6ee0-4274-8051-e27e6d01ba5e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:05.345797 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-bfda4750-6ee0-4274-8051-e27e6d01ba5e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 14 microversion: 2.20 time: 0.067775 Oct 15 03:57:05.346306 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 981/2065] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:05 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:57:06.358535 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d006f1c3-a106-4c66-b813-45caa62d76c1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:06.359486 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d006f1c3-a106-4c66-b813-45caa62d76c1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:06.366533 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d006f1c3-a106-4c66-b813-45caa62d76c1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:06.366983 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d006f1c3-a106-4c66-b813-45caa62d76c1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:06.367763 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d006f1c3-a106-4c66-b813-45caa62d76c1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:06.368197 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d006f1c3-a106-4c66-b813-45caa62d76c1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:06.433217 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d006f1c3-a106-4c66-b813-45caa62d76c1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 14 microversion: 2.20 time: 0.078704 Oct 15 03:57:06.433811 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1085/2066] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:06 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:57:07.445222 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a9db55f8-8c10-492d-925a-4e890f45a998 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:07.446176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a9db55f8-8c10-492d-925a-4e890f45a998 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:07.452875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a9db55f8-8c10-492d-925a-4e890f45a998 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:07.453327 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a9db55f8-8c10-492d-925a-4e890f45a998 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:07.454086 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a9db55f8-8c10-492d-925a-4e890f45a998 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:07.454521 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a9db55f8-8c10-492d-925a-4e890f45a998 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:07.512489 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a9db55f8-8c10-492d-925a-4e890f45a998 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 14 microversion: 2.20 time: 0.071786 Oct 15 03:57:07.513110 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 982/2067] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:07 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 03:57:08.523612 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0f7cc026-696c-4895-ae4c-a32b9e150dcf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:08.524641 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0f7cc026-696c-4895-ae4c-a32b9e150dcf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:08.530919 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0f7cc026-696c-4895-ae4c-a32b9e150dcf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:08.531365 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0f7cc026-696c-4895-ae4c-a32b9e150dcf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:08.532157 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0f7cc026-696c-4895-ae4c-a32b9e150dcf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:08.532589 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0f7cc026-696c-4895-ae4c-a32b9e150dcf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:08.609183 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0f7cc026-696c-4895-ae4c-a32b9e150dcf tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 5045 microversion: 2.20 time: 0.089469 Oct 15 03:57:08.609959 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1086/2068] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:08 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 5045 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 03:57:09.620717 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b22043db-3a1d-4307-b933-456843e96596 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:09.621621 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b22043db-3a1d-4307-b933-456843e96596 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:09.627991 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b22043db-3a1d-4307-b933-456843e96596 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:09.628442 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b22043db-3a1d-4307-b933-456843e96596 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:09.629205 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b22043db-3a1d-4307-b933-456843e96596 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:09.629644 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b22043db-3a1d-4307-b933-456843e96596 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:09.696233 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b22043db-3a1d-4307-b933-456843e96596 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 15025 microversion: 2.20 time: 0.079599 Oct 15 03:57:09.696818 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 983/2069] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:09 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 15025 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:10.708248 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-9378c702-ec5e-4722-9b56-f1db1582011b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:10.709814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-9378c702-ec5e-4722-9b56-f1db1582011b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:10.716169 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9378c702-ec5e-4722-9b56-f1db1582011b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:10.716620 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9378c702-ec5e-4722-9b56-f1db1582011b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:10.717375 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9378c702-ec5e-4722-9b56-f1db1582011b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:10.717810 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-9378c702-ec5e-4722-9b56-f1db1582011b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:10.787169 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-9378c702-ec5e-4722-9b56-f1db1582011b tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 18608 microversion: 2.20 time: 0.082945 Oct 15 03:57:10.788385 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1087/2070] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:10 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 18608 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:11.799429 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-242db052-2935-4456-8d2e-1e3769f4469e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:11.800493 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-242db052-2935-4456-8d2e-1e3769f4469e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:11.806819 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-242db052-2935-4456-8d2e-1e3769f4469e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:11.807267 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-242db052-2935-4456-8d2e-1e3769f4469e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:11.808070 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-242db052-2935-4456-8d2e-1e3769f4469e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:11.808501 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-242db052-2935-4456-8d2e-1e3769f4469e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:11.883937 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-242db052-2935-4456-8d2e-1e3769f4469e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 19539 microversion: 2.20 time: 0.088367 Oct 15 03:57:11.884555 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 984/2071] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:11 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 19539 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:12.894732 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7f541ef1-685b-49f5-a193-11f6821d5dd0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:12.895946 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7f541ef1-685b-49f5-a193-11f6821d5dd0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:12.902738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7f541ef1-685b-49f5-a193-11f6821d5dd0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:12.903191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7f541ef1-685b-49f5-a193-11f6821d5dd0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:12.904076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7f541ef1-685b-49f5-a193-11f6821d5dd0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:12.904517 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7f541ef1-685b-49f5-a193-11f6821d5dd0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:12.977432 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7f541ef1-685b-49f5-a193-11f6821d5dd0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 22494 microversion: 2.20 time: 0.086566 Oct 15 03:57:12.978034 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1088/2072] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:12 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 22494 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:13.988914 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ae116763-1d68-4c3c-b8bd-62c275849c9e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:13.989920 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ae116763-1d68-4c3c-b8bd-62c275849c9e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:13.997014 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae116763-1d68-4c3c-b8bd-62c275849c9e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:13.997452 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae116763-1d68-4c3c-b8bd-62c275849c9e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:13.998217 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae116763-1d68-4c3c-b8bd-62c275849c9e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:13.998651 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ae116763-1d68-4c3c-b8bd-62c275849c9e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:14.068144 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ae116763-1d68-4c3c-b8bd-62c275849c9e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 23803 microversion: 2.20 time: 0.083043 Oct 15 03:57:14.071864 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 985/2073] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:13 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 23803 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:15.080345 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-58b2ea6c-892e-451f-9f33-4455f21abb42 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:15.081443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-58b2ea6c-892e-451f-9f33-4455f21abb42 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:15.088446 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-58b2ea6c-892e-451f-9f33-4455f21abb42 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:15.088900 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-58b2ea6c-892e-451f-9f33-4455f21abb42 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:15.089666 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-58b2ea6c-892e-451f-9f33-4455f21abb42 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:15.090106 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-58b2ea6c-892e-451f-9f33-4455f21abb42 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:15.161484 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-58b2ea6c-892e-451f-9f33-4455f21abb42 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 25557 microversion: 2.20 time: 0.085427 Oct 15 03:57:15.162117 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1089/2074] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:15 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 25557 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:16.173290 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-dcbc4e95-2ed4-4975-b66e-9fc25401e9ef tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:16.174296 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-dcbc4e95-2ed4-4975-b66e-9fc25401e9ef tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:16.180592 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dcbc4e95-2ed4-4975-b66e-9fc25401e9ef tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:16.181045 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dcbc4e95-2ed4-4975-b66e-9fc25401e9ef tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:16.181809 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dcbc4e95-2ed4-4975-b66e-9fc25401e9ef tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:16.182249 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dcbc4e95-2ed4-4975-b66e-9fc25401e9ef tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:16.257013 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-dcbc4e95-2ed4-4975-b66e-9fc25401e9ef tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 26991 microversion: 2.20 time: 0.087549 Oct 15 03:57:16.257668 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 986/2075] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:16 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 26991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:17.268933 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e69e1915-a917-4c8d-bd74-b2af38a5c058 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:17.269939 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e69e1915-a917-4c8d-bd74-b2af38a5c058 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:17.276347 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e69e1915-a917-4c8d-bd74-b2af38a5c058 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:17.276799 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e69e1915-a917-4c8d-bd74-b2af38a5c058 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:17.277561 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e69e1915-a917-4c8d-bd74-b2af38a5c058 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:17.277998 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e69e1915-a917-4c8d-bd74-b2af38a5c058 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:17.363956 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e69e1915-a917-4c8d-bd74-b2af38a5c058 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 27716 microversion: 2.20 time: 0.098918 Oct 15 03:57:17.364567 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1090/2076] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:17 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 27716 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:18.376403 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-84cdc068-a6f8-44c9-88c8-9012cedf7c99 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:18.377402 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-84cdc068-a6f8-44c9-88c8-9012cedf7c99 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:18.384253 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-84cdc068-a6f8-44c9-88c8-9012cedf7c99 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:18.384698 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-84cdc068-a6f8-44c9-88c8-9012cedf7c99 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:18.385451 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-84cdc068-a6f8-44c9-88c8-9012cedf7c99 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:18.385886 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-84cdc068-a6f8-44c9-88c8-9012cedf7c99 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:18.458620 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-84cdc068-a6f8-44c9-88c8-9012cedf7c99 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 28196 microversion: 2.20 time: 0.086148 Oct 15 03:57:18.459223 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 987/2077] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:18 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 28196 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:19.471092 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-359d25c8-847a-422e-9194-e06d1beec1b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:19.472136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-359d25c8-847a-422e-9194-e06d1beec1b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:19.479063 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-359d25c8-847a-422e-9194-e06d1beec1b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:19.479502 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-359d25c8-847a-422e-9194-e06d1beec1b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:19.480279 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-359d25c8-847a-422e-9194-e06d1beec1b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:19.480710 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-359d25c8-847a-422e-9194-e06d1beec1b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:19.542374 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-359d25c8-847a-422e-9194-e06d1beec1b7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 28196 microversion: 2.20 time: 0.075190 Oct 15 03:57:19.542972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1091/2078] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:19 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 28196 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:20.554197 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-704a65b8-0a9a-46f8-bcd8-2c1b1f398806 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:20.555214 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-704a65b8-0a9a-46f8-bcd8-2c1b1f398806 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:20.562123 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-704a65b8-0a9a-46f8-bcd8-2c1b1f398806 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:20.562593 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-704a65b8-0a9a-46f8-bcd8-2c1b1f398806 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:20.563350 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-704a65b8-0a9a-46f8-bcd8-2c1b1f398806 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:20.563802 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-704a65b8-0a9a-46f8-bcd8-2c1b1f398806 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:20.642026 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-704a65b8-0a9a-46f8-bcd8-2c1b1f398806 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 28487 microversion: 2.20 time: 0.091521 Oct 15 03:57:20.642831 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 988/2079] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:20 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 28487 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:21.654697 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a63712d7-5c0d-4d38-981c-843c5e0fc90c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:21.655613 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a63712d7-5c0d-4d38-981c-843c5e0fc90c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:21.661975 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a63712d7-5c0d-4d38-981c-843c5e0fc90c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:21.662421 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a63712d7-5c0d-4d38-981c-843c5e0fc90c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:21.663179 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a63712d7-5c0d-4d38-981c-843c5e0fc90c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:21.663616 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a63712d7-5c0d-4d38-981c-843c5e0fc90c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:21.754332 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a63712d7-5c0d-4d38-981c-843c5e0fc90c tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 28655 microversion: 2.20 time: 0.104267 Oct 15 03:57:21.754950 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1092/2080] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:21 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 28655 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:22.766338 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-656df177-a5fc-4c01-adfa-d1158683f8c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:22.767338 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-656df177-a5fc-4c01-adfa-d1158683f8c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:22.773732 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-656df177-a5fc-4c01-adfa-d1158683f8c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:22.774182 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-656df177-a5fc-4c01-adfa-d1158683f8c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:22.775448 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-656df177-a5fc-4c01-adfa-d1158683f8c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:22.775912 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-656df177-a5fc-4c01-adfa-d1158683f8c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:22.835642 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-656df177-a5fc-4c01-adfa-d1158683f8c7 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 28655 microversion: 2.20 time: 0.073198 Oct 15 03:57:22.836274 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 989/2081] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:22 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 28655 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:23.848290 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0d8d9cc9-4e58-4f26-a530-2edb32c889a0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:23.849293 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0d8d9cc9-4e58-4f26-a530-2edb32c889a0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:23.856195 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0d8d9cc9-4e58-4f26-a530-2edb32c889a0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:23.856649 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0d8d9cc9-4e58-4f26-a530-2edb32c889a0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:23.857402 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0d8d9cc9-4e58-4f26-a530-2edb32c889a0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:23.857836 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0d8d9cc9-4e58-4f26-a530-2edb32c889a0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:23.917446 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0d8d9cc9-4e58-4f26-a530-2edb32c889a0 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 28655 microversion: 2.20 time: 0.073172 Oct 15 03:57:23.918303 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1093/2082] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:23 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 28655 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 15 03:57:24.929570 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e1892e36-43d4-4f37-aaff-5ce287422380 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:24.930516 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e1892e36-43d4-4f37-aaff-5ce287422380 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:24.937357 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e1892e36-43d4-4f37-aaff-5ce287422380 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:24.937804 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e1892e36-43d4-4f37-aaff-5ce287422380 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:24.938583 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e1892e36-43d4-4f37-aaff-5ce287422380 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:24.938993 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e1892e36-43d4-4f37-aaff-5ce287422380 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:24.998878 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e1892e36-43d4-4f37-aaff-5ce287422380 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 28655 microversion: 2.20 time: 0.073313 Oct 15 03:57:24.999486 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 990/2083] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:24 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 28655 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:26.010606 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b44d8f16-6866-4d2c-9734-fd4f9d08f88f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:26.011604 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b44d8f16-6866-4d2c-9734-fd4f9d08f88f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:26.017959 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b44d8f16-6866-4d2c-9734-fd4f9d08f88f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:26.018408 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b44d8f16-6866-4d2c-9734-fd4f9d08f88f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:26.019163 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b44d8f16-6866-4d2c-9734-fd4f9d08f88f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:26.019594 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b44d8f16-6866-4d2c-9734-fd4f9d08f88f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:26.092270 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b44d8f16-6866-4d2c-9734-fd4f9d08f88f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 30707 microversion: 2.20 time: 0.086048 Oct 15 03:57:26.093076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1094/2084] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:26 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 30707 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:27.104170 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-384a30c6-98f7-4cac-a370-830bdd8366db tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:27.105174 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-384a30c6-98f7-4cac-a370-830bdd8366db tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:27.111399 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-384a30c6-98f7-4cac-a370-830bdd8366db tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:27.111887 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-384a30c6-98f7-4cac-a370-830bdd8366db tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:27.112656 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-384a30c6-98f7-4cac-a370-830bdd8366db tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:27.113090 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-384a30c6-98f7-4cac-a370-830bdd8366db tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:27.181517 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-384a30c6-98f7-4cac-a370-830bdd8366db tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 32707 microversion: 2.20 time: 0.080718 Oct 15 03:57:27.182156 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 991/2085] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:27 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 32707 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:28.192996 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-194498f7-4b8c-43da-9943-ad7c47519f8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:28.194005 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-194498f7-4b8c-43da-9943-ad7c47519f8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:28.200528 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-194498f7-4b8c-43da-9943-ad7c47519f8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:28.200978 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-194498f7-4b8c-43da-9943-ad7c47519f8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:28.202004 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-194498f7-4b8c-43da-9943-ad7c47519f8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:28.202440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-194498f7-4b8c-43da-9943-ad7c47519f8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:28.272095 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-194498f7-4b8c-43da-9943-ad7c47519f8e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 33835 microversion: 2.20 time: 0.083067 Oct 15 03:57:28.276318 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1095/2086] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:28 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 33835 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:29.284385 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e8e3a3cb-58b5-49e2-93ef-ccd65bc1edc9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:29.285501 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e8e3a3cb-58b5-49e2-93ef-ccd65bc1edc9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:29.292558 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e8e3a3cb-58b5-49e2-93ef-ccd65bc1edc9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:29.293005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e8e3a3cb-58b5-49e2-93ef-ccd65bc1edc9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:29.293761 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e8e3a3cb-58b5-49e2-93ef-ccd65bc1edc9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:29.294186 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e8e3a3cb-58b5-49e2-93ef-ccd65bc1edc9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:29.370909 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e8e3a3cb-58b5-49e2-93ef-ccd65bc1edc9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 35054 microversion: 2.20 time: 0.090420 Oct 15 03:57:29.371539 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 992/2087] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:29 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 35054 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:30.383136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b2f41a98-10a9-4c4a-8855-0c4a9224e5ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:30.384157 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b2f41a98-10a9-4c4a-8855-0c4a9224e5ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:30.390539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b2f41a98-10a9-4c4a-8855-0c4a9224e5ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:30.390983 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b2f41a98-10a9-4c4a-8855-0c4a9224e5ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:30.391764 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b2f41a98-10a9-4c4a-8855-0c4a9224e5ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:30.392200 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b2f41a98-10a9-4c4a-8855-0c4a9224e5ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:30.461416 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b2f41a98-10a9-4c4a-8855-0c4a9224e5ba tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 36331 microversion: 2.20 time: 0.082226 Oct 15 03:57:30.462086 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1096/2088] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:30 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 36331 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:31.473430 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5fbe9b2b-4549-4ac1-ab5a-e8b152c87647 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:31.474443 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5fbe9b2b-4549-4ac1-ab5a-e8b152c87647 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:31.480749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5fbe9b2b-4549-4ac1-ab5a-e8b152c87647 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:31.481175 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5fbe9b2b-4549-4ac1-ab5a-e8b152c87647 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:31.481929 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5fbe9b2b-4549-4ac1-ab5a-e8b152c87647 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:31.482357 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5fbe9b2b-4549-4ac1-ab5a-e8b152c87647 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:31.553535 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5fbe9b2b-4549-4ac1-ab5a-e8b152c87647 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 37980 microversion: 2.20 time: 0.083911 Oct 15 03:57:31.554065 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 993/2089] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:31 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 37980 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:32.566189 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e0d8301a-82a7-4e05-8c17-ba65670626cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:32.567157 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e0d8301a-82a7-4e05-8c17-ba65670626cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:32.574069 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0d8301a-82a7-4e05-8c17-ba65670626cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:32.574516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0d8301a-82a7-4e05-8c17-ba65670626cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:32.575276 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0d8301a-82a7-4e05-8c17-ba65670626cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:32.575727 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e0d8301a-82a7-4e05-8c17-ba65670626cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:32.651833 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e0d8301a-82a7-4e05-8c17-ba65670626cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 38213 microversion: 2.20 time: 0.089555 Oct 15 03:57:32.652472 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1097/2090] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:32 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 38213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:33.664328 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e02e9134-031b-4723-9665-4a16fbee71cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:33.665245 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e02e9134-031b-4723-9665-4a16fbee71cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:33.672190 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e02e9134-031b-4723-9665-4a16fbee71cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:33.672633 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e02e9134-031b-4723-9665-4a16fbee71cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:33.673388 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e02e9134-031b-4723-9665-4a16fbee71cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:33.673822 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e02e9134-031b-4723-9665-4a16fbee71cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:33.734205 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e02e9134-031b-4723-9665-4a16fbee71cb tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 38213 microversion: 2.20 time: 0.073817 Oct 15 03:57:33.735054 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 994/2091] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:33 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 38213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:34.746901 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-78337b17-8156-44c2-bb0e-f6030100c059 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:34.747964 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-78337b17-8156-44c2-bb0e-f6030100c059 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:34.754295 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-78337b17-8156-44c2-bb0e-f6030100c059 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:34.754746 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-78337b17-8156-44c2-bb0e-f6030100c059 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:34.755498 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-78337b17-8156-44c2-bb0e-f6030100c059 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:34.755978 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-78337b17-8156-44c2-bb0e-f6030100c059 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:34.814950 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-78337b17-8156-44c2-bb0e-f6030100c059 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 38213 microversion: 2.20 time: 0.072295 Oct 15 03:57:34.815598 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1098/2092] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:34 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 38213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:35.828163 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5bbe1ef1-2a05-498e-b54a-ce7eba58bb91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 03:57:35.829132 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5bbe1ef1-2a05-498e-b54a-ce7eba58bb91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:35.835545 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5bbe1ef1-2a05-498e-b54a-ce7eba58bb91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:35.836035 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5bbe1ef1-2a05-498e-b54a-ce7eba58bb91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:35.836804 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5bbe1ef1-2a05-498e-b54a-ce7eba58bb91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:35.837244 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5bbe1ef1-2a05-498e-b54a-ce7eba58bb91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:35.908647 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5bbe1ef1-2a05-498e-b54a-ce7eba58bb91 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action" status: 200 len: 38356 microversion: 2.20 time: 0.085360 Oct 15 03:57:35.909260 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 995/2093] 10.222.0.30 () {62 vars in 1318 bytes} [Fri Oct 15 03:57:35 2021] POST /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/action => generated 38356 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 15 03:57:35.919423 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-54e8014d-a9c5-4742-a4ae-ce4d328397ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 03:57:35.920039 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-54e8014d-a9c5-4742-a4ae-ce4d328397ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 03:57:35.926473 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-54e8014d-a9c5-4742-a4ae-ce4d328397ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:35.926921 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-54e8014d-a9c5-4742-a4ae-ce4d328397ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:35.927694 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-54e8014d-a9c5-4742-a4ae-ce4d328397ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 03:57:35.928139 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-54e8014d-a9c5-4742-a4ae-ce4d328397ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 03:57:35.952497 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-54e8014d-a9c5-4742-a4ae-ce4d328397ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/ips" status: 200 len: 151 microversion: 2.20 time: 0.037057 Oct 15 03:57:35.953046 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1099/2094] 10.222.0.30 () {60 vars in 1288 bytes} [Fri Oct 15 03:57:35 2021] GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 03:59:58.143593 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:59:58.144202 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 03:59:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 03:59:59.050364 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 03:59:59.050857 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 03:59:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:00:05.689620 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:00:05.690104 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 04:00:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:00:10.693795 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:00:10.694269 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 04:00:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:00:11.051840 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:00:11.052538 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 04:00:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:01:50.837875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:01:50.838480 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 04:01:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:03:18.160749 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:03:18.161269 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 04:03:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:03:19.066683 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:03:19.067201 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 04:03:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:03:25.707065 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:03:25.707597 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 04:03:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:03:30.712666 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:03:30.713146 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 04:03:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:03:31.069688 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:03:31.070105 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 04:03:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:03:36.739078 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5cc85daf-8c99-49f7-9b26-c6658a21a2b7] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 15 04:03:36.743045 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-16c94a04-10ee-4e1c-85fc-a875a863f2f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:03:36.743623 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-16c94a04-10ee-4e1c-85fc-a875a863f2f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:03:36.749713 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-16c94a04-10ee-4e1c-85fc-a875a863f2f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:03:36.750157 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-16c94a04-10ee-4e1c-85fc-a875a863f2f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:03:36.750927 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-16c94a04-10ee-4e1c-85fc-a875a863f2f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:03:36.751994 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-16c94a04-10ee-4e1c-85fc-a875a863f2f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:03:36.775391 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-16c94a04-10ee-4e1c-85fc-a875a863f2f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Going to try to terminate instance {{(pid=120899) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 15 04:03:36.847404 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-16c94a04-10ee-4e1c-85fc-a875a863f2f9 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "DELETE /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc" status: 204 len: 0 microversion: 2.20 time: 0.110578 Oct 15 04:03:36.847988 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 996/2095] 10.222.0.30 () {60 vars in 1279 bytes} [Fri Oct 15 04:03:36 2021] DELETE /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 15 04:03:36.855382 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: ERROR oslo.messaging._drivers.impl_rabbit [-] [62b4e7dd-437c-4699-815c-b81f4b01b864] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 15 04:03:36.858871 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d32dd493-f122-4ae6-a6be-1f6547a9e547 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:03:36.859507 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d32dd493-f122-4ae6-a6be-1f6547a9e547 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:03:36.865779 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d32dd493-f122-4ae6-a6be-1f6547a9e547 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:03:36.866223 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d32dd493-f122-4ae6-a6be-1f6547a9e547 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:03:36.866967 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d32dd493-f122-4ae6-a6be-1f6547a9e547 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:03:36.867396 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d32dd493-f122-4ae6-a6be-1f6547a9e547 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:03:37.161302 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d32dd493-f122-4ae6-a6be-1f6547a9e547 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:03:37.168915 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d32dd493-f122-4ae6-a6be-1f6547a9e547 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:03:37.170391 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d32dd493-f122-4ae6-a6be-1f6547a9e547 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:03:37.171520 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d32dd493-f122-4ae6-a6be-1f6547a9e547 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc" status: 200 len: 1724 microversion: 2.20 time: 0.318935 Oct 15 04:03:37.172080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1100/2096] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 04:03:36 2021] GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc => generated 1724 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 04:03:38.094481 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] [5cc85daf-8c99-49f7-9b26-c6658a21a2b7] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 39816. Oct 15 04:03:38.154706 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-1d4a0c22-5e34-4cce-bca0-43adab51c556 req-7cee3dd8-41e9-40a8-b3d4-1b57895a152e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "371d7064-a347-4a52-8bae-af61850faddc", "name": "network-vif-deleted", "tag": "0c3a60a6-15ff-4a74-a593-ad48e184fbd1"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:03:38.156408 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:03:38.156408 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 04:03:38.172943 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-1d4a0c22-5e34-4cce-bca0-43adab51c556 req-7cee3dd8-41e9-40a8-b3d4-1b57895a152e service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:03:38.173807 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-1d4a0c22-5e34-4cce-bca0-43adab51c556 req-7cee3dd8-41e9-40a8-b3d4-1b57895a152e service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:03:38.185583 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-1d4a0c22-5e34-4cce-bca0-43adab51c556 req-7cee3dd8-41e9-40a8-b3d4-1b57895a152e service nova] Creating event network-vif-deleted:0c3a60a6-15ff-4a74-a593-ad48e184fbd1 for instance 371d7064-a347-4a52-8bae-af61850faddc on hv-cinder-81410 Oct 15 04:03:38.192289 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6eccb01b-a5cd-428d-971a-e8000c83147f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:03:38.193705 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6eccb01b-a5cd-428d-971a-e8000c83147f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:03:38.202472 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-1d4a0c22-5e34-4cce-bca0-43adab51c556 req-7cee3dd8-41e9-40a8-b3d4-1b57895a152e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130256 Oct 15 04:03:38.203547 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 997/2097] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:03:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:03:38.216085 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6eccb01b-a5cd-428d-971a-e8000c83147f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:03:38.216951 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6eccb01b-a5cd-428d-971a-e8000c83147f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:03:38.217942 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6eccb01b-a5cd-428d-971a-e8000c83147f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:03:38.218580 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6eccb01b-a5cd-428d-971a-e8000c83147f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:03:38.229337 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] [62b4e7dd-437c-4699-815c-b81f4b01b864] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 39822. Oct 15 04:03:38.269125 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6eccb01b-a5cd-428d-971a-e8000c83147f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:03:38.269574 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6eccb01b-a5cd-428d-971a-e8000c83147f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:03:38.270029 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.objects.instance [None req-6eccb01b-a5cd-428d-971a-e8000c83147f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lazy-loading 'fault' on Instance uuid 371d7064-a347-4a52-8bae-af61850faddc {{(pid=120897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 04:03:38.310117 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6eccb01b-a5cd-428d-971a-e8000c83147f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:03:38.318537 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6eccb01b-a5cd-428d-971a-e8000c83147f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:03:38.320057 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6eccb01b-a5cd-428d-971a-e8000c83147f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd795b4264cbe4aff82f5a2b0275ca972', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4923cacd2a4baea3b5dcf9522e9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:03:38.321448 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6eccb01b-a5cd-428d-971a-e8000c83147f tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc" status: 200 len: 1372 microversion: 2.20 time: 0.134951 Oct 15 04:03:38.330011 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1101/2098] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 04:03:38 2021] GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc => generated 1372 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 04:03:39.340619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6499e895-a221-40e3-a941-bc91af042d80 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:03:39.341321 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6499e895-a221-40e3-a941-bc91af042d80 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:03:39.347847 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6499e895-a221-40e3-a941-bc91af042d80 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:03:39.348305 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6499e895-a221-40e3-a941-bc91af042d80 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:03:39.349073 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6499e895-a221-40e3-a941-bc91af042d80 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:03:39.349512 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6499e895-a221-40e3-a941-bc91af042d80 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:03:39.362886 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-6499e895-a221-40e3-a941-bc91af042d80 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] HTTP exception thrown: Instance 371d7064-a347-4a52-8bae-af61850faddc could not be found. Oct 15 04:03:39.363466 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6499e895-a221-40e3-a941-bc91af042d80 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Returning 404 to user: Instance 371d7064-a347-4a52-8bae-af61850faddc could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 04:03:39.364302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6499e895-a221-40e3-a941-bc91af042d80 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc" status: 404 len: 111 microversion: 2.20 time: 0.028351 Oct 15 04:03:39.364810 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 998/2099] 10.222.0.30 () {60 vars in 1276 bytes} [Fri Oct 15 04:03:39 2021] GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 15 04:03:39.372677 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4dae3702-b06b-4fc1-8fab-95350542a20a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '.version_select at 0x7f4abcb08a60>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:03:39.392180 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4dae3702-b06b-4fc1-8fab-95350542a20a tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1448836334" status: 204 len: 0 microversion: 2.20 time: 0.023062 Oct 15 04:03:39.392702 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1102/2100] 10.222.0.30 () {60 vars in 1261 bytes} [Fri Oct 15 04:03:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1448836334 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 15 04:05:10.854983 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:05:10.855466 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 04:05:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:06:38.178478 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:06:38.179056 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 04:06:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:06:39.083903 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:06:39.084386 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 04:06:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:06:45.724245 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:06:45.724828 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 04:06:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:06:50.731352 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:06:50.731953 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 04:06:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:06:51.087105 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:06:51.087551 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 04:06:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:07:49.029807 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5cc85daf-8c99-49f7-9b26-c6658a21a2b7] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 15 04:07:49.033339 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9cd2bafe-fe8d-470d-9132-aadb359ba21e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:07:49.033822 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9cd2bafe-fe8d-470d-9132-aadb359ba21e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:07:49.040177 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9cd2bafe-fe8d-470d-9132-aadb359ba21e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:49.040618 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9cd2bafe-fe8d-470d-9132-aadb359ba21e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:49.041364 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9cd2bafe-fe8d-470d-9132-aadb359ba21e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:49.041788 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9cd2bafe-fe8d-470d-9132-aadb359ba21e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:49.065079 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9cd2bafe-fe8d-470d-9132-aadb359ba21e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Going to try to terminate instance {{(pid=120899) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 15 04:07:49.134807 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9cd2bafe-fe8d-470d-9132-aadb359ba21e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 204 len: 0 microversion: 2.1 time: 0.107059 Oct 15 04:07:49.135768 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 999/2101] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 04:07:49 2021] DELETE /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 04:07:49.141803 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: ERROR oslo.messaging._drivers.impl_rabbit [-] [62b4e7dd-437c-4699-815c-b81f4b01b864] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 15 04:07:49.145206 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e35dee47-1a4f-4cfa-b0f8-999a2f74ba14 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:07:49.145807 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e35dee47-1a4f-4cfa-b0f8-999a2f74ba14 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:07:49.152500 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e35dee47-1a4f-4cfa-b0f8-999a2f74ba14 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:49.153454 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e35dee47-1a4f-4cfa-b0f8-999a2f74ba14 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:49.154208 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e35dee47-1a4f-4cfa-b0f8-999a2f74ba14 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:49.154694 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e35dee47-1a4f-4cfa-b0f8-999a2f74ba14 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:49.271022 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e35dee47-1a4f-4cfa-b0f8-999a2f74ba14 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:07:49.278741 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e35dee47-1a4f-4cfa-b0f8-999a2f74ba14 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1508 microversion: 2.1 time: 0.138507 Oct 15 04:07:49.279287 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1103/2102] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:07:49 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1508 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:07:50.132221 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-5fadced1-8731-4460-9930-9df34c4ebead req-f2467e59-eec1-49a0-9ad3-6ad461f83255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7977d03b-ee0f-485a-a1c1-e711d9df1a46", "name": "network-vif-deleted", "tag": "a8547089-bb71-4ecb-a5da-ded0a0bf878f"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:07:50.133843 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:07:50.133843 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 04:07:50.159235 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-5fadced1-8731-4460-9930-9df34c4ebead req-f2467e59-eec1-49a0-9ad3-6ad461f83255 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:50.159704 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-5fadced1-8731-4460-9930-9df34c4ebead req-f2467e59-eec1-49a0-9ad3-6ad461f83255 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:50.171269 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-5fadced1-8731-4460-9930-9df34c4ebead req-f2467e59-eec1-49a0-9ad3-6ad461f83255 service nova] Creating event network-vif-deleted:a8547089-bb71-4ecb-a5da-ded0a0bf878f for instance 7977d03b-ee0f-485a-a1c1-e711d9df1a46 on hv-cinder-81410 Oct 15 04:07:50.176182 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-5fadced1-8731-4460-9930-9df34c4ebead req-f2467e59-eec1-49a0-9ad3-6ad461f83255 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048443 Oct 15 04:07:50.176695 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1000/2103] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:07:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:07:50.295340 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2a448d18-17c5-4fae-8ad6-f5793627696c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:07:50.296017 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2a448d18-17c5-4fae-8ad6-f5793627696c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:07:50.312453 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2a448d18-17c5-4fae-8ad6-f5793627696c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:50.312900 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2a448d18-17c5-4fae-8ad6-f5793627696c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:50.313651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2a448d18-17c5-4fae-8ad6-f5793627696c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:50.314082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2a448d18-17c5-4fae-8ad6-f5793627696c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:50.319767 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] [62b4e7dd-437c-4699-815c-b81f4b01b864] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 41646. Oct 15 04:07:50.344981 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2a448d18-17c5-4fae-8ad6-f5793627696c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:50.345420 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2a448d18-17c5-4fae-8ad6-f5793627696c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:50.345865 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.objects.instance [None req-2a448d18-17c5-4fae-8ad6-f5793627696c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lazy-loading 'fault' on Instance uuid 7977d03b-ee0f-485a-a1c1-e711d9df1a46 {{(pid=120897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 04:07:50.383579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2a448d18-17c5-4fae-8ad6-f5793627696c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:07:50.391056 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2a448d18-17c5-4fae-8ad6-f5793627696c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 200 len: 1311 microversion: 2.1 time: 0.099402 Oct 15 04:07:50.391600 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1104/2104] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:07:50 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:07:51.408652 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a7cbd616-09e1-4cf9-b33c-7f0b5f5de718 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:07:51.409642 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a7cbd616-09e1-4cf9-b33c-7f0b5f5de718 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: 7977d03b-ee0f-485a-a1c1-e711d9df1a46] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:07:51.411886 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] [5cc85daf-8c99-49f7-9b26-c6658a21a2b7] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 41642. Oct 15 04:07:51.417345 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a7cbd616-09e1-4cf9-b33c-7f0b5f5de718 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:51.417858 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a7cbd616-09e1-4cf9-b33c-7f0b5f5de718 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:51.419331 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a7cbd616-09e1-4cf9-b33c-7f0b5f5de718 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:51.419977 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a7cbd616-09e1-4cf9-b33c-7f0b5f5de718 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:51.432889 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-a7cbd616-09e1-4cf9-b33c-7f0b5f5de718 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] HTTP exception thrown: Instance 7977d03b-ee0f-485a-a1c1-e711d9df1a46 could not be found. Oct 15 04:07:51.433476 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a7cbd616-09e1-4cf9-b33c-7f0b5f5de718 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Returning 404 to user: Instance 7977d03b-ee0f-485a-a1c1-e711d9df1a46 could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 04:07:51.434320 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a7cbd616-09e1-4cf9-b33c-7f0b5f5de718 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46" status: 404 len: 111 microversion: 2.1 time: 0.029745 Oct 15 04:07:51.435090 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1001/2105] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:07:51 2021] GET /compute/v2.1/servers/7977d03b-ee0f-485a-a1c1-e711d9df1a46 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 04:07:51.442651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b247b0c4-f053-40e2-a479-a9174325ae75 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:07:51.443419 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b247b0c4-f053-40e2-a479-a9174325ae75 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:07:51.450295 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b247b0c4-f053-40e2-a479-a9174325ae75 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:51.451029 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b247b0c4-f053-40e2-a479-a9174325ae75 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:51.451886 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b247b0c4-f053-40e2-a479-a9174325ae75 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:51.452384 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b247b0c4-f053-40e2-a479-a9174325ae75 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:51.478034 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b247b0c4-f053-40e2-a479-a9174325ae75 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Going to try to terminate instance {{(pid=120897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 15 04:07:51.553510 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b247b0c4-f053-40e2-a479-a9174325ae75 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 204 len: 0 microversion: 2.1 time: 0.113913 Oct 15 04:07:51.557152 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1105/2106] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 04:07:51 2021] DELETE /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 15 04:07:51.562212 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b47cdfc8-713e-4a4c-b75d-ed2ab4e5da4c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:07:51.562820 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b47cdfc8-713e-4a4c-b75d-ed2ab4e5da4c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:07:51.569703 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b47cdfc8-713e-4a4c-b75d-ed2ab4e5da4c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:51.570145 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b47cdfc8-713e-4a4c-b75d-ed2ab4e5da4c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:51.570902 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b47cdfc8-713e-4a4c-b75d-ed2ab4e5da4c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:51.571334 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b47cdfc8-713e-4a4c-b75d-ed2ab4e5da4c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:51.874626 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b47cdfc8-713e-4a4c-b75d-ed2ab4e5da4c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:07:51.882370 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b47cdfc8-713e-4a4c-b75d-ed2ab4e5da4c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1568 microversion: 2.1 time: 0.323927 Oct 15 04:07:51.882919 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1002/2107] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:07:51 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1568 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:07:52.592867 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-1398cc2f-cb27-4d75-a57d-3c1b48103697 req-6c4da145-97d8-4044-bd0a-d143a277d915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c33f5b74-7b6d-44da-870a-cff6c079605d", "name": "network-vif-deleted", "tag": "4e56ff2e-025a-453b-847c-49973ba90607"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:07:52.595068 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:07:52.595068 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 04:07:52.603941 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-1398cc2f-cb27-4d75-a57d-3c1b48103697 req-6c4da145-97d8-4044-bd0a-d143a277d915 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:52.604392 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-1398cc2f-cb27-4d75-a57d-3c1b48103697 req-6c4da145-97d8-4044-bd0a-d143a277d915 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:52.617830 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-1398cc2f-cb27-4d75-a57d-3c1b48103697 req-6c4da145-97d8-4044-bd0a-d143a277d915 service nova] Creating event network-vif-deleted:4e56ff2e-025a-453b-847c-49973ba90607 for instance c33f5b74-7b6d-44da-870a-cff6c079605d on hv-cinder-81410 Oct 15 04:07:52.623644 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-1398cc2f-cb27-4d75-a57d-3c1b48103697 req-6c4da145-97d8-4044-bd0a-d143a277d915 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034773 Oct 15 04:07:52.624196 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1106/2108] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:07:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 04:07:52.900264 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-257b23d6-7afa-40cf-b127-5f2a3c5d4487 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:07:52.900816 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-257b23d6-7afa-40cf-b127-5f2a3c5d4487 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:07:52.906558 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-257b23d6-7afa-40cf-b127-5f2a3c5d4487 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:52.907012 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-257b23d6-7afa-40cf-b127-5f2a3c5d4487 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:52.907805 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-257b23d6-7afa-40cf-b127-5f2a3c5d4487 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:52.908277 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-257b23d6-7afa-40cf-b127-5f2a3c5d4487 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:52.967059 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-257b23d6-7afa-40cf-b127-5f2a3c5d4487 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:07:52.974657 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-257b23d6-7afa-40cf-b127-5f2a3c5d4487 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078165 Oct 15 04:07:52.975212 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1003/2109] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:07:52 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:07:53.992138 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f017c014-b241-4724-8453-00fc3fda5766 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:07:53.992818 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f017c014-b241-4724-8453-00fc3fda5766 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:07:53.999310 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f017c014-b241-4724-8453-00fc3fda5766 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:53.999782 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f017c014-b241-4724-8453-00fc3fda5766 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:54.000530 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f017c014-b241-4724-8453-00fc3fda5766 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:54.000958 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f017c014-b241-4724-8453-00fc3fda5766 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:54.058566 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f017c014-b241-4724-8453-00fc3fda5766 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:07:54.066560 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f017c014-b241-4724-8453-00fc3fda5766 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078419 Oct 15 04:07:54.067106 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1107/2110] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:07:53 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:07:55.083432 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-101cd24a-6d00-4b2d-ae6e-96212bb34650 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:07:55.084103 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-101cd24a-6d00-4b2d-ae6e-96212bb34650 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:07:55.089863 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-101cd24a-6d00-4b2d-ae6e-96212bb34650 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:55.090933 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-101cd24a-6d00-4b2d-ae6e-96212bb34650 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:55.091711 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-101cd24a-6d00-4b2d-ae6e-96212bb34650 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:55.092148 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-101cd24a-6d00-4b2d-ae6e-96212bb34650 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:55.155023 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-101cd24a-6d00-4b2d-ae6e-96212bb34650 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:07:55.162731 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-101cd24a-6d00-4b2d-ae6e-96212bb34650 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.082892 Oct 15 04:07:55.163246 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1004/2111] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:07:55 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:07:56.179059 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-46d4bff9-85fe-4991-8498-7ad73e251f4a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:07:56.179663 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-46d4bff9-85fe-4991-8498-7ad73e251f4a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:07:56.186598 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-46d4bff9-85fe-4991-8498-7ad73e251f4a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:56.187043 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-46d4bff9-85fe-4991-8498-7ad73e251f4a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:56.187834 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-46d4bff9-85fe-4991-8498-7ad73e251f4a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:56.188291 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-46d4bff9-85fe-4991-8498-7ad73e251f4a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:56.249584 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-46d4bff9-85fe-4991-8498-7ad73e251f4a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:07:56.258995 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-46d4bff9-85fe-4991-8498-7ad73e251f4a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.082437 Oct 15 04:07:56.260215 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1108/2112] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:07:56 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:07:57.274738 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f9f9bc08-c62a-4ece-95c4-b0e22d0326b8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:07:57.275419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f9f9bc08-c62a-4ece-95c4-b0e22d0326b8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:07:57.281549 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f9f9bc08-c62a-4ece-95c4-b0e22d0326b8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:57.281989 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f9f9bc08-c62a-4ece-95c4-b0e22d0326b8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:57.282742 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f9f9bc08-c62a-4ece-95c4-b0e22d0326b8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:57.283167 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f9f9bc08-c62a-4ece-95c4-b0e22d0326b8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:57.342892 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f9f9bc08-c62a-4ece-95c4-b0e22d0326b8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:07:57.350483 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f9f9bc08-c62a-4ece-95c4-b0e22d0326b8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.079433 Oct 15 04:07:57.351033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1005/2113] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:07:57 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:07:58.367086 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d3f20e29-1f8a-42c1-8aa9-05c0a0f8d70c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:07:58.367718 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d3f20e29-1f8a-42c1-8aa9-05c0a0f8d70c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:07:58.374620 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d3f20e29-1f8a-42c1-8aa9-05c0a0f8d70c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:58.375061 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d3f20e29-1f8a-42c1-8aa9-05c0a0f8d70c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:58.375838 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d3f20e29-1f8a-42c1-8aa9-05c0a0f8d70c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:58.376281 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d3f20e29-1f8a-42c1-8aa9-05c0a0f8d70c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:58.433085 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d3f20e29-1f8a-42c1-8aa9-05c0a0f8d70c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:07:58.440946 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d3f20e29-1f8a-42c1-8aa9-05c0a0f8d70c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077490 Oct 15 04:07:58.441482 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1109/2114] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:07:58 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:07:59.457814 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fedead9d-485b-4a03-b599-b73663f1f0f7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:07:59.458456 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fedead9d-485b-4a03-b599-b73663f1f0f7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:07:59.464215 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fedead9d-485b-4a03-b599-b73663f1f0f7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:59.464666 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fedead9d-485b-4a03-b599-b73663f1f0f7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:59.466081 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fedead9d-485b-4a03-b599-b73663f1f0f7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:07:59.466519 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fedead9d-485b-4a03-b599-b73663f1f0f7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:07:59.523098 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fedead9d-485b-4a03-b599-b73663f1f0f7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:07:59.531398 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fedead9d-485b-4a03-b599-b73663f1f0f7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077195 Oct 15 04:07:59.531986 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1006/2115] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:07:59 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:00.547554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6b2c26d1-eae1-43fe-bd2c-819e60aaeefd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:00.548123 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6b2c26d1-eae1-43fe-bd2c-819e60aaeefd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:00.554013 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6b2c26d1-eae1-43fe-bd2c-819e60aaeefd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:00.554457 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6b2c26d1-eae1-43fe-bd2c-819e60aaeefd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:00.555276 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6b2c26d1-eae1-43fe-bd2c-819e60aaeefd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:00.555731 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6b2c26d1-eae1-43fe-bd2c-819e60aaeefd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:00.612609 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6b2c26d1-eae1-43fe-bd2c-819e60aaeefd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:00.620077 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6b2c26d1-eae1-43fe-bd2c-819e60aaeefd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076112 Oct 15 04:08:00.620805 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1110/2116] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:00 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:01.636829 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c398f8ec-6970-4c46-939d-3e0a388ba8ab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:01.637439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c398f8ec-6970-4c46-939d-3e0a388ba8ab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:01.643195 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c398f8ec-6970-4c46-939d-3e0a388ba8ab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:01.643695 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c398f8ec-6970-4c46-939d-3e0a388ba8ab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:01.644458 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c398f8ec-6970-4c46-939d-3e0a388ba8ab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:01.644888 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c398f8ec-6970-4c46-939d-3e0a388ba8ab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:01.704843 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c398f8ec-6970-4c46-939d-3e0a388ba8ab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:01.712444 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c398f8ec-6970-4c46-939d-3e0a388ba8ab tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.079267 Oct 15 04:08:01.712992 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1007/2117] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:01 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:02.728566 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fad9389e-6843-4c23-90a9-c1b2a6061f51 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:02.729179 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fad9389e-6843-4c23-90a9-c1b2a6061f51 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:02.735476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fad9389e-6843-4c23-90a9-c1b2a6061f51 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:02.735952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fad9389e-6843-4c23-90a9-c1b2a6061f51 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:02.736698 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fad9389e-6843-4c23-90a9-c1b2a6061f51 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:02.737126 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fad9389e-6843-4c23-90a9-c1b2a6061f51 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:02.796771 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fad9389e-6843-4c23-90a9-c1b2a6061f51 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:02.804272 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fad9389e-6843-4c23-90a9-c1b2a6061f51 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.079335 Oct 15 04:08:02.804817 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1111/2118] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:02 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:03.821029 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-43f2fc08-dbc5-4747-8a3b-0ec28d60a1e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:03.821596 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-43f2fc08-dbc5-4747-8a3b-0ec28d60a1e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:03.827872 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-43f2fc08-dbc5-4747-8a3b-0ec28d60a1e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:03.828326 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-43f2fc08-dbc5-4747-8a3b-0ec28d60a1e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:03.829093 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-43f2fc08-dbc5-4747-8a3b-0ec28d60a1e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:03.829528 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-43f2fc08-dbc5-4747-8a3b-0ec28d60a1e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:03.886197 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-43f2fc08-dbc5-4747-8a3b-0ec28d60a1e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:03.894302 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-43f2fc08-dbc5-4747-8a3b-0ec28d60a1e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077290 Oct 15 04:08:03.894862 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1008/2119] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:03 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:04.911517 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-73779582-14d2-4763-bbc0-bc875d889f36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:04.911966 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-73779582-14d2-4763-bbc0-bc875d889f36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:04.918581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-73779582-14d2-4763-bbc0-bc875d889f36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:04.919022 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-73779582-14d2-4763-bbc0-bc875d889f36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:04.919837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-73779582-14d2-4763-bbc0-bc875d889f36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:04.920309 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-73779582-14d2-4763-bbc0-bc875d889f36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:04.978103 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-73779582-14d2-4763-bbc0-bc875d889f36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:04.986151 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-73779582-14d2-4763-bbc0-bc875d889f36 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078518 Oct 15 04:08:04.986698 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1112/2120] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:04 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:06.002625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-741181e1-6391-4d5d-aee9-2227eb803e6f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:06.003238 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-741181e1-6391-4d5d-aee9-2227eb803e6f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:06.009446 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-741181e1-6391-4d5d-aee9-2227eb803e6f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:06.009898 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-741181e1-6391-4d5d-aee9-2227eb803e6f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:06.010658 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-741181e1-6391-4d5d-aee9-2227eb803e6f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:06.011090 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-741181e1-6391-4d5d-aee9-2227eb803e6f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:06.071833 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-741181e1-6391-4d5d-aee9-2227eb803e6f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:06.080092 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-741181e1-6391-4d5d-aee9-2227eb803e6f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.081193 Oct 15 04:08:06.080651 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1009/2121] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:05 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:07.096383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-dfbcec0e-ed08-40b8-9991-14ed75c49daf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:07.096998 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-dfbcec0e-ed08-40b8-9991-14ed75c49daf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:07.103224 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfbcec0e-ed08-40b8-9991-14ed75c49daf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:07.103705 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfbcec0e-ed08-40b8-9991-14ed75c49daf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:07.104470 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfbcec0e-ed08-40b8-9991-14ed75c49daf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:07.104905 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dfbcec0e-ed08-40b8-9991-14ed75c49daf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:07.161925 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-dfbcec0e-ed08-40b8-9991-14ed75c49daf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:07.170078 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-dfbcec0e-ed08-40b8-9991-14ed75c49daf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077352 Oct 15 04:08:07.170630 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1113/2122] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:07 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:08.186520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fe5ba10f-f58b-4690-9193-f8b967f314a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:08.187149 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fe5ba10f-f58b-4690-9193-f8b967f314a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:08.192780 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe5ba10f-f58b-4690-9193-f8b967f314a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:08.193224 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe5ba10f-f58b-4690-9193-f8b967f314a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:08.194217 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe5ba10f-f58b-4690-9193-f8b967f314a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:08.194656 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fe5ba10f-f58b-4690-9193-f8b967f314a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:08.255311 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fe5ba10f-f58b-4690-9193-f8b967f314a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:08.263600 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fe5ba10f-f58b-4690-9193-f8b967f314a2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.081191 Oct 15 04:08:08.264180 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1010/2123] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:08 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:09.280511 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-26209ea8-6cff-41c5-ae98-0a2888b5b994 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:09.281111 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-26209ea8-6cff-41c5-ae98-0a2888b5b994 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:09.286794 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-26209ea8-6cff-41c5-ae98-0a2888b5b994 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:09.287237 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-26209ea8-6cff-41c5-ae98-0a2888b5b994 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:09.288007 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-26209ea8-6cff-41c5-ae98-0a2888b5b994 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:09.288432 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-26209ea8-6cff-41c5-ae98-0a2888b5b994 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:09.345512 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-26209ea8-6cff-41c5-ae98-0a2888b5b994 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:09.353025 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-26209ea8-6cff-41c5-ae98-0a2888b5b994 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076796 Oct 15 04:08:09.353586 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1114/2124] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:09 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:10.369789 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d3625311-5218-4b96-8bab-e171b68d2828 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:10.370403 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d3625311-5218-4b96-8bab-e171b68d2828 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:10.376736 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3625311-5218-4b96-8bab-e171b68d2828 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:10.377185 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3625311-5218-4b96-8bab-e171b68d2828 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:10.377943 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3625311-5218-4b96-8bab-e171b68d2828 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:10.378376 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d3625311-5218-4b96-8bab-e171b68d2828 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:10.435815 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d3625311-5218-4b96-8bab-e171b68d2828 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:10.443427 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d3625311-5218-4b96-8bab-e171b68d2828 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077293 Oct 15 04:08:10.444278 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1011/2125] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:10 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:11.460697 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a7005970-0d72-42f9-b075-c6b7d391e0cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:11.461319 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a7005970-0d72-42f9-b075-c6b7d391e0cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:11.468663 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a7005970-0d72-42f9-b075-c6b7d391e0cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:11.469113 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a7005970-0d72-42f9-b075-c6b7d391e0cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:11.469907 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a7005970-0d72-42f9-b075-c6b7d391e0cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:11.470342 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a7005970-0d72-42f9-b075-c6b7d391e0cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:11.527699 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a7005970-0d72-42f9-b075-c6b7d391e0cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:11.535904 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a7005970-0d72-42f9-b075-c6b7d391e0cd tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078887 Oct 15 04:08:11.536462 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1115/2126] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:11 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:12.552300 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e7862b23-7609-4a05-8550-d446ccddeec2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:12.552845 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e7862b23-7609-4a05-8550-d446ccddeec2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:12.558634 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7862b23-7609-4a05-8550-d446ccddeec2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:12.559625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7862b23-7609-4a05-8550-d446ccddeec2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:12.560414 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7862b23-7609-4a05-8550-d446ccddeec2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:12.560845 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7862b23-7609-4a05-8550-d446ccddeec2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:12.620893 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e7862b23-7609-4a05-8550-d446ccddeec2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:12.628908 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e7862b23-7609-4a05-8550-d446ccddeec2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.080348 Oct 15 04:08:12.629455 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1012/2127] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:12 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:13.646058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e39caba9-a5ef-457e-b782-9eb3396039e2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:13.646611 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e39caba9-a5ef-457e-b782-9eb3396039e2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:13.652281 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e39caba9-a5ef-457e-b782-9eb3396039e2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:13.652724 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e39caba9-a5ef-457e-b782-9eb3396039e2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:13.653466 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e39caba9-a5ef-457e-b782-9eb3396039e2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:13.653891 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e39caba9-a5ef-457e-b782-9eb3396039e2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:13.711106 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e39caba9-a5ef-457e-b782-9eb3396039e2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:13.718599 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e39caba9-a5ef-457e-b782-9eb3396039e2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076272 Oct 15 04:08:13.719144 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1116/2128] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:13 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:14.735305 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-eed75e56-54b3-4036-8aae-c2a921d354ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:14.735906 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-eed75e56-54b3-4036-8aae-c2a921d354ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:14.741851 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eed75e56-54b3-4036-8aae-c2a921d354ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:14.742301 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eed75e56-54b3-4036-8aae-c2a921d354ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:14.743050 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eed75e56-54b3-4036-8aae-c2a921d354ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:14.743480 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eed75e56-54b3-4036-8aae-c2a921d354ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:14.803277 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-eed75e56-54b3-4036-8aae-c2a921d354ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:14.811721 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-eed75e56-54b3-4036-8aae-c2a921d354ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.080618 Oct 15 04:08:14.812267 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1013/2129] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:14 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:15.828838 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f66d94bc-a65c-4753-8af8-bb85b190bab8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:15.829426 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f66d94bc-a65c-4753-8af8-bb85b190bab8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:15.835181 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f66d94bc-a65c-4753-8af8-bb85b190bab8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:15.835621 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f66d94bc-a65c-4753-8af8-bb85b190bab8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:15.836399 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f66d94bc-a65c-4753-8af8-bb85b190bab8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:15.836831 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f66d94bc-a65c-4753-8af8-bb85b190bab8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:15.893938 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f66d94bc-a65c-4753-8af8-bb85b190bab8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:15.901421 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f66d94bc-a65c-4753-8af8-bb85b190bab8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076843 Oct 15 04:08:15.902262 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1117/2130] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:15 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:16.917926 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4fd1ef1f-1ffd-4c0b-bf6f-cb30f64f49e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:16.918536 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4fd1ef1f-1ffd-4c0b-bf6f-cb30f64f49e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:16.924979 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4fd1ef1f-1ffd-4c0b-bf6f-cb30f64f49e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:16.925424 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4fd1ef1f-1ffd-4c0b-bf6f-cb30f64f49e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:16.926185 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4fd1ef1f-1ffd-4c0b-bf6f-cb30f64f49e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:16.926619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4fd1ef1f-1ffd-4c0b-bf6f-cb30f64f49e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:16.984238 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4fd1ef1f-1ffd-4c0b-bf6f-cb30f64f49e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:16.991786 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4fd1ef1f-1ffd-4c0b-bf6f-cb30f64f49e3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077503 Oct 15 04:08:16.992349 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1014/2131] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:16 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:18.007328 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5e79e0a6-f53d-4a5e-a96d-27105286f26d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:18.007950 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5e79e0a6-f53d-4a5e-a96d-27105286f26d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:18.013581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5e79e0a6-f53d-4a5e-a96d-27105286f26d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:18.014027 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5e79e0a6-f53d-4a5e-a96d-27105286f26d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:18.014781 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5e79e0a6-f53d-4a5e-a96d-27105286f26d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:18.015211 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5e79e0a6-f53d-4a5e-a96d-27105286f26d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:18.072910 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5e79e0a6-f53d-4a5e-a96d-27105286f26d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:18.080435 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5e79e0a6-f53d-4a5e-a96d-27105286f26d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076824 Oct 15 04:08:18.080983 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1118/2132] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:18 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:19.096390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3392609c-597a-44b6-8e52-22b1bd19f4c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:19.097000 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3392609c-597a-44b6-8e52-22b1bd19f4c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:19.103201 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3392609c-597a-44b6-8e52-22b1bd19f4c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:19.103649 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3392609c-597a-44b6-8e52-22b1bd19f4c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:19.104442 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3392609c-597a-44b6-8e52-22b1bd19f4c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:19.104877 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3392609c-597a-44b6-8e52-22b1bd19f4c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:19.161937 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3392609c-597a-44b6-8e52-22b1bd19f4c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:19.169551 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3392609c-597a-44b6-8e52-22b1bd19f4c5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076791 Oct 15 04:08:19.170033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1015/2133] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:19 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:20.185735 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7b880d63-135e-4ce9-a56b-6b5d884a5a04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:20.186326 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7b880d63-135e-4ce9-a56b-6b5d884a5a04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:20.192226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7b880d63-135e-4ce9-a56b-6b5d884a5a04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:20.192665 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7b880d63-135e-4ce9-a56b-6b5d884a5a04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:20.193410 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7b880d63-135e-4ce9-a56b-6b5d884a5a04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:20.194091 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7b880d63-135e-4ce9-a56b-6b5d884a5a04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:20.252076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-7b880d63-135e-4ce9-a56b-6b5d884a5a04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:20.259565 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7b880d63-135e-4ce9-a56b-6b5d884a5a04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077512 Oct 15 04:08:20.260149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1119/2134] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:20 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:21.276612 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4f6edb7a-33e5-4068-92ef-5172a050bbdf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:21.277252 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4f6edb7a-33e5-4068-92ef-5172a050bbdf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:21.283159 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4f6edb7a-33e5-4068-92ef-5172a050bbdf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:21.283586 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4f6edb7a-33e5-4068-92ef-5172a050bbdf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:21.284482 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4f6edb7a-33e5-4068-92ef-5172a050bbdf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:21.284915 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4f6edb7a-33e5-4068-92ef-5172a050bbdf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:21.352261 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4f6edb7a-33e5-4068-92ef-5172a050bbdf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:21.360653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4f6edb7a-33e5-4068-92ef-5172a050bbdf tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.087750 Oct 15 04:08:21.361242 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1016/2135] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:21 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 04:08:22.377585 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-33b0c302-d468-4608-a63e-26e5eb9585ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:22.378194 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-33b0c302-d468-4608-a63e-26e5eb9585ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:22.383929 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-33b0c302-d468-4608-a63e-26e5eb9585ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:22.384586 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-33b0c302-d468-4608-a63e-26e5eb9585ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:22.385141 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-33b0c302-d468-4608-a63e-26e5eb9585ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:22.385579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-33b0c302-d468-4608-a63e-26e5eb9585ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:22.443328 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-33b0c302-d468-4608-a63e-26e5eb9585ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:22.451818 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-33b0c302-d468-4608-a63e-26e5eb9585ec tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077971 Oct 15 04:08:22.452371 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1120/2136] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:22 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:23.468659 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-09cec0c6-ac83-44f9-8294-784fbe8fcd62 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:23.469268 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-09cec0c6-ac83-44f9-8294-784fbe8fcd62 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:23.474881 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09cec0c6-ac83-44f9-8294-784fbe8fcd62 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:23.475323 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09cec0c6-ac83-44f9-8294-784fbe8fcd62 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:23.476110 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09cec0c6-ac83-44f9-8294-784fbe8fcd62 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:23.476547 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-09cec0c6-ac83-44f9-8294-784fbe8fcd62 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:23.533977 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-09cec0c6-ac83-44f9-8294-784fbe8fcd62 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:23.541475 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-09cec0c6-ac83-44f9-8294-784fbe8fcd62 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077085 Oct 15 04:08:23.542030 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1017/2137] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:23 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:24.557825 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-56cda7a1-c9d5-4616-9b68-01303f11016b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:24.558334 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-56cda7a1-c9d5-4616-9b68-01303f11016b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:24.563935 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-56cda7a1-c9d5-4616-9b68-01303f11016b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:24.564383 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-56cda7a1-c9d5-4616-9b68-01303f11016b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:24.565124 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-56cda7a1-c9d5-4616-9b68-01303f11016b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:24.565554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-56cda7a1-c9d5-4616-9b68-01303f11016b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:24.622610 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-56cda7a1-c9d5-4616-9b68-01303f11016b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:24.630162 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-56cda7a1-c9d5-4616-9b68-01303f11016b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076026 Oct 15 04:08:24.630719 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1121/2138] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:24 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:25.647705 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0fe8d5a1-1c64-409d-8022-57bcbe0b2438 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:25.648428 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0fe8d5a1-1c64-409d-8022-57bcbe0b2438 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:25.654189 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0fe8d5a1-1c64-409d-8022-57bcbe0b2438 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:25.654646 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0fe8d5a1-1c64-409d-8022-57bcbe0b2438 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:25.655408 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0fe8d5a1-1c64-409d-8022-57bcbe0b2438 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:25.655866 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0fe8d5a1-1c64-409d-8022-57bcbe0b2438 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:25.713573 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0fe8d5a1-1c64-409d-8022-57bcbe0b2438 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:25.721101 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0fe8d5a1-1c64-409d-8022-57bcbe0b2438 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078272 Oct 15 04:08:25.721718 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1018/2139] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:25 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:26.737777 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b3718a65-94bf-4fcd-860b-5fec8d0e6306 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:26.738390 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b3718a65-94bf-4fcd-860b-5fec8d0e6306 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:26.744092 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b3718a65-94bf-4fcd-860b-5fec8d0e6306 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:26.744540 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b3718a65-94bf-4fcd-860b-5fec8d0e6306 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:26.745290 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b3718a65-94bf-4fcd-860b-5fec8d0e6306 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:26.745722 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b3718a65-94bf-4fcd-860b-5fec8d0e6306 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:26.802791 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b3718a65-94bf-4fcd-860b-5fec8d0e6306 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:26.810550 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b3718a65-94bf-4fcd-860b-5fec8d0e6306 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076483 Oct 15 04:08:26.811099 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1122/2140] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:26 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:27.827741 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f61e77aa-f119-4c14-be68-e4c55d105b34 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:27.828266 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f61e77aa-f119-4c14-be68-e4c55d105b34 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:27.833976 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f61e77aa-f119-4c14-be68-e4c55d105b34 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:27.834419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f61e77aa-f119-4c14-be68-e4c55d105b34 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:27.835174 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f61e77aa-f119-4c14-be68-e4c55d105b34 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:27.835602 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f61e77aa-f119-4c14-be68-e4c55d105b34 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:27.894836 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f61e77aa-f119-4c14-be68-e4c55d105b34 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:27.902406 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f61e77aa-f119-4c14-be68-e4c55d105b34 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.079214 Oct 15 04:08:27.902959 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1019/2141] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:27 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:28.919536 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a8a24167-ad51-44ec-b02b-458873ac9f69 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:28.920170 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a8a24167-ad51-44ec-b02b-458873ac9f69 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:28.926013 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a8a24167-ad51-44ec-b02b-458873ac9f69 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:28.926464 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a8a24167-ad51-44ec-b02b-458873ac9f69 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:28.927223 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a8a24167-ad51-44ec-b02b-458873ac9f69 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:28.927703 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a8a24167-ad51-44ec-b02b-458873ac9f69 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:28.985927 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a8a24167-ad51-44ec-b02b-458873ac9f69 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:28.993437 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a8a24167-ad51-44ec-b02b-458873ac9f69 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078078 Oct 15 04:08:28.993983 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1123/2142] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:28 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:30.010321 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-957249f2-4318-4152-a045-3e765dd45717 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:30.010929 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-957249f2-4318-4152-a045-3e765dd45717 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:30.017289 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-957249f2-4318-4152-a045-3e765dd45717 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:30.017737 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-957249f2-4318-4152-a045-3e765dd45717 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:30.018500 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-957249f2-4318-4152-a045-3e765dd45717 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:30.018933 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-957249f2-4318-4152-a045-3e765dd45717 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:30.076914 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-957249f2-4318-4152-a045-3e765dd45717 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:30.084410 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-957249f2-4318-4152-a045-3e765dd45717 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077767 Oct 15 04:08:30.084968 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1020/2143] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:30 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:30.871936 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:08:30.872163 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 04:08:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:08:31.100861 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f5add5ec-d404-4969-b378-e70fa88652c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:31.101473 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f5add5ec-d404-4969-b378-e70fa88652c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:31.107392 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f5add5ec-d404-4969-b378-e70fa88652c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:31.107884 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f5add5ec-d404-4969-b378-e70fa88652c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:31.108641 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f5add5ec-d404-4969-b378-e70fa88652c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:31.109080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f5add5ec-d404-4969-b378-e70fa88652c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:31.166880 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f5add5ec-d404-4969-b378-e70fa88652c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:31.174560 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f5add5ec-d404-4969-b378-e70fa88652c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077374 Oct 15 04:08:31.175111 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1124/2144] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:31 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:32.190790 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fcd7ed0c-587e-409c-846a-c92cfa9c9b4b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:32.191436 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fcd7ed0c-587e-409c-846a-c92cfa9c9b4b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:32.197553 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fcd7ed0c-587e-409c-846a-c92cfa9c9b4b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:32.198017 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fcd7ed0c-587e-409c-846a-c92cfa9c9b4b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:32.198754 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fcd7ed0c-587e-409c-846a-c92cfa9c9b4b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:32.199186 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fcd7ed0c-587e-409c-846a-c92cfa9c9b4b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:32.257539 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fcd7ed0c-587e-409c-846a-c92cfa9c9b4b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:32.265189 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fcd7ed0c-587e-409c-846a-c92cfa9c9b4b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078024 Oct 15 04:08:32.265746 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1021/2145] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:32 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:33.281331 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c94ca491-7f1f-441b-aa5e-c30626c00be9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:33.281936 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c94ca491-7f1f-441b-aa5e-c30626c00be9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:33.287752 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c94ca491-7f1f-441b-aa5e-c30626c00be9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:33.288199 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c94ca491-7f1f-441b-aa5e-c30626c00be9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:33.288944 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c94ca491-7f1f-441b-aa5e-c30626c00be9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:33.289368 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c94ca491-7f1f-441b-aa5e-c30626c00be9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:33.346435 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c94ca491-7f1f-441b-aa5e-c30626c00be9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:33.353976 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c94ca491-7f1f-441b-aa5e-c30626c00be9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076299 Oct 15 04:08:33.354525 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1125/2146] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:33 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:34.370856 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a3de5c3e-805f-4735-ac49-e8517c17a981 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:34.371461 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a3de5c3e-805f-4735-ac49-e8517c17a981 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:34.377145 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a3de5c3e-805f-4735-ac49-e8517c17a981 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:34.377593 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a3de5c3e-805f-4735-ac49-e8517c17a981 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:34.378354 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a3de5c3e-805f-4735-ac49-e8517c17a981 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:34.378788 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a3de5c3e-805f-4735-ac49-e8517c17a981 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:34.437930 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-a3de5c3e-805f-4735-ac49-e8517c17a981 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:34.445758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a3de5c3e-805f-4735-ac49-e8517c17a981 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078629 Oct 15 04:08:34.446309 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1022/2147] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:34 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:35.462030 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d380f4c4-b1f8-4136-9c36-8070316da4b3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:35.462646 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d380f4c4-b1f8-4136-9c36-8070316da4b3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:35.468490 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d380f4c4-b1f8-4136-9c36-8070316da4b3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:35.468939 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d380f4c4-b1f8-4136-9c36-8070316da4b3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:35.469694 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d380f4c4-b1f8-4136-9c36-8070316da4b3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:35.470131 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d380f4c4-b1f8-4136-9c36-8070316da4b3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:35.527911 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d380f4c4-b1f8-4136-9c36-8070316da4b3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:35.535458 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d380f4c4-b1f8-4136-9c36-8070316da4b3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077161 Oct 15 04:08:35.536049 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1126/2148] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:35 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:36.552356 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7976f631-6539-485f-8bbd-06e5981ac63e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:36.552968 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7976f631-6539-485f-8bbd-06e5981ac63e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:36.558807 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7976f631-6539-485f-8bbd-06e5981ac63e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:36.559252 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7976f631-6539-485f-8bbd-06e5981ac63e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:36.560621 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7976f631-6539-485f-8bbd-06e5981ac63e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:36.561051 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7976f631-6539-485f-8bbd-06e5981ac63e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:36.618604 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7976f631-6539-485f-8bbd-06e5981ac63e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:36.626593 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7976f631-6539-485f-8bbd-06e5981ac63e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077965 Oct 15 04:08:36.627179 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1023/2149] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:36 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:37.643316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e79beac4-d20d-4141-b386-3bb0335480f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:37.643882 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e79beac4-d20d-4141-b386-3bb0335480f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:37.649656 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e79beac4-d20d-4141-b386-3bb0335480f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:37.650312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e79beac4-d20d-4141-b386-3bb0335480f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:37.651387 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e79beac4-d20d-4141-b386-3bb0335480f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:37.652071 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e79beac4-d20d-4141-b386-3bb0335480f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:37.760091 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e79beac4-d20d-4141-b386-3bb0335480f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:37.768360 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e79beac4-d20d-4141-b386-3bb0335480f3 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.128717 Oct 15 04:08:37.768922 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1127/2150] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:37 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:38.785455 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ac1f4987-7bba-41b5-9b3c-d85f813254df tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:38.786061 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ac1f4987-7bba-41b5-9b3c-d85f813254df tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:38.792282 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ac1f4987-7bba-41b5-9b3c-d85f813254df tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:38.792736 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ac1f4987-7bba-41b5-9b3c-d85f813254df tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:38.793496 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ac1f4987-7bba-41b5-9b3c-d85f813254df tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:38.793926 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ac1f4987-7bba-41b5-9b3c-d85f813254df tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:38.852166 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ac1f4987-7bba-41b5-9b3c-d85f813254df tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:38.860554 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ac1f4987-7bba-41b5-9b3c-d85f813254df tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078797 Oct 15 04:08:38.861125 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1024/2151] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:38 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:39.877530 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4b0b836c-db49-4985-8716-7a4f84cf82f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:39.878082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4b0b836c-db49-4985-8716-7a4f84cf82f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:39.884218 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4b0b836c-db49-4985-8716-7a4f84cf82f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:39.884673 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4b0b836c-db49-4985-8716-7a4f84cf82f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:39.885421 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4b0b836c-db49-4985-8716-7a4f84cf82f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:39.885852 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4b0b836c-db49-4985-8716-7a4f84cf82f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:39.943097 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4b0b836c-db49-4985-8716-7a4f84cf82f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:39.950959 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4b0b836c-db49-4985-8716-7a4f84cf82f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077134 Oct 15 04:08:39.951507 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1128/2152] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:39 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:40.967370 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8d8cf2c0-1187-4917-82d3-42481a18e61e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:40.968007 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8d8cf2c0-1187-4917-82d3-42481a18e61e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:40.973916 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8d8cf2c0-1187-4917-82d3-42481a18e61e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:40.974369 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8d8cf2c0-1187-4917-82d3-42481a18e61e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:40.975133 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8d8cf2c0-1187-4917-82d3-42481a18e61e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:40.975569 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8d8cf2c0-1187-4917-82d3-42481a18e61e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:41.035502 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8d8cf2c0-1187-4917-82d3-42481a18e61e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:41.043139 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8d8cf2c0-1187-4917-82d3-42481a18e61e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.079510 Oct 15 04:08:41.043745 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1025/2153] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:40 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:42.059421 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-73b43e79-51b3-4a05-928a-6d9d7f2536f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:42.060041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-73b43e79-51b3-4a05-928a-6d9d7f2536f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:42.065997 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-73b43e79-51b3-4a05-928a-6d9d7f2536f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:42.066449 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-73b43e79-51b3-4a05-928a-6d9d7f2536f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:42.067213 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-73b43e79-51b3-4a05-928a-6d9d7f2536f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:42.067651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-73b43e79-51b3-4a05-928a-6d9d7f2536f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:42.362896 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-73b43e79-51b3-4a05-928a-6d9d7f2536f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:42.370722 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-73b43e79-51b3-4a05-928a-6d9d7f2536f2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.314974 Oct 15 04:08:42.371272 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1129/2154] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:42 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:43.387260 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-aec7f4f9-218f-4813-992c-f9ef5a597b06 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:43.387969 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-aec7f4f9-218f-4813-992c-f9ef5a597b06 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:43.393825 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aec7f4f9-218f-4813-992c-f9ef5a597b06 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:43.394284 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aec7f4f9-218f-4813-992c-f9ef5a597b06 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:43.395054 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aec7f4f9-218f-4813-992c-f9ef5a597b06 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:43.395494 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-aec7f4f9-218f-4813-992c-f9ef5a597b06 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:43.453432 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-aec7f4f9-218f-4813-992c-f9ef5a597b06 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:43.460944 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-aec7f4f9-218f-4813-992c-f9ef5a597b06 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077218 Oct 15 04:08:43.461500 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1026/2155] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:43 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:44.477135 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ad6c9ed0-065d-4b7b-a92f-c55a53790b20 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:44.477737 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ad6c9ed0-065d-4b7b-a92f-c55a53790b20 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:44.483997 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ad6c9ed0-065d-4b7b-a92f-c55a53790b20 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:44.484438 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ad6c9ed0-065d-4b7b-a92f-c55a53790b20 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:44.485182 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ad6c9ed0-065d-4b7b-a92f-c55a53790b20 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:44.485612 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ad6c9ed0-065d-4b7b-a92f-c55a53790b20 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:44.542106 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ad6c9ed0-065d-4b7b-a92f-c55a53790b20 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:44.550069 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ad6c9ed0-065d-4b7b-a92f-c55a53790b20 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076506 Oct 15 04:08:44.550613 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1130/2156] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:44 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:45.566005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d4bcb8c6-a146-4226-be45-db77ec723128 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:45.566526 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d4bcb8c6-a146-4226-be45-db77ec723128 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:45.572457 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d4bcb8c6-a146-4226-be45-db77ec723128 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:45.572903 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d4bcb8c6-a146-4226-be45-db77ec723128 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:45.573655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d4bcb8c6-a146-4226-be45-db77ec723128 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:45.574084 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d4bcb8c6-a146-4226-be45-db77ec723128 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:45.630935 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d4bcb8c6-a146-4226-be45-db77ec723128 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:45.639090 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d4bcb8c6-a146-4226-be45-db77ec723128 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076700 Oct 15 04:08:45.639640 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1027/2157] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:45 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:46.655810 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-fea6ed8a-da79-426d-81c1-8259b3a6b977 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:46.656413 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-fea6ed8a-da79-426d-81c1-8259b3a6b977 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:46.662139 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fea6ed8a-da79-426d-81c1-8259b3a6b977 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:46.662588 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fea6ed8a-da79-426d-81c1-8259b3a6b977 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:46.663340 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fea6ed8a-da79-426d-81c1-8259b3a6b977 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:46.663801 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-fea6ed8a-da79-426d-81c1-8259b3a6b977 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:46.722730 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-fea6ed8a-da79-426d-81c1-8259b3a6b977 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:46.730282 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-fea6ed8a-da79-426d-81c1-8259b3a6b977 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078713 Oct 15 04:08:46.730834 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1131/2158] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:46 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:47.745841 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a329609b-db26-4770-9947-fc0ba7b8b136 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:47.746448 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a329609b-db26-4770-9947-fc0ba7b8b136 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:47.752174 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a329609b-db26-4770-9947-fc0ba7b8b136 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:47.752619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a329609b-db26-4770-9947-fc0ba7b8b136 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:47.753366 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a329609b-db26-4770-9947-fc0ba7b8b136 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:47.753793 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a329609b-db26-4770-9947-fc0ba7b8b136 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:47.810600 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-a329609b-db26-4770-9947-fc0ba7b8b136 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:47.818090 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a329609b-db26-4770-9947-fc0ba7b8b136 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.075842 Oct 15 04:08:47.818893 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1028/2159] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:47 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:48.834261 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6ff60548-8711-4487-baf2-9e89269df13a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:48.834867 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6ff60548-8711-4487-baf2-9e89269df13a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:48.840565 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6ff60548-8711-4487-baf2-9e89269df13a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:48.841017 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6ff60548-8711-4487-baf2-9e89269df13a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:48.841769 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6ff60548-8711-4487-baf2-9e89269df13a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:48.842253 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6ff60548-8711-4487-baf2-9e89269df13a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:48.899222 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6ff60548-8711-4487-baf2-9e89269df13a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:48.908109 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6ff60548-8711-4487-baf2-9e89269df13a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077105 Oct 15 04:08:48.909077 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1132/2160] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:48 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:49.925556 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e1d0082d-683d-40e9-b926-9715253dbf83 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:49.926088 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e1d0082d-683d-40e9-b926-9715253dbf83 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:49.931924 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e1d0082d-683d-40e9-b926-9715253dbf83 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:49.932374 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e1d0082d-683d-40e9-b926-9715253dbf83 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:49.933133 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e1d0082d-683d-40e9-b926-9715253dbf83 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:49.933568 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e1d0082d-683d-40e9-b926-9715253dbf83 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:49.990812 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e1d0082d-683d-40e9-b926-9715253dbf83 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:49.998833 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e1d0082d-683d-40e9-b926-9715253dbf83 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076991 Oct 15 04:08:49.999382 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1029/2161] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:49 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:51.015314 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-51e58520-fd38-4411-99df-c5a8c7a7bfae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:51.015974 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-51e58520-fd38-4411-99df-c5a8c7a7bfae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:51.021682 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-51e58520-fd38-4411-99df-c5a8c7a7bfae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:51.022133 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-51e58520-fd38-4411-99df-c5a8c7a7bfae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:51.022890 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-51e58520-fd38-4411-99df-c5a8c7a7bfae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:51.023329 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-51e58520-fd38-4411-99df-c5a8c7a7bfae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:51.081682 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-51e58520-fd38-4411-99df-c5a8c7a7bfae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:51.089201 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-51e58520-fd38-4411-99df-c5a8c7a7bfae tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077770 Oct 15 04:08:51.089758 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1133/2162] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:51 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:52.106179 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-91e8f727-5a42-4193-b109-55ba797b1fc8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:52.106850 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-91e8f727-5a42-4193-b109-55ba797b1fc8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:52.112798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-91e8f727-5a42-4193-b109-55ba797b1fc8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:52.113247 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-91e8f727-5a42-4193-b109-55ba797b1fc8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:52.114010 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-91e8f727-5a42-4193-b109-55ba797b1fc8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:52.114442 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-91e8f727-5a42-4193-b109-55ba797b1fc8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:52.172046 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-91e8f727-5a42-4193-b109-55ba797b1fc8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:52.179580 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-91e8f727-5a42-4193-b109-55ba797b1fc8 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077105 Oct 15 04:08:52.180167 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1030/2163] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:52 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:53.196819 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-35cd65a5-fb02-4d11-a2fb-fec54188dae0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:53.197376 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-35cd65a5-fb02-4d11-a2fb-fec54188dae0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:53.203016 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35cd65a5-fb02-4d11-a2fb-fec54188dae0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:53.203464 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35cd65a5-fb02-4d11-a2fb-fec54188dae0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:53.204242 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35cd65a5-fb02-4d11-a2fb-fec54188dae0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:53.204675 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-35cd65a5-fb02-4d11-a2fb-fec54188dae0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:53.264972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-35cd65a5-fb02-4d11-a2fb-fec54188dae0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:53.272616 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-35cd65a5-fb02-4d11-a2fb-fec54188dae0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.079744 Oct 15 04:08:53.273166 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1134/2164] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:53 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:54.289576 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3fb681d6-e14b-4480-b34f-9b683a0233ff tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:54.290183 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3fb681d6-e14b-4480-b34f-9b683a0233ff tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:54.295985 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3fb681d6-e14b-4480-b34f-9b683a0233ff tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:54.296433 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3fb681d6-e14b-4480-b34f-9b683a0233ff tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:54.297193 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3fb681d6-e14b-4480-b34f-9b683a0233ff tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:54.297625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3fb681d6-e14b-4480-b34f-9b683a0233ff tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:54.355752 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3fb681d6-e14b-4480-b34f-9b683a0233ff tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:54.363158 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3fb681d6-e14b-4480-b34f-9b683a0233ff tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077212 Oct 15 04:08:54.363734 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1031/2165] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:54 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:55.379266 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-60c2de57-e11f-4f3e-9dec-51160d71d994 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:55.379897 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-60c2de57-e11f-4f3e-9dec-51160d71d994 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:55.385826 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-60c2de57-e11f-4f3e-9dec-51160d71d994 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:55.386269 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-60c2de57-e11f-4f3e-9dec-51160d71d994 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:55.387017 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-60c2de57-e11f-4f3e-9dec-51160d71d994 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:55.387439 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-60c2de57-e11f-4f3e-9dec-51160d71d994 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:55.444910 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-60c2de57-e11f-4f3e-9dec-51160d71d994 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:55.452363 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-60c2de57-e11f-4f3e-9dec-51160d71d994 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076727 Oct 15 04:08:55.452914 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1135/2166] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:55 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:56.469114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7983be9f-074d-452c-9b2e-9b5cd3596ac7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:56.469839 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7983be9f-074d-452c-9b2e-9b5cd3596ac7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:56.475921 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7983be9f-074d-452c-9b2e-9b5cd3596ac7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:56.476369 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7983be9f-074d-452c-9b2e-9b5cd3596ac7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:56.477135 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7983be9f-074d-452c-9b2e-9b5cd3596ac7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:56.477571 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7983be9f-074d-452c-9b2e-9b5cd3596ac7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:56.537106 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7983be9f-074d-452c-9b2e-9b5cd3596ac7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:56.545513 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7983be9f-074d-452c-9b2e-9b5cd3596ac7 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.080305 Oct 15 04:08:56.546077 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1032/2167] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:56 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:57.564825 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0d553e10-8568-44d3-a543-ef1dc7046c04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:57.565379 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0d553e10-8568-44d3-a543-ef1dc7046c04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:57.571440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0d553e10-8568-44d3-a543-ef1dc7046c04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:57.571923 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0d553e10-8568-44d3-a543-ef1dc7046c04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:57.572703 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0d553e10-8568-44d3-a543-ef1dc7046c04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:57.573132 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0d553e10-8568-44d3-a543-ef1dc7046c04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:57.630675 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0d553e10-8568-44d3-a543-ef1dc7046c04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:57.638910 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0d553e10-8568-44d3-a543-ef1dc7046c04 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077868 Oct 15 04:08:57.639466 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1136/2168] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:57 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:58.655043 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-80501792-d3a8-4e61-9c6a-35fcec62cb06 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:58.655657 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-80501792-d3a8-4e61-9c6a-35fcec62cb06 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:58.661564 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-80501792-d3a8-4e61-9c6a-35fcec62cb06 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:58.662017 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-80501792-d3a8-4e61-9c6a-35fcec62cb06 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:58.662785 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-80501792-d3a8-4e61-9c6a-35fcec62cb06 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:58.663220 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-80501792-d3a8-4e61-9c6a-35fcec62cb06 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:58.721799 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-80501792-d3a8-4e61-9c6a-35fcec62cb06 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:58.729366 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-80501792-d3a8-4e61-9c6a-35fcec62cb06 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078591 Oct 15 04:08:58.729926 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1033/2169] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:58 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:08:59.745625 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a4133712-7cea-41c0-b4ad-82dcdaac8c52 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:08:59.746229 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a4133712-7cea-41c0-b4ad-82dcdaac8c52 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:08:59.752571 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4133712-7cea-41c0-b4ad-82dcdaac8c52 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:59.753015 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4133712-7cea-41c0-b4ad-82dcdaac8c52 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:59.753753 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4133712-7cea-41c0-b4ad-82dcdaac8c52 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:08:59.754178 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4133712-7cea-41c0-b4ad-82dcdaac8c52 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:08:59.813114 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a4133712-7cea-41c0-b4ad-82dcdaac8c52 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:08:59.820907 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a4133712-7cea-41c0-b4ad-82dcdaac8c52 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078942 Oct 15 04:08:59.821453 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1137/2170] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:08:59 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:00.838023 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3e6891b5-ccc3-4286-ac3b-ad6214b9360b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:00.838627 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3e6891b5-ccc3-4286-ac3b-ad6214b9360b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:00.844897 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3e6891b5-ccc3-4286-ac3b-ad6214b9360b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:00.845337 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3e6891b5-ccc3-4286-ac3b-ad6214b9360b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:00.846088 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3e6891b5-ccc3-4286-ac3b-ad6214b9360b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:00.846511 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3e6891b5-ccc3-4286-ac3b-ad6214b9360b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:00.904380 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3e6891b5-ccc3-4286-ac3b-ad6214b9360b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:00.911815 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3e6891b5-ccc3-4286-ac3b-ad6214b9360b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077422 Oct 15 04:09:00.912369 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1034/2171] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:00 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:01.928611 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5117e9dc-c40e-4db5-918a-1ff392b176fc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:01.929264 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5117e9dc-c40e-4db5-918a-1ff392b176fc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:01.935509 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5117e9dc-c40e-4db5-918a-1ff392b176fc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:01.935978 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5117e9dc-c40e-4db5-918a-1ff392b176fc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:01.936721 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5117e9dc-c40e-4db5-918a-1ff392b176fc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:01.937148 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5117e9dc-c40e-4db5-918a-1ff392b176fc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:01.993761 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5117e9dc-c40e-4db5-918a-1ff392b176fc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:02.001788 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5117e9dc-c40e-4db5-918a-1ff392b176fc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076895 Oct 15 04:09:02.002331 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1138/2172] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:01 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:03.018263 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0bb5fb8c-0a11-48df-9d2c-cbad170218ee tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:03.018869 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0bb5fb8c-0a11-48df-9d2c-cbad170218ee tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:03.024647 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0bb5fb8c-0a11-48df-9d2c-cbad170218ee tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:03.025096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0bb5fb8c-0a11-48df-9d2c-cbad170218ee tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:03.025857 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0bb5fb8c-0a11-48df-9d2c-cbad170218ee tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:03.026293 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0bb5fb8c-0a11-48df-9d2c-cbad170218ee tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:03.084790 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-0bb5fb8c-0a11-48df-9d2c-cbad170218ee tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:03.092520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0bb5fb8c-0a11-48df-9d2c-cbad170218ee tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077918 Oct 15 04:09:03.093078 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1035/2173] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:03 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:04.108445 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-99e77cc0-18d2-471d-bf22-040acd3bde28 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:04.109039 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-99e77cc0-18d2-471d-bf22-040acd3bde28 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:04.114761 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-99e77cc0-18d2-471d-bf22-040acd3bde28 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:04.115212 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-99e77cc0-18d2-471d-bf22-040acd3bde28 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:04.115988 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-99e77cc0-18d2-471d-bf22-040acd3bde28 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:04.116424 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-99e77cc0-18d2-471d-bf22-040acd3bde28 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:04.174352 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-99e77cc0-18d2-471d-bf22-040acd3bde28 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:04.182028 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-99e77cc0-18d2-471d-bf22-040acd3bde28 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077763 Oct 15 04:09:04.182577 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1139/2174] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:04 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:05.199033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-902c3c37-5330-4534-9aaf-1ff65721f18b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:05.200294 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-902c3c37-5330-4534-9aaf-1ff65721f18b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:05.206306 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-902c3c37-5330-4534-9aaf-1ff65721f18b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:05.206815 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-902c3c37-5330-4534-9aaf-1ff65721f18b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:05.208140 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-902c3c37-5330-4534-9aaf-1ff65721f18b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:05.208913 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-902c3c37-5330-4534-9aaf-1ff65721f18b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:05.269964 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-902c3c37-5330-4534-9aaf-1ff65721f18b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:05.277552 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-902c3c37-5330-4534-9aaf-1ff65721f18b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.082171 Oct 15 04:09:05.278112 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1036/2175] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:05 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:06.294266 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-49c59728-342d-4ac7-a9b4-ff2d4c960f85 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:06.294882 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-49c59728-342d-4ac7-a9b4-ff2d4c960f85 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:06.300618 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-49c59728-342d-4ac7-a9b4-ff2d4c960f85 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:06.301065 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-49c59728-342d-4ac7-a9b4-ff2d4c960f85 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:06.301812 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-49c59728-342d-4ac7-a9b4-ff2d4c960f85 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:06.302243 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-49c59728-342d-4ac7-a9b4-ff2d4c960f85 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:06.362737 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-49c59728-342d-4ac7-a9b4-ff2d4c960f85 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:06.370154 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-49c59728-342d-4ac7-a9b4-ff2d4c960f85 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.079595 Oct 15 04:09:06.370704 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1140/2176] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:06 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:07.385769 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9ef8f8a1-0803-4340-93da-febe0b98f584 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:07.386372 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9ef8f8a1-0803-4340-93da-febe0b98f584 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:07.392049 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ef8f8a1-0803-4340-93da-febe0b98f584 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:07.392497 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ef8f8a1-0803-4340-93da-febe0b98f584 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:07.393251 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ef8f8a1-0803-4340-93da-febe0b98f584 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:07.393679 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9ef8f8a1-0803-4340-93da-febe0b98f584 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:07.452952 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-9ef8f8a1-0803-4340-93da-febe0b98f584 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:07.460563 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9ef8f8a1-0803-4340-93da-febe0b98f584 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078343 Oct 15 04:09:07.461124 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1037/2177] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:07 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:08.477458 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-88077e31-20e2-49eb-840e-0c77c92e0567 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:08.478060 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-88077e31-20e2-49eb-840e-0c77c92e0567 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:08.484463 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-88077e31-20e2-49eb-840e-0c77c92e0567 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:08.484955 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-88077e31-20e2-49eb-840e-0c77c92e0567 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:08.485719 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-88077e31-20e2-49eb-840e-0c77c92e0567 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:08.486145 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-88077e31-20e2-49eb-840e-0c77c92e0567 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:08.544977 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-88077e31-20e2-49eb-840e-0c77c92e0567 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:08.552617 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-88077e31-20e2-49eb-840e-0c77c92e0567 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078984 Oct 15 04:09:08.553164 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1141/2178] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:08 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:09.569282 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-eded75b1-ddc7-4e90-865f-4657dcb24f68 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:09.569862 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-eded75b1-ddc7-4e90-865f-4657dcb24f68 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:09.575574 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eded75b1-ddc7-4e90-865f-4657dcb24f68 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:09.576048 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eded75b1-ddc7-4e90-865f-4657dcb24f68 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:09.577421 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eded75b1-ddc7-4e90-865f-4657dcb24f68 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:09.577851 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eded75b1-ddc7-4e90-865f-4657dcb24f68 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:09.634435 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-eded75b1-ddc7-4e90-865f-4657dcb24f68 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:09.642728 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-eded75b1-ddc7-4e90-865f-4657dcb24f68 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077413 Oct 15 04:09:09.643288 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1038/2179] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:09 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:10.658657 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-aa85ff8b-fa8b-4fe7-9fc8-40892d643949 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:10.659196 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-aa85ff8b-fa8b-4fe7-9fc8-40892d643949 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:10.664904 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aa85ff8b-fa8b-4fe7-9fc8-40892d643949 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:10.665346 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aa85ff8b-fa8b-4fe7-9fc8-40892d643949 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:10.666090 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aa85ff8b-fa8b-4fe7-9fc8-40892d643949 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:10.666521 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-aa85ff8b-fa8b-4fe7-9fc8-40892d643949 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:10.727053 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-aa85ff8b-fa8b-4fe7-9fc8-40892d643949 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:10.734739 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-aa85ff8b-fa8b-4fe7-9fc8-40892d643949 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.080413 Oct 15 04:09:10.735288 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1142/2180] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:10 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 04:09:11.749882 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6fafb64e-4b07-409c-b43e-e48a6e32344e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:11.750489 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6fafb64e-4b07-409c-b43e-e48a6e32344e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:11.756181 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6fafb64e-4b07-409c-b43e-e48a6e32344e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:11.756626 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6fafb64e-4b07-409c-b43e-e48a6e32344e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:11.757385 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6fafb64e-4b07-409c-b43e-e48a6e32344e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:11.757813 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6fafb64e-4b07-409c-b43e-e48a6e32344e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:11.814968 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6fafb64e-4b07-409c-b43e-e48a6e32344e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:11.822673 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6fafb64e-4b07-409c-b43e-e48a6e32344e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076448 Oct 15 04:09:11.823233 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1039/2181] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:11 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:12.840458 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-42682fcc-7e04-44ad-bb22-75924e8af07b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:12.841826 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-42682fcc-7e04-44ad-bb22-75924e8af07b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:12.847553 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-42682fcc-7e04-44ad-bb22-75924e8af07b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:12.848029 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-42682fcc-7e04-44ad-bb22-75924e8af07b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:12.848779 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-42682fcc-7e04-44ad-bb22-75924e8af07b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:12.849206 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-42682fcc-7e04-44ad-bb22-75924e8af07b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:12.908906 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-42682fcc-7e04-44ad-bb22-75924e8af07b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:12.916414 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-42682fcc-7e04-44ad-bb22-75924e8af07b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.081204 Oct 15 04:09:12.916963 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1143/2182] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:12 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:13.933111 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-328719ad-3f53-429f-866a-b3934ce9be2d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:13.933715 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-328719ad-3f53-429f-866a-b3934ce9be2d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:13.939946 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-328719ad-3f53-429f-866a-b3934ce9be2d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:13.940388 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-328719ad-3f53-429f-866a-b3934ce9be2d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:13.941144 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-328719ad-3f53-429f-866a-b3934ce9be2d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:13.941572 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-328719ad-3f53-429f-866a-b3934ce9be2d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:13.998586 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-328719ad-3f53-429f-866a-b3934ce9be2d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:14.006620 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-328719ad-3f53-429f-866a-b3934ce9be2d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077144 Oct 15 04:09:14.007176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1040/2183] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:13 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:15.024182 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-268493bd-b0b6-4102-8108-0c28172615f9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:15.024902 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-268493bd-b0b6-4102-8108-0c28172615f9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:15.031413 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-268493bd-b0b6-4102-8108-0c28172615f9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:15.031894 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-268493bd-b0b6-4102-8108-0c28172615f9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:15.032649 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-268493bd-b0b6-4102-8108-0c28172615f9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:15.033082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-268493bd-b0b6-4102-8108-0c28172615f9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:15.090272 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-268493bd-b0b6-4102-8108-0c28172615f9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:15.098364 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-268493bd-b0b6-4102-8108-0c28172615f9 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078514 Oct 15 04:09:15.098920 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1144/2184] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:15 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:16.115079 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-47783d79-fbcb-463b-b32f-bf8ebc2e43f0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:16.115708 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-47783d79-fbcb-463b-b32f-bf8ebc2e43f0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:16.121440 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-47783d79-fbcb-463b-b32f-bf8ebc2e43f0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:16.121887 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-47783d79-fbcb-463b-b32f-bf8ebc2e43f0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:16.122636 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-47783d79-fbcb-463b-b32f-bf8ebc2e43f0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:16.123064 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-47783d79-fbcb-463b-b32f-bf8ebc2e43f0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:16.180630 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-47783d79-fbcb-463b-b32f-bf8ebc2e43f0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:16.188169 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-47783d79-fbcb-463b-b32f-bf8ebc2e43f0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076690 Oct 15 04:09:16.188724 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1041/2185] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:16 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:17.205308 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b44ab9a8-38cd-4b5e-9c3d-fe27d82358f1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:17.205853 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b44ab9a8-38cd-4b5e-9c3d-fe27d82358f1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:17.211533 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b44ab9a8-38cd-4b5e-9c3d-fe27d82358f1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:17.212015 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b44ab9a8-38cd-4b5e-9c3d-fe27d82358f1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:17.212770 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b44ab9a8-38cd-4b5e-9c3d-fe27d82358f1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:17.213204 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b44ab9a8-38cd-4b5e-9c3d-fe27d82358f1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:17.271382 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b44ab9a8-38cd-4b5e-9c3d-fe27d82358f1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:17.279092 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b44ab9a8-38cd-4b5e-9c3d-fe27d82358f1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078133 Oct 15 04:09:17.279638 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1145/2186] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:17 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:18.295499 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-675c9907-e306-4939-bb27-b85561e8b722 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:18.296141 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-675c9907-e306-4939-bb27-b85561e8b722 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:18.301828 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-675c9907-e306-4939-bb27-b85561e8b722 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:18.302270 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-675c9907-e306-4939-bb27-b85561e8b722 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:18.303022 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-675c9907-e306-4939-bb27-b85561e8b722 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:18.303445 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-675c9907-e306-4939-bb27-b85561e8b722 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:18.360797 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-675c9907-e306-4939-bb27-b85561e8b722 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:18.368362 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-675c9907-e306-4939-bb27-b85561e8b722 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076674 Oct 15 04:09:18.368914 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1042/2187] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:18 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:19.385227 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-84b50ad9-d7ad-461f-8526-3dc3c61f7f0f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:19.385776 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-84b50ad9-d7ad-461f-8526-3dc3c61f7f0f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:19.391572 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84b50ad9-d7ad-461f-8526-3dc3c61f7f0f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:19.392047 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84b50ad9-d7ad-461f-8526-3dc3c61f7f0f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:19.392805 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84b50ad9-d7ad-461f-8526-3dc3c61f7f0f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:19.393237 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84b50ad9-d7ad-461f-8526-3dc3c61f7f0f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:19.453450 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-84b50ad9-d7ad-461f-8526-3dc3c61f7f0f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:19.460985 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-84b50ad9-d7ad-461f-8526-3dc3c61f7f0f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.079526 Oct 15 04:09:19.461534 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1146/2188] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:19 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:20.478230 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-37d38e1d-5a38-4e9a-8cd7-17cb4e4dcd6c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:20.478757 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-37d38e1d-5a38-4e9a-8cd7-17cb4e4dcd6c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:20.484987 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-37d38e1d-5a38-4e9a-8cd7-17cb4e4dcd6c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:20.485433 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-37d38e1d-5a38-4e9a-8cd7-17cb4e4dcd6c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:20.486342 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-37d38e1d-5a38-4e9a-8cd7-17cb4e4dcd6c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:20.486773 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-37d38e1d-5a38-4e9a-8cd7-17cb4e4dcd6c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:20.544497 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-37d38e1d-5a38-4e9a-8cd7-17cb4e4dcd6c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:20.552541 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-37d38e1d-5a38-4e9a-8cd7-17cb4e4dcd6c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078203 Oct 15 04:09:20.553096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1043/2189] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:20 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:21.569176 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-68dbd07d-0ebc-439b-b26b-4dbef807977b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:21.569778 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-68dbd07d-0ebc-439b-b26b-4dbef807977b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:21.575576 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-68dbd07d-0ebc-439b-b26b-4dbef807977b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:21.576053 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-68dbd07d-0ebc-439b-b26b-4dbef807977b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:21.576799 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-68dbd07d-0ebc-439b-b26b-4dbef807977b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:21.577827 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-68dbd07d-0ebc-439b-b26b-4dbef807977b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:21.634543 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-68dbd07d-0ebc-439b-b26b-4dbef807977b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:21.642617 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-68dbd07d-0ebc-439b-b26b-4dbef807977b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077395 Oct 15 04:09:21.643170 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1147/2190] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:21 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:22.658695 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2c10eb08-8a2b-40a7-80fc-6125aace9f25 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:22.659297 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2c10eb08-8a2b-40a7-80fc-6125aace9f25 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:22.665082 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2c10eb08-8a2b-40a7-80fc-6125aace9f25 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:22.665524 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2c10eb08-8a2b-40a7-80fc-6125aace9f25 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:22.666277 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2c10eb08-8a2b-40a7-80fc-6125aace9f25 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:22.666702 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2c10eb08-8a2b-40a7-80fc-6125aace9f25 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:22.724443 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2c10eb08-8a2b-40a7-80fc-6125aace9f25 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:22.731997 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2c10eb08-8a2b-40a7-80fc-6125aace9f25 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077575 Oct 15 04:09:22.732550 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1044/2191] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:22 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:23.748374 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bb1d1249-bb33-4270-b8a4-91520c1576c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:23.748974 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bb1d1249-bb33-4270-b8a4-91520c1576c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:23.754712 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bb1d1249-bb33-4270-b8a4-91520c1576c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:23.755154 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bb1d1249-bb33-4270-b8a4-91520c1576c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:23.755935 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bb1d1249-bb33-4270-b8a4-91520c1576c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:23.756365 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bb1d1249-bb33-4270-b8a4-91520c1576c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:23.813643 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bb1d1249-bb33-4270-b8a4-91520c1576c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:23.821388 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bb1d1249-bb33-4270-b8a4-91520c1576c1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076692 Oct 15 04:09:23.821939 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1148/2192] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:23 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:24.838374 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2dcf7391-8069-4bd1-9892-b9674cc0384a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:24.838977 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2dcf7391-8069-4bd1-9892-b9674cc0384a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:24.845424 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2dcf7391-8069-4bd1-9892-b9674cc0384a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:24.845864 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2dcf7391-8069-4bd1-9892-b9674cc0384a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:24.846611 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2dcf7391-8069-4bd1-9892-b9674cc0384a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:24.847039 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2dcf7391-8069-4bd1-9892-b9674cc0384a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:24.903708 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2dcf7391-8069-4bd1-9892-b9674cc0384a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:24.911830 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2dcf7391-8069-4bd1-9892-b9674cc0384a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077264 Oct 15 04:09:24.912387 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1045/2193] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:24 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:25.928121 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6dc31794-77ee-41f8-8304-44245c9f2b9f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:25.928747 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6dc31794-77ee-41f8-8304-44245c9f2b9f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:25.934428 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6dc31794-77ee-41f8-8304-44245c9f2b9f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:25.934872 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6dc31794-77ee-41f8-8304-44245c9f2b9f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:25.935620 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6dc31794-77ee-41f8-8304-44245c9f2b9f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:25.936184 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6dc31794-77ee-41f8-8304-44245c9f2b9f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:25.995980 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6dc31794-77ee-41f8-8304-44245c9f2b9f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:26.003533 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6dc31794-77ee-41f8-8304-44245c9f2b9f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.079093 Oct 15 04:09:26.004142 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1149/2194] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:25 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:27.019899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9de26db5-40c0-4dbf-ad71-2d6678ac581d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:27.020532 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9de26db5-40c0-4dbf-ad71-2d6678ac581d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:27.026241 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9de26db5-40c0-4dbf-ad71-2d6678ac581d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:27.026684 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9de26db5-40c0-4dbf-ad71-2d6678ac581d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:27.027432 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9de26db5-40c0-4dbf-ad71-2d6678ac581d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:27.027889 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9de26db5-40c0-4dbf-ad71-2d6678ac581d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:27.087195 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-9de26db5-40c0-4dbf-ad71-2d6678ac581d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:27.094797 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9de26db5-40c0-4dbf-ad71-2d6678ac581d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078502 Oct 15 04:09:27.095350 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1046/2195] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:27 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:28.110429 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-34897483-1d93-4b37-b416-0e39a87d979f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:28.111035 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-34897483-1d93-4b37-b416-0e39a87d979f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:28.116787 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-34897483-1d93-4b37-b416-0e39a87d979f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:28.117229 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-34897483-1d93-4b37-b416-0e39a87d979f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:28.117983 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-34897483-1d93-4b37-b416-0e39a87d979f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:28.118410 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-34897483-1d93-4b37-b416-0e39a87d979f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:28.179768 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-34897483-1d93-4b37-b416-0e39a87d979f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:28.187882 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-34897483-1d93-4b37-b416-0e39a87d979f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.081042 Oct 15 04:09:28.188440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1150/2196] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:28 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:29.204480 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e9d067dc-5776-4f41-af7d-95e346685627 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:29.205139 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e9d067dc-5776-4f41-af7d-95e346685627 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:29.210995 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e9d067dc-5776-4f41-af7d-95e346685627 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:29.211441 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e9d067dc-5776-4f41-af7d-95e346685627 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:29.212633 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e9d067dc-5776-4f41-af7d-95e346685627 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:29.212633 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e9d067dc-5776-4f41-af7d-95e346685627 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:29.271795 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e9d067dc-5776-4f41-af7d-95e346685627 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:29.279315 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e9d067dc-5776-4f41-af7d-95e346685627 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078459 Oct 15 04:09:29.279921 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1047/2197] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:29 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:30.296652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3b1fd0a2-ec5d-4233-b5a8-af197d938ec1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:30.297342 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3b1fd0a2-ec5d-4233-b5a8-af197d938ec1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:30.303024 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b1fd0a2-ec5d-4233-b5a8-af197d938ec1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:30.303475 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b1fd0a2-ec5d-4233-b5a8-af197d938ec1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:30.304266 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b1fd0a2-ec5d-4233-b5a8-af197d938ec1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:30.304707 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3b1fd0a2-ec5d-4233-b5a8-af197d938ec1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:30.363788 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-3b1fd0a2-ec5d-4233-b5a8-af197d938ec1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:30.371386 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3b1fd0a2-ec5d-4233-b5a8-af197d938ec1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078938 Oct 15 04:09:30.372116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1151/2198] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:30 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:31.387697 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7fe12f7e-b39c-4ff2-8cc9-1ed58d5ef9d5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:31.388291 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7fe12f7e-b39c-4ff2-8cc9-1ed58d5ef9d5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:31.394496 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7fe12f7e-b39c-4ff2-8cc9-1ed58d5ef9d5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:31.394938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7fe12f7e-b39c-4ff2-8cc9-1ed58d5ef9d5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:31.395694 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7fe12f7e-b39c-4ff2-8cc9-1ed58d5ef9d5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:31.396126 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7fe12f7e-b39c-4ff2-8cc9-1ed58d5ef9d5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:31.453368 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7fe12f7e-b39c-4ff2-8cc9-1ed58d5ef9d5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:31.460875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7fe12f7e-b39c-4ff2-8cc9-1ed58d5ef9d5 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076778 Oct 15 04:09:31.461447 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1048/2199] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:31 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:32.479532 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-13d94c9d-c069-4c9e-944f-20f9d450070e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:32.480185 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-13d94c9d-c069-4c9e-944f-20f9d450070e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:32.486131 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-13d94c9d-c069-4c9e-944f-20f9d450070e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:32.486583 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-13d94c9d-c069-4c9e-944f-20f9d450070e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:32.487341 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-13d94c9d-c069-4c9e-944f-20f9d450070e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:32.487818 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-13d94c9d-c069-4c9e-944f-20f9d450070e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:32.550026 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-13d94c9d-c069-4c9e-944f-20f9d450070e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:32.557643 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-13d94c9d-c069-4c9e-944f-20f9d450070e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.084192 Oct 15 04:09:32.558231 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1152/2200] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:32 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:33.574369 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-dc332348-0405-4abf-9969-628d8c6d4225 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:33.574885 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-dc332348-0405-4abf-9969-628d8c6d4225 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:33.580622 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dc332348-0405-4abf-9969-628d8c6d4225 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:33.581067 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dc332348-0405-4abf-9969-628d8c6d4225 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:33.581809 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dc332348-0405-4abf-9969-628d8c6d4225 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:33.582236 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dc332348-0405-4abf-9969-628d8c6d4225 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:33.639199 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-dc332348-0405-4abf-9969-628d8c6d4225 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:33.646709 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-dc332348-0405-4abf-9969-628d8c6d4225 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076065 Oct 15 04:09:33.647259 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1049/2201] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:33 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:34.663718 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ee0c5473-e51f-47da-a5b7-c94ee6862dd1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:34.664257 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ee0c5473-e51f-47da-a5b7-c94ee6862dd1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:34.669934 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ee0c5473-e51f-47da-a5b7-c94ee6862dd1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:34.670390 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ee0c5473-e51f-47da-a5b7-c94ee6862dd1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:34.671626 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ee0c5473-e51f-47da-a5b7-c94ee6862dd1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:34.672076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ee0c5473-e51f-47da-a5b7-c94ee6862dd1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:34.729419 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ee0c5473-e51f-47da-a5b7-c94ee6862dd1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:34.737494 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ee0c5473-e51f-47da-a5b7-c94ee6862dd1 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077473 Oct 15 04:09:34.738045 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1153/2202] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:34 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:35.753439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f0fd293f-1e9c-4cb0-95e4-9cc8a0de2b24 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:35.753987 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f0fd293f-1e9c-4cb0-95e4-9cc8a0de2b24 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:35.759669 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f0fd293f-1e9c-4cb0-95e4-9cc8a0de2b24 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:35.760142 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f0fd293f-1e9c-4cb0-95e4-9cc8a0de2b24 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:35.760893 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f0fd293f-1e9c-4cb0-95e4-9cc8a0de2b24 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:35.761322 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f0fd293f-1e9c-4cb0-95e4-9cc8a0de2b24 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:35.819318 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f0fd293f-1e9c-4cb0-95e4-9cc8a0de2b24 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:35.826774 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f0fd293f-1e9c-4cb0-95e4-9cc8a0de2b24 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077078 Oct 15 04:09:35.827364 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1050/2203] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:35 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:36.841777 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5f66a729-fc73-4858-8ffa-d05a4904cb86 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:36.842379 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5f66a729-fc73-4858-8ffa-d05a4904cb86 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:36.848046 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5f66a729-fc73-4858-8ffa-d05a4904cb86 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:36.848495 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5f66a729-fc73-4858-8ffa-d05a4904cb86 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:36.849247 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5f66a729-fc73-4858-8ffa-d05a4904cb86 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:36.849664 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5f66a729-fc73-4858-8ffa-d05a4904cb86 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:36.908901 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5f66a729-fc73-4858-8ffa-d05a4904cb86 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:36.916356 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5f66a729-fc73-4858-8ffa-d05a4904cb86 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078145 Oct 15 04:09:36.916909 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1154/2204] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:36 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:37.933013 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-82a447c0-b264-49b8-81b7-a4be6394d6d2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:37.933631 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-82a447c0-b264-49b8-81b7-a4be6394d6d2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:37.940074 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-82a447c0-b264-49b8-81b7-a4be6394d6d2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:37.940525 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-82a447c0-b264-49b8-81b7-a4be6394d6d2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:37.941286 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-82a447c0-b264-49b8-81b7-a4be6394d6d2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:37.941723 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-82a447c0-b264-49b8-81b7-a4be6394d6d2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:37.999448 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-82a447c0-b264-49b8-81b7-a4be6394d6d2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:38.007057 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-82a447c0-b264-49b8-81b7-a4be6394d6d2 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077678 Oct 15 04:09:38.007628 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1051/2205] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:37 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:39.024064 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1f3095e4-8c4c-495a-aff7-c2e436c2b38d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:39.024675 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1f3095e4-8c4c-495a-aff7-c2e436c2b38d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:39.030706 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1f3095e4-8c4c-495a-aff7-c2e436c2b38d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:39.031476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1f3095e4-8c4c-495a-aff7-c2e436c2b38d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:39.032768 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1f3095e4-8c4c-495a-aff7-c2e436c2b38d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:39.033442 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1f3095e4-8c4c-495a-aff7-c2e436c2b38d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:39.095732 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1f3095e4-8c4c-495a-aff7-c2e436c2b38d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:39.103477 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1f3095e4-8c4c-495a-aff7-c2e436c2b38d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.083044 Oct 15 04:09:39.104068 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1155/2206] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:39 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:40.119806 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-07924481-6182-4bcd-92f4-9b4ff0390bfc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:40.120413 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-07924481-6182-4bcd-92f4-9b4ff0390bfc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:40.127283 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-07924481-6182-4bcd-92f4-9b4ff0390bfc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:40.127750 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-07924481-6182-4bcd-92f4-9b4ff0390bfc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:40.128509 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-07924481-6182-4bcd-92f4-9b4ff0390bfc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:40.128939 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-07924481-6182-4bcd-92f4-9b4ff0390bfc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:40.187118 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-07924481-6182-4bcd-92f4-9b4ff0390bfc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:40.194966 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-07924481-6182-4bcd-92f4-9b4ff0390bfc tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078909 Oct 15 04:09:40.195527 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1052/2207] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:40 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:41.009117 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-86d50161-7352-4132-a400-d1707b74b2ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:41.009656 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-86d50161-7352-4132-a400-d1707b74b2ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:41.015293 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-86d50161-7352-4132-a400-d1707b74b2ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:41.015787 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-86d50161-7352-4132-a400-d1707b74b2ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:41.016589 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-86d50161-7352-4132-a400-d1707b74b2ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:41.017057 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-86d50161-7352-4132-a400-d1707b74b2ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:41.029867 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.wsgi [None req-86d50161-7352-4132-a400-d1707b74b2ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] HTTP exception thrown: Instance 371d7064-a347-4a52-8bae-af61850faddc could not be found. Oct 15 04:09:41.030954 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-86d50161-7352-4132-a400-d1707b74b2ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Returning 404 to user: Instance 371d7064-a347-4a52-8bae-af61850faddc could not be found. {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 04:09:41.031782 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-86d50161-7352-4132-a400-d1707b74b2ce tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "DELETE /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc" status: 404 len: 111 microversion: 2.1 time: 0.026313 Oct 15 04:09:41.032289 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1156/2208] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 04:09:41 2021] DELETE /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 04:09:41.039841 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b7297bec-6e65-44b9-a820-0d0f565c6ae1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:41.040453 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b7297bec-6e65-44b9-a820-0d0f565c6ae1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 371d7064-a347-4a52-8bae-af61850faddc] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:41.047054 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b7297bec-6e65-44b9-a820-0d0f565c6ae1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:41.047886 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b7297bec-6e65-44b9-a820-0d0f565c6ae1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:41.049171 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b7297bec-6e65-44b9-a820-0d0f565c6ae1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:41.049717 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b7297bec-6e65-44b9-a820-0d0f565c6ae1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:41.064024 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-b7297bec-6e65-44b9-a820-0d0f565c6ae1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] HTTP exception thrown: Instance 371d7064-a347-4a52-8bae-af61850faddc could not be found. Oct 15 04:09:41.064613 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b7297bec-6e65-44b9-a820-0d0f565c6ae1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Returning 404 to user: Instance 371d7064-a347-4a52-8bae-af61850faddc could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 04:09:41.065426 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b7297bec-6e65-44b9-a820-0d0f565c6ae1 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc" status: 404 len: 111 microversion: 2.1 time: 0.029218 Oct 15 04:09:41.065951 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1053/2209] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:41 2021] GET /compute/v2.1/servers/371d7064-a347-4a52-8bae-af61850faddc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 04:09:41.211757 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a3f34c6c-3248-4c99-b916-b8131178c026 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:41.212312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a3f34c6c-3248-4c99-b916-b8131178c026 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:41.218730 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a3f34c6c-3248-4c99-b916-b8131178c026 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:41.219173 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a3f34c6c-3248-4c99-b916-b8131178c026 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:41.219962 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a3f34c6c-3248-4c99-b916-b8131178c026 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:41.220401 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a3f34c6c-3248-4c99-b916-b8131178c026 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:41.279114 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a3f34c6c-3248-4c99-b916-b8131178c026 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:41.286890 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a3f34c6c-3248-4c99-b916-b8131178c026 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.078820 Oct 15 04:09:41.287442 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1157/2210] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:41 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:42.303693 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9f838558-cda5-4b3a-a044-071cb668212f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:42.304318 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9f838558-cda5-4b3a-a044-071cb668212f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:42.310133 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9f838558-cda5-4b3a-a044-071cb668212f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:42.310584 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9f838558-cda5-4b3a-a044-071cb668212f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:42.311366 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9f838558-cda5-4b3a-a044-071cb668212f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:42.311827 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9f838558-cda5-4b3a-a044-071cb668212f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:42.369682 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-9f838558-cda5-4b3a-a044-071cb668212f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:42.377816 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9f838558-cda5-4b3a-a044-071cb668212f tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077766 Oct 15 04:09:42.378365 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1054/2211] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:42 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:43.394447 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0892d93e-5e66-4ff3-bd0b-0d1bfbbd357b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:43.395054 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0892d93e-5e66-4ff3-bd0b-0d1bfbbd357b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:43.400834 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0892d93e-5e66-4ff3-bd0b-0d1bfbbd357b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:43.401285 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0892d93e-5e66-4ff3-bd0b-0d1bfbbd357b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:43.402033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0892d93e-5e66-4ff3-bd0b-0d1bfbbd357b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:43.402467 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0892d93e-5e66-4ff3-bd0b-0d1bfbbd357b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:43.460190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0892d93e-5e66-4ff3-bd0b-0d1bfbbd357b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:43.472801 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0892d93e-5e66-4ff3-bd0b-0d1bfbbd357b tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.081938 Oct 15 04:09:43.473371 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1158/2212] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:43 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:44.490294 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e80c4a7c-cf34-4e34-b49b-971c3e12e87e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:44.490900 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e80c4a7c-cf34-4e34-b49b-971c3e12e87e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:44.496651 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e80c4a7c-cf34-4e34-b49b-971c3e12e87e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:44.497033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e80c4a7c-cf34-4e34-b49b-971c3e12e87e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:44.497783 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e80c4a7c-cf34-4e34-b49b-971c3e12e87e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:44.498207 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e80c4a7c-cf34-4e34-b49b-971c3e12e87e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:44.555801 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e80c4a7c-cf34-4e34-b49b-971c3e12e87e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:44.563168 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e80c4a7c-cf34-4e34-b49b-971c3e12e87e tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076515 Oct 15 04:09:44.563738 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1055/2213] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:44 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:45.579826 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d7896972-d503-445c-8823-d3885ee2a0c6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:45.580399 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d7896972-d503-445c-8823-d3885ee2a0c6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:45.586034 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7896972-d503-445c-8823-d3885ee2a0c6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:45.586472 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7896972-d503-445c-8823-d3885ee2a0c6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:45.587215 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7896972-d503-445c-8823-d3885ee2a0c6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:45.587639 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d7896972-d503-445c-8823-d3885ee2a0c6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:45.647659 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d7896972-d503-445c-8823-d3885ee2a0c6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:45.655695 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d7896972-d503-445c-8823-d3885ee2a0c6 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.079099 Oct 15 04:09:45.656243 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1159/2214] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:45 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:46.672419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4ade6583-7150-49c7-aaae-9770bc70ab1c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:46.673030 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4ade6583-7150-49c7-aaae-9770bc70ab1c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:46.678740 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4ade6583-7150-49c7-aaae-9770bc70ab1c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:46.679189 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4ade6583-7150-49c7-aaae-9770bc70ab1c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:46.679977 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4ade6583-7150-49c7-aaae-9770bc70ab1c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:46.680411 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4ade6583-7150-49c7-aaae-9770bc70ab1c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:46.738431 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4ade6583-7150-49c7-aaae-9770bc70ab1c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:46.745986 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4ade6583-7150-49c7-aaae-9770bc70ab1c tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077746 Oct 15 04:09:46.746539 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1056/2215] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:46 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:47.762446 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a4b4e558-69fb-48b4-96a8-aab2611e74ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:47.763199 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a4b4e558-69fb-48b4-96a8-aab2611e74ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:47.769555 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4b4e558-69fb-48b4-96a8-aab2611e74ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:47.770003 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4b4e558-69fb-48b4-96a8-aab2611e74ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:47.770758 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4b4e558-69fb-48b4-96a8-aab2611e74ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:47.771194 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a4b4e558-69fb-48b4-96a8-aab2611e74ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:47.828518 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a4b4e558-69fb-48b4-96a8-aab2611e74ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:47.836101 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a4b4e558-69fb-48b4-96a8-aab2611e74ea tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077127 Oct 15 04:09:47.836649 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1160/2216] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:47 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:48.851883 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5c0608f2-16d4-4d09-9409-e1e3666da44d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:48.852485 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5c0608f2-16d4-4d09-9409-e1e3666da44d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:48.858226 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c0608f2-16d4-4d09-9409-e1e3666da44d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:48.858668 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c0608f2-16d4-4d09-9409-e1e3666da44d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:48.859415 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c0608f2-16d4-4d09-9409-e1e3666da44d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:48.859872 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5c0608f2-16d4-4d09-9409-e1e3666da44d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:48.917400 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-5c0608f2-16d4-4d09-9409-e1e3666da44d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:48.925185 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5c0608f2-16d4-4d09-9409-e1e3666da44d tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.076856 Oct 15 04:09:48.925744 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1057/2217] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:48 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:49.942022 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ca333ac4-eb97-4909-a31d-0ad35e77c279 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:49.942557 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ca333ac4-eb97-4909-a31d-0ad35e77c279 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:49.948612 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ca333ac4-eb97-4909-a31d-0ad35e77c279 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:49.949062 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ca333ac4-eb97-4909-a31d-0ad35e77c279 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:49.949822 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ca333ac4-eb97-4909-a31d-0ad35e77c279 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:49.950258 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ca333ac4-eb97-4909-a31d-0ad35e77c279 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:50.008009 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ca333ac4-eb97-4909-a31d-0ad35e77c279 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:50.016195 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ca333ac4-eb97-4909-a31d-0ad35e77c279 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.077905 Oct 15 04:09:50.016755 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1161/2218] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:49 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:51.032710 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-eb49cc87-c3e5-4046-b866-8c74b9b05df0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:51.033322 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-eb49cc87-c3e5-4046-b866-8c74b9b05df0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:51.039129 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eb49cc87-c3e5-4046-b866-8c74b9b05df0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:51.039576 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eb49cc87-c3e5-4046-b866-8c74b9b05df0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:51.040367 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eb49cc87-c3e5-4046-b866-8c74b9b05df0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:51.040800 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-eb49cc87-c3e5-4046-b866-8c74b9b05df0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:51.101762 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-eb49cc87-c3e5-4046-b866-8c74b9b05df0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:51.110566 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-eb49cc87-c3e5-4046-b866-8c74b9b05df0 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.081586 Oct 15 04:09:51.111136 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1058/2219] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:51 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:52.127526 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-927f01dc-b66a-4906-b1aa-b11386735391 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:52.128175 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-927f01dc-b66a-4906-b1aa-b11386735391 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:52.133985 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-927f01dc-b66a-4906-b1aa-b11386735391 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:52.134433 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-927f01dc-b66a-4906-b1aa-b11386735391 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:52.135191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-927f01dc-b66a-4906-b1aa-b11386735391 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:52.135631 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-927f01dc-b66a-4906-b1aa-b11386735391 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:52.196490 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-927f01dc-b66a-4906-b1aa-b11386735391 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e012909f2e14c9c9e8c93d76aead42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4687122800414ea6b0203e53a18a54ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:09:52.204897 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-927f01dc-b66a-4906-b1aa-b11386735391 tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 200 len: 1353 microversion: 2.1 time: 0.081743 Oct 15 04:09:52.205456 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1162/2220] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:52 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:09:53.222115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fa9799b9-facd-4a17-96cb-3e0241758a9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:09:53.222668 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fa9799b9-facd-4a17-96cb-3e0241758a9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] [instance: c33f5b74-7b6d-44da-870a-cff6c079605d] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:09:53.228453 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fa9799b9-facd-4a17-96cb-3e0241758a9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:53.228902 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fa9799b9-facd-4a17-96cb-3e0241758a9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:53.229658 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fa9799b9-facd-4a17-96cb-3e0241758a9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:09:53.230098 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fa9799b9-facd-4a17-96cb-3e0241758a9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:09:53.243617 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-fa9799b9-facd-4a17-96cb-3e0241758a9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] HTTP exception thrown: Instance c33f5b74-7b6d-44da-870a-cff6c079605d could not be found. Oct 15 04:09:53.244061 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fa9799b9-facd-4a17-96cb-3e0241758a9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] Returning 404 to user: Instance c33f5b74-7b6d-44da-870a-cff6c079605d could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 04:09:53.244910 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fa9799b9-facd-4a17-96cb-3e0241758a9a tempest-ServerRescueNegativeTestJSON-26107288 tempest-ServerRescueNegativeTestJSON-26107288-project] 10.222.0.30 "GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d" status: 404 len: 111 microversion: 2.1 time: 0.026590 Oct 15 04:09:53.245439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1059/2221] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:09:53 2021] GET /compute/v2.1/servers/c33f5b74-7b6d-44da-870a-cff6c079605d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 04:09:58.197414 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:09:58.197997 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 04:09:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:09:59.103202 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:09:59.104663 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 04:09:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:10:01.352423 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-11cc5c66-355c-412c-aa93-8479c6cc1e34 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'create', calling method: .version_select at 0x7f4abcb6b430>, body: {"keypair": {"name": "tempest-keypair-1419519068"}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:01.369785 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-11cc5c66-355c-412c-aa93-8479c6cc1e34 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Getting quotas for project 8a2f64c8564f447d84849db55e0b0573. Resources: {'key_pairs'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 04:10:01.374129 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-11cc5c66-355c-412c-aa93-8479c6cc1e34 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Getting quotas for user 987993288a1a42dfa808e39eab41c82c and project 8a2f64c8564f447d84849db55e0b0573. Resources: {'key_pairs'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 04:10:01.385799 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: ERROR oslo.messaging._drivers.impl_rabbit [None req-11cc5c66-355c-412c-aa93-8479c6cc1e34 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [63ac3031-30ce-4001-9f80-bf1ea5d43fc0] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 15 04:10:02.403087 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [None req-11cc5c66-355c-412c-aa93-8479c6cc1e34 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [63ac3031-30ce-4001-9f80-bf1ea5d43fc0] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 42486. Oct 15 04:10:02.689412 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-11cc5c66-355c-412c-aa93-8479c6cc1e34 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Getting quotas for project 8a2f64c8564f447d84849db55e0b0573. Resources: {'key_pairs'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 04:10:02.695411 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-11cc5c66-355c-412c-aa93-8479c6cc1e34 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Getting quotas for user 987993288a1a42dfa808e39eab41c82c and project 8a2f64c8564f447d84849db55e0b0573. Resources: {'key_pairs'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 04:10:02.711483 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-11cc5c66-355c-412c-aa93-8479c6cc1e34 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.486009 Oct 15 04:10:02.712102 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1163/2222] 10.222.0.30 () {60 vars in 1157 bytes} [Fri Oct 15 04:10:01 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:10:04.058314 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2368a113-f504-439d-b906-e6b8200b3979 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1622987616", "imageRef": "0ec12dbd-23ec-4d58-b215-4e3cd5f17594", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4fa67cb1-3493-4482-a3e1-9660863c9411"}], "security_groups": [{"name": "tempest-securitygroup--379836819"}], "key_name": "tempest-keypair-1419519068", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:04.158114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.network.neutron [None req-2368a113-f504-439d-b906-e6b8200b3979 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] validate_networks() for [('4fa67cb1-3493-4482-a3e1-9660863c9411', None, None, None, None, None)] {{(pid=120899) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 15 04:10:04.599293 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-2368a113-f504-439d-b906-e6b8200b3979 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Flavor limits 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 04:10:04.599741 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-2368a113-f504-439d-b906-e6b8200b3979 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Image limits 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 04:10:04.600216 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-2368a113-f504-439d-b906-e6b8200b3979 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Flavor pref 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 04:10:04.600625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-2368a113-f504-439d-b906-e6b8200b3979 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Image pref 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 04:10:04.601070 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-2368a113-f504-439d-b906-e6b8200b3979 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 04:10:04.610564 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2368a113-f504-439d-b906-e6b8200b3979 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:04.611003 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2368a113-f504-439d-b906-e6b8200b3979 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:04.611846 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2368a113-f504-439d-b906-e6b8200b3979 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:04.612284 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2368a113-f504-439d-b906-e6b8200b3979 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:04.629027 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-2368a113-f504-439d-b906-e6b8200b3979 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Getting quotas for project 8a2f64c8564f447d84849db55e0b0573. Resources: {'cores', 'instances', 'ram'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 04:10:04.633010 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-2368a113-f504-439d-b906-e6b8200b3979 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Getting quotas for user 987993288a1a42dfa808e39eab41c82c and project 8a2f64c8564f447d84849db55e0b0573. Resources: {'cores', 'instances', 'ram'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 04:10:04.644117 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2368a113-f504-439d-b906-e6b8200b3979 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Going to run 1 instances... {{(pid=120899) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 15 04:10:04.646541 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2368a113-f504-439d-b906-e6b8200b3979 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ec12dbd-23ec-4d58-b215-4e3cd5f17594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120899) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 15 04:10:04.694491 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2368a113-f504-439d-b906-e6b8200b3979 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.640149 Oct 15 04:10:04.695154 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1060/2223] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Oct 15 04:10:04 2021] POST /compute/v2.1/servers => generated 401 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 04:10:04.705080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d69bb59a-4877-4e00-a183-96ad1138f640 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:10:04.705747 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d69bb59a-4877-4e00-a183-96ad1138f640 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:04.759990 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d69bb59a-4877-4e00-a183-96ad1138f640 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:10:04.766384 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d69bb59a-4877-4e00-a183-96ad1138f640 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1238 microversion: 2.1 time: 0.065289 Oct 15 04:10:04.766945 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1164/2224] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:10:04 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:10:05.783375 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f9e626c8-ff01-41fa-a748-1bd598ba61cb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:10:05.784393 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f9e626c8-ff01-41fa-a748-1bd598ba61cb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:05.791162 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f9e626c8-ff01-41fa-a748-1bd598ba61cb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:05.791609 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f9e626c8-ff01-41fa-a748-1bd598ba61cb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:05.792401 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f9e626c8-ff01-41fa-a748-1bd598ba61cb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:05.792827 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f9e626c8-ff01-41fa-a748-1bd598ba61cb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:05.867276 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-f9e626c8-ff01-41fa-a748-1bd598ba61cb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:10:05.875938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f9e626c8-ff01-41fa-a748-1bd598ba61cb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1296 microversion: 2.1 time: 0.096283 Oct 15 04:10:05.876596 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1061/2225] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:10:05 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1296 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:10:06.893325 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-18c664fb-98af-40d2-a991-c8aff1b0021b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:10:06.894559 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-18c664fb-98af-40d2-a991-c8aff1b0021b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:06.906612 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18c664fb-98af-40d2-a991-c8aff1b0021b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:06.907076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18c664fb-98af-40d2-a991-c8aff1b0021b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:06.911401 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18c664fb-98af-40d2-a991-c8aff1b0021b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:06.911929 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-18c664fb-98af-40d2-a991-c8aff1b0021b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:07.146241 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-18c664fb-98af-40d2-a991-c8aff1b0021b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:10:07.162881 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-18c664fb-98af-40d2-a991-c8aff1b0021b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1363 microversion: 2.1 time: 0.273829 Oct 15 04:10:07.168433 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1165/2226] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:10:06 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:10:07.214194 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-ae4301de-1baf-4df5-9063-89cefff70143 req-9481df25-bddc-4921-bb5a-0444cfd4e98a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e", "tag": "1a982e98-69d2-46fe-948f-0bb47e46c5c4"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:07.215875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:10:07.215875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 04:10:07.224871 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-ae4301de-1baf-4df5-9063-89cefff70143 req-9481df25-bddc-4921-bb5a-0444cfd4e98a service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:07.226212 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-ae4301de-1baf-4df5-9063-89cefff70143 req-9481df25-bddc-4921-bb5a-0444cfd4e98a service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:07.238565 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-ae4301de-1baf-4df5-9063-89cefff70143 req-9481df25-bddc-4921-bb5a-0444cfd4e98a service nova] Creating event network-changed:1a982e98-69d2-46fe-948f-0bb47e46c5c4 for instance ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e on hv-cinder-81410 Oct 15 04:10:07.242309 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: ERROR oslo.messaging._drivers.impl_rabbit [req-ae4301de-1baf-4df5-9063-89cefff70143 req-9481df25-bddc-4921-bb5a-0444cfd4e98a service nova] [65706e5e-5289-48f5-9ef5-a017179fe41f] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 15 04:10:08.179494 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2f883db1-42c2-43ed-8669-d7d1beecb5cf tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:10:08.180113 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2f883db1-42c2-43ed-8669-d7d1beecb5cf tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:08.186061 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2f883db1-42c2-43ed-8669-d7d1beecb5cf tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:08.186486 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2f883db1-42c2-43ed-8669-d7d1beecb5cf tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:08.187234 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2f883db1-42c2-43ed-8669-d7d1beecb5cf tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:08.187664 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2f883db1-42c2-43ed-8669-d7d1beecb5cf tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:08.260029 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [req-ae4301de-1baf-4df5-9063-89cefff70143 req-9481df25-bddc-4921-bb5a-0444cfd4e98a service nova] [65706e5e-5289-48f5-9ef5-a017179fe41f] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 42564. Oct 15 04:10:08.263420 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-ae4301de-1baf-4df5-9063-89cefff70143 req-9481df25-bddc-4921-bb5a-0444cfd4e98a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.150970 Oct 15 04:10:08.264045 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1062/2227] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:10:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:10:08.334090 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-2f883db1-42c2-43ed-8669-d7d1beecb5cf tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:10:08.341206 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2f883db1-42c2-43ed-8669-d7d1beecb5cf tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1363 microversion: 2.1 time: 0.165375 Oct 15 04:10:08.341807 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1166/2228] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:10:08 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 04:10:09.359221 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7c903862-cb48-4deb-8ebb-a360355ccdc7 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:10:09.359890 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7c903862-cb48-4deb-8ebb-a360355ccdc7 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:09.365998 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7c903862-cb48-4deb-8ebb-a360355ccdc7 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:09.366446 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7c903862-cb48-4deb-8ebb-a360355ccdc7 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:09.367193 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7c903862-cb48-4deb-8ebb-a360355ccdc7 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:09.367623 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7c903862-cb48-4deb-8ebb-a360355ccdc7 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:09.486957 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7c903862-cb48-4deb-8ebb-a360355ccdc7 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:10:09.493982 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7c903862-cb48-4deb-8ebb-a360355ccdc7 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1363 microversion: 2.1 time: 0.139389 Oct 15 04:10:09.494532 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1063/2229] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:10:09 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1363 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:10:10.509553 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-55791e76-b3a7-4764-9d0d-366b895903f9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:10:10.510165 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-55791e76-b3a7-4764-9d0d-366b895903f9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:10.515964 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-55791e76-b3a7-4764-9d0d-366b895903f9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:10.516413 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-55791e76-b3a7-4764-9d0d-366b895903f9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:10.517166 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-55791e76-b3a7-4764-9d0d-366b895903f9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:10.517597 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-55791e76-b3a7-4764-9d0d-366b895903f9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:10.634058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-55791e76-b3a7-4764-9d0d-366b895903f9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:10:10.641675 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-55791e76-b3a7-4764-9d0d-366b895903f9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1363 microversion: 2.1 time: 0.135729 Oct 15 04:10:10.642234 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1167/2230] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:10:10 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1363 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:10:11.657891 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-709d809b-99e9-4a85-ba31-2e5e2ccca111 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:10:11.658540 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-709d809b-99e9-4a85-ba31-2e5e2ccca111 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:11.664249 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-709d809b-99e9-4a85-ba31-2e5e2ccca111 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:11.664702 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-709d809b-99e9-4a85-ba31-2e5e2ccca111 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:11.665464 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-709d809b-99e9-4a85-ba31-2e5e2ccca111 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:11.665902 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-709d809b-99e9-4a85-ba31-2e5e2ccca111 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:11.781225 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-709d809b-99e9-4a85-ba31-2e5e2ccca111 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:10:11.788323 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-709d809b-99e9-4a85-ba31-2e5e2ccca111 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1363 microversion: 2.1 time: 0.134080 Oct 15 04:10:11.788884 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1064/2231] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:10:11 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1363 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:10:12.804784 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5357c9e5-9eb6-4b53-a540-000e24b5a311 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:10:12.805432 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5357c9e5-9eb6-4b53-a540-000e24b5a311 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:12.811736 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5357c9e5-9eb6-4b53-a540-000e24b5a311 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:12.812181 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5357c9e5-9eb6-4b53-a540-000e24b5a311 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:12.812925 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5357c9e5-9eb6-4b53-a540-000e24b5a311 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:12.813354 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5357c9e5-9eb6-4b53-a540-000e24b5a311 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:12.933861 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-5357c9e5-9eb6-4b53-a540-000e24b5a311 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:10:12.941669 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5357c9e5-9eb6-4b53-a540-000e24b5a311 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1363 microversion: 2.1 time: 0.140464 Oct 15 04:10:12.942225 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1168/2232] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:10:12 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1363 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:10:13.050010 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-da203052-ab54-4767-a3fa-c3ac1097f398 req-5d801332-594d-48fd-8008-4c7b3b81df29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e", "name": "network-vif-plugged", "status": "completed", "tag": "1a982e98-69d2-46fe-948f-0bb47e46c5c4"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:13.051498 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:10:13.051498 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 04:10:13.058175 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-da203052-ab54-4767-a3fa-c3ac1097f398 req-5d801332-594d-48fd-8008-4c7b3b81df29 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:13.058843 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-da203052-ab54-4767-a3fa-c3ac1097f398 req-5d801332-594d-48fd-8008-4c7b3b81df29 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:13.070345 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-da203052-ab54-4767-a3fa-c3ac1097f398 req-5d801332-594d-48fd-8008-4c7b3b81df29 service nova] Creating event network-vif-plugged:1a982e98-69d2-46fe-948f-0bb47e46c5c4 for instance ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e on hv-cinder-81410 Oct 15 04:10:13.075177 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-da203052-ab54-4767-a3fa-c3ac1097f398 req-5d801332-594d-48fd-8008-4c7b3b81df29 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083457 Oct 15 04:10:13.075849 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1065/2233] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:10:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:10:13.957944 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6af94d31-d341-4e07-8784-64f368d568d5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:10:13.958588 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6af94d31-d341-4e07-8784-64f368d568d5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:13.964406 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6af94d31-d341-4e07-8784-64f368d568d5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:13.964796 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6af94d31-d341-4e07-8784-64f368d568d5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:13.965550 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6af94d31-d341-4e07-8784-64f368d568d5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:13.965982 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6af94d31-d341-4e07-8784-64f368d568d5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:14.081329 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-6af94d31-d341-4e07-8784-64f368d568d5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:10:14.088308 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6af94d31-d341-4e07-8784-64f368d568d5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1363 microversion: 2.1 time: 0.133993 Oct 15 04:10:14.088861 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1169/2234] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:10:13 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1363 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:10:15.105380 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-13133045-88f1-4485-b256-bcb77154217c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:10:15.105995 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-13133045-88f1-4485-b256-bcb77154217c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:15.112509 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13133045-88f1-4485-b256-bcb77154217c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:15.112955 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13133045-88f1-4485-b256-bcb77154217c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:15.113710 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13133045-88f1-4485-b256-bcb77154217c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:15.114142 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-13133045-88f1-4485-b256-bcb77154217c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:15.233005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-13133045-88f1-4485-b256-bcb77154217c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:10:15.240323 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-13133045-88f1-4485-b256-bcb77154217c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1550 microversion: 2.1 time: 0.139049 Oct 15 04:10:15.240884 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1066/2235] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:10:15 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1550 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:10:15.256866 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7da03cb1-df71-4129-b0ff-110cf84774fc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:10:15.257365 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7da03cb1-df71-4129-b0ff-110cf84774fc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:15.263145 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7da03cb1-df71-4129-b0ff-110cf84774fc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:15.263592 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7da03cb1-df71-4129-b0ff-110cf84774fc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:15.264386 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7da03cb1-df71-4129-b0ff-110cf84774fc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:15.264820 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7da03cb1-df71-4129-b0ff-110cf84774fc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:15.344852 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7da03cb1-df71-4129-b0ff-110cf84774fc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091402 Oct 15 04:10:15.345510 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1170/2236] 10.222.0.30 () {58 vars in 1274 bytes} [Fri Oct 15 04:10:15 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:10:16.488405 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-73425dfc-1c0f-4315-8f38-af4cff76b036 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:16.489387 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-73425dfc-1c0f-4315-8f38-af4cff76b036 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:16.490770 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-55a08817-52a4-4eb7-9f2c-97bfa13cb8c2 req-f82bf7d1-1f95-4e2e-80c1-026a85d0efdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e", "tag": "1a982e98-69d2-46fe-948f-0bb47e46c5c4"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:16.492303 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:10:16.492303 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 04:10:16.495852 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-73425dfc-1c0f-4315-8f38-af4cff76b036 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:16.496266 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-73425dfc-1c0f-4315-8f38-af4cff76b036 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:16.497166 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-73425dfc-1c0f-4315-8f38-af4cff76b036 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:16.497612 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-73425dfc-1c0f-4315-8f38-af4cff76b036 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:16.499563 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-55a08817-52a4-4eb7-9f2c-97bfa13cb8c2 req-f82bf7d1-1f95-4e2e-80c1-026a85d0efdb service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:16.500040 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-55a08817-52a4-4eb7-9f2c-97bfa13cb8c2 req-f82bf7d1-1f95-4e2e-80c1-026a85d0efdb service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:16.511049 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-55a08817-52a4-4eb7-9f2c-97bfa13cb8c2 req-f82bf7d1-1f95-4e2e-80c1-026a85d0efdb service nova] Creating event network-changed:1a982e98-69d2-46fe-948f-0bb47e46c5c4 for instance ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e on hv-cinder-81410 Oct 15 04:10:16.516238 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-55a08817-52a4-4eb7-9f2c-97bfa13cb8c2 req-f82bf7d1-1f95-4e2e-80c1-026a85d0efdb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028886 Oct 15 04:10:16.517027 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1171/2237] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:10:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 04:10:16.559837 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-73425dfc-1c0f-4315-8f38-af4cff76b036 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 14 microversion: 2.1 time: 0.074870 Oct 15 04:10:16.563768 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1067/2238] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:16 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:10:17.572235 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-23b7f2d1-1d87-44f6-8216-957a49993577 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:17.573239 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-23b7f2d1-1d87-44f6-8216-957a49993577 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:17.579703 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-23b7f2d1-1d87-44f6-8216-957a49993577 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:17.580164 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-23b7f2d1-1d87-44f6-8216-957a49993577 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:17.580930 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-23b7f2d1-1d87-44f6-8216-957a49993577 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:17.581371 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-23b7f2d1-1d87-44f6-8216-957a49993577 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:17.637436 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-23b7f2d1-1d87-44f6-8216-957a49993577 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 14 microversion: 2.1 time: 0.069380 Oct 15 04:10:17.638073 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1172/2239] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:17 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 15 04:10:18.648701 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-18c5ac8f-c472-4b4d-908f-9941df853f2b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:18.649619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-18c5ac8f-c472-4b4d-908f-9941df853f2b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:18.656001 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18c5ac8f-c472-4b4d-908f-9941df853f2b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:18.656451 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18c5ac8f-c472-4b4d-908f-9941df853f2b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:18.657208 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18c5ac8f-c472-4b4d-908f-9941df853f2b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:18.657642 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-18c5ac8f-c472-4b4d-908f-9941df853f2b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:18.715769 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-18c5ac8f-c472-4b4d-908f-9941df853f2b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 14 microversion: 2.1 time: 0.071043 Oct 15 04:10:18.716349 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1068/2240] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:18 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:10:19.726802 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ee387185-f2b7-4442-a6c1-6613402a252a tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:19.727832 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ee387185-f2b7-4442-a6c1-6613402a252a tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:19.734231 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ee387185-f2b7-4442-a6c1-6613402a252a tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:19.734678 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ee387185-f2b7-4442-a6c1-6613402a252a tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:19.735434 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ee387185-f2b7-4442-a6c1-6613402a252a tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:19.735901 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ee387185-f2b7-4442-a6c1-6613402a252a tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:19.790491 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ee387185-f2b7-4442-a6c1-6613402a252a tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 14 microversion: 2.1 time: 0.067639 Oct 15 04:10:19.791052 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1173/2241] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:19 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:10:20.801650 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-dbbf648c-7a7b-43f5-8241-709755651634 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:20.802603 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-dbbf648c-7a7b-43f5-8241-709755651634 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:20.809013 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dbbf648c-7a7b-43f5-8241-709755651634 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:20.809459 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dbbf648c-7a7b-43f5-8241-709755651634 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:20.810755 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dbbf648c-7a7b-43f5-8241-709755651634 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:20.811191 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-dbbf648c-7a7b-43f5-8241-709755651634 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:20.865557 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-dbbf648c-7a7b-43f5-8241-709755651634 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 14 microversion: 2.1 time: 0.067902 Oct 15 04:10:20.866143 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1069/2242] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:20 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:10:21.876638 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-796052ba-a636-4ceb-8eef-93ad6eb46cf9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:21.877570 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-796052ba-a636-4ceb-8eef-93ad6eb46cf9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:21.883904 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-796052ba-a636-4ceb-8eef-93ad6eb46cf9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:21.884354 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-796052ba-a636-4ceb-8eef-93ad6eb46cf9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:21.885115 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-796052ba-a636-4ceb-8eef-93ad6eb46cf9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:21.885552 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-796052ba-a636-4ceb-8eef-93ad6eb46cf9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:21.940892 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-796052ba-a636-4ceb-8eef-93ad6eb46cf9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 14 microversion: 2.1 time: 0.068275 Oct 15 04:10:21.942153 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1174/2243] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:21 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:10:22.952848 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-45a85646-0a7d-43db-84c6-b00574982a08 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:22.953796 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-45a85646-0a7d-43db-84c6-b00574982a08 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:22.960131 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-45a85646-0a7d-43db-84c6-b00574982a08 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:22.960579 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-45a85646-0a7d-43db-84c6-b00574982a08 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:22.961338 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-45a85646-0a7d-43db-84c6-b00574982a08 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:22.961773 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-45a85646-0a7d-43db-84c6-b00574982a08 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:23.018712 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-45a85646-0a7d-43db-84c6-b00574982a08 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 14 microversion: 2.1 time: 0.070411 Oct 15 04:10:23.019290 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1070/2244] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:22 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:10:24.030302 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-105e4d1e-a6e1-494c-93d4-8c905e25a304 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:24.031295 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-105e4d1e-a6e1-494c-93d4-8c905e25a304 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:24.037611 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-105e4d1e-a6e1-494c-93d4-8c905e25a304 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:24.038054 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-105e4d1e-a6e1-494c-93d4-8c905e25a304 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:24.038801 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-105e4d1e-a6e1-494c-93d4-8c905e25a304 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:24.039232 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-105e4d1e-a6e1-494c-93d4-8c905e25a304 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:24.093977 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-105e4d1e-a6e1-494c-93d4-8c905e25a304 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 14 microversion: 2.1 time: 0.068135 Oct 15 04:10:24.094577 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1175/2245] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:24 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:10:25.105050 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c37aca2b-82e3-4b54-8d9f-7d6f189d9c66 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:25.106047 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c37aca2b-82e3-4b54-8d9f-7d6f189d9c66 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:25.112910 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c37aca2b-82e3-4b54-8d9f-7d6f189d9c66 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:25.113355 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c37aca2b-82e3-4b54-8d9f-7d6f189d9c66 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:25.114101 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c37aca2b-82e3-4b54-8d9f-7d6f189d9c66 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:25.114530 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c37aca2b-82e3-4b54-8d9f-7d6f189d9c66 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:25.172317 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c37aca2b-82e3-4b54-8d9f-7d6f189d9c66 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 14 microversion: 2.1 time: 0.071115 Oct 15 04:10:25.172893 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1071/2246] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:25 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:10:26.183478 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f8d9a0cd-caeb-4d40-8961-6fba53ee8ded tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:26.184429 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f8d9a0cd-caeb-4d40-8961-6fba53ee8ded tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:26.190827 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f8d9a0cd-caeb-4d40-8961-6fba53ee8ded tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:26.191274 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f8d9a0cd-caeb-4d40-8961-6fba53ee8ded tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:26.192069 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f8d9a0cd-caeb-4d40-8961-6fba53ee8ded tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:26.192772 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f8d9a0cd-caeb-4d40-8961-6fba53ee8ded tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:26.260483 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f8d9a0cd-caeb-4d40-8961-6fba53ee8ded tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 9596 microversion: 2.1 time: 0.081017 Oct 15 04:10:26.261133 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1176/2247] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:26 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 9596 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:10:27.272494 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a03eebe0-8f99-42f6-ab55-7c8ee50ea3c0 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:27.273495 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a03eebe0-8f99-42f6-ab55-7c8ee50ea3c0 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:27.280531 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a03eebe0-8f99-42f6-ab55-7c8ee50ea3c0 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:27.281083 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a03eebe0-8f99-42f6-ab55-7c8ee50ea3c0 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:27.282119 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a03eebe0-8f99-42f6-ab55-7c8ee50ea3c0 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:27.282880 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a03eebe0-8f99-42f6-ab55-7c8ee50ea3c0 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:27.352916 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a03eebe0-8f99-42f6-ab55-7c8ee50ea3c0 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 17055 microversion: 2.1 time: 0.084366 Oct 15 04:10:27.356132 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1072/2248] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:27 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 17055 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:28.364715 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c5d0bad1-ec36-4ff3-8249-399140e8ac46 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:28.365737 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c5d0bad1-ec36-4ff3-8249-399140e8ac46 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:28.372060 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c5d0bad1-ec36-4ff3-8249-399140e8ac46 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:28.372504 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c5d0bad1-ec36-4ff3-8249-399140e8ac46 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:28.373249 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c5d0bad1-ec36-4ff3-8249-399140e8ac46 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:28.373680 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c5d0bad1-ec36-4ff3-8249-399140e8ac46 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:28.440654 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c5d0bad1-ec36-4ff3-8249-399140e8ac46 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 18498 microversion: 2.1 time: 0.079871 Oct 15 04:10:28.441332 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1177/2249] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:28 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 18498 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:29.452505 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ffeabdf1-cd38-45e0-a360-c7cbc7cf59e1 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:29.453504 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ffeabdf1-cd38-45e0-a360-c7cbc7cf59e1 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:29.459777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ffeabdf1-cd38-45e0-a360-c7cbc7cf59e1 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:29.460221 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ffeabdf1-cd38-45e0-a360-c7cbc7cf59e1 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:29.460974 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ffeabdf1-cd38-45e0-a360-c7cbc7cf59e1 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:29.461412 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ffeabdf1-cd38-45e0-a360-c7cbc7cf59e1 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:29.531039 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ffeabdf1-cd38-45e0-a360-c7cbc7cf59e1 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 21172 microversion: 2.1 time: 0.082431 Oct 15 04:10:29.531599 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1073/2250] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:29 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 21172 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:30.541926 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b5b2f3a2-67dc-405f-a1bf-8dbbe5be4a82 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:30.542967 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b5b2f3a2-67dc-405f-a1bf-8dbbe5be4a82 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:30.549524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b5b2f3a2-67dc-405f-a1bf-8dbbe5be4a82 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:30.549972 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b5b2f3a2-67dc-405f-a1bf-8dbbe5be4a82 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:30.550728 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b5b2f3a2-67dc-405f-a1bf-8dbbe5be4a82 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:30.551161 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b5b2f3a2-67dc-405f-a1bf-8dbbe5be4a82 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:30.625716 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b5b2f3a2-67dc-405f-a1bf-8dbbe5be4a82 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 22981 microversion: 2.1 time: 0.087647 Oct 15 04:10:30.626536 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1178/2251] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:30 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 22981 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:31.637324 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1c992684-7b39-4795-b249-f1d3a3b84d14 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:31.638313 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1c992684-7b39-4795-b249-f1d3a3b84d14 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:31.644644 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1c992684-7b39-4795-b249-f1d3a3b84d14 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:31.645091 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1c992684-7b39-4795-b249-f1d3a3b84d14 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:31.645841 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1c992684-7b39-4795-b249-f1d3a3b84d14 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:31.646270 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1c992684-7b39-4795-b249-f1d3a3b84d14 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:31.718701 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1c992684-7b39-4795-b249-f1d3a3b84d14 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 24366 microversion: 2.1 time: 0.085215 Oct 15 04:10:31.719298 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1074/2252] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:31 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 24366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:32.730445 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d5bedaca-8877-40d8-ad43-95d10b9a068e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:32.731449 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d5bedaca-8877-40d8-ad43-95d10b9a068e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:32.737920 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d5bedaca-8877-40d8-ad43-95d10b9a068e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:32.738375 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d5bedaca-8877-40d8-ad43-95d10b9a068e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:32.739142 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d5bedaca-8877-40d8-ad43-95d10b9a068e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:32.739579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d5bedaca-8877-40d8-ad43-95d10b9a068e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:32.811606 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d5bedaca-8877-40d8-ad43-95d10b9a068e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 25991 microversion: 2.1 time: 0.085015 Oct 15 04:10:32.812260 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1179/2253] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:32 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 25991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:33.823026 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-735eee94-3228-410b-9125-bfd4f74b44ed tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:33.824072 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-735eee94-3228-410b-9125-bfd4f74b44ed tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:33.830924 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-735eee94-3228-410b-9125-bfd4f74b44ed tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:33.831375 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-735eee94-3228-410b-9125-bfd4f74b44ed tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:33.832167 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-735eee94-3228-410b-9125-bfd4f74b44ed tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:33.832606 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-735eee94-3228-410b-9125-bfd4f74b44ed tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:33.904540 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-735eee94-3228-410b-9125-bfd4f74b44ed tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 27251 microversion: 2.1 time: 0.084650 Oct 15 04:10:33.905057 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1075/2254] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:33 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 27251 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:34.916375 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b3d56383-18c4-4114-8764-b95a77047a78 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:34.917369 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b3d56383-18c4-4114-8764-b95a77047a78 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:34.924272 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b3d56383-18c4-4114-8764-b95a77047a78 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:34.924742 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b3d56383-18c4-4114-8764-b95a77047a78 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:34.925466 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b3d56383-18c4-4114-8764-b95a77047a78 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:34.925891 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b3d56383-18c4-4114-8764-b95a77047a78 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:35.005647 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b3d56383-18c4-4114-8764-b95a77047a78 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 27959 microversion: 2.1 time: 0.093228 Oct 15 04:10:35.006258 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1180/2255] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:34 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 27959 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:36.019272 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4d47f7ae-6408-4be9-9c5e-4f6d5efb41e5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:36.020510 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4d47f7ae-6408-4be9-9c5e-4f6d5efb41e5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:36.026619 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4d47f7ae-6408-4be9-9c5e-4f6d5efb41e5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:36.027072 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4d47f7ae-6408-4be9-9c5e-4f6d5efb41e5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:36.027963 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4d47f7ae-6408-4be9-9c5e-4f6d5efb41e5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:36.028398 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4d47f7ae-6408-4be9-9c5e-4f6d5efb41e5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:36.108737 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4d47f7ae-6408-4be9-9c5e-4f6d5efb41e5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 28269 microversion: 2.1 time: 0.094357 Oct 15 04:10:36.109382 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1076/2256] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:36 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 28269 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:37.120443 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-483e7b95-de95-4585-8860-042482d5746c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:37.121395 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-483e7b95-de95-4585-8860-042482d5746c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:37.128246 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-483e7b95-de95-4585-8860-042482d5746c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:37.128688 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-483e7b95-de95-4585-8860-042482d5746c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:37.129440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-483e7b95-de95-4585-8860-042482d5746c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:37.129875 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-483e7b95-de95-4585-8860-042482d5746c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:37.188677 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-483e7b95-de95-4585-8860-042482d5746c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 28269 microversion: 2.1 time: 0.072181 Oct 15 04:10:37.189289 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1181/2257] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:37 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 28269 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 04:10:38.200425 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a6e87e0c-9a76-4e11-9c7e-2eaf47c25f0c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:38.201939 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a6e87e0c-9a76-4e11-9c7e-2eaf47c25f0c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:38.208373 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a6e87e0c-9a76-4e11-9c7e-2eaf47c25f0c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:38.208820 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a6e87e0c-9a76-4e11-9c7e-2eaf47c25f0c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:38.209580 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a6e87e0c-9a76-4e11-9c7e-2eaf47c25f0c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:38.210012 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a6e87e0c-9a76-4e11-9c7e-2eaf47c25f0c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:38.288061 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a6e87e0c-9a76-4e11-9c7e-2eaf47c25f0c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 28560 microversion: 2.1 time: 0.091509 Oct 15 04:10:38.291229 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1077/2258] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:38 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 28560 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:39.300466 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e75efc4f-302f-458d-8a33-26599134989d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:39.301502 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e75efc4f-302f-458d-8a33-26599134989d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:39.307885 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e75efc4f-302f-458d-8a33-26599134989d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:39.308334 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e75efc4f-302f-458d-8a33-26599134989d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:39.309101 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e75efc4f-302f-458d-8a33-26599134989d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:39.309532 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e75efc4f-302f-458d-8a33-26599134989d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:39.394452 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e75efc4f-302f-458d-8a33-26599134989d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 28728 microversion: 2.1 time: 0.097859 Oct 15 04:10:39.395082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1182/2259] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:39 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 28728 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:40.406049 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f0530526-7574-4488-aa37-5008baacca0f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:40.407052 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f0530526-7574-4488-aa37-5008baacca0f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:40.413369 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f0530526-7574-4488-aa37-5008baacca0f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:40.413813 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f0530526-7574-4488-aa37-5008baacca0f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:40.414568 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f0530526-7574-4488-aa37-5008baacca0f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:40.414995 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f0530526-7574-4488-aa37-5008baacca0f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:40.474815 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f0530526-7574-4488-aa37-5008baacca0f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 28728 microversion: 2.1 time: 0.073147 Oct 15 04:10:40.475412 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1078/2260] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:40 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 28728 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:41.486452 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b3a30f26-eb79-4cd9-a84b-9dd63c6c6301 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:41.487440 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b3a30f26-eb79-4cd9-a84b-9dd63c6c6301 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:41.493816 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b3a30f26-eb79-4cd9-a84b-9dd63c6c6301 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:41.494213 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b3a30f26-eb79-4cd9-a84b-9dd63c6c6301 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:41.494962 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b3a30f26-eb79-4cd9-a84b-9dd63c6c6301 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:41.495394 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b3a30f26-eb79-4cd9-a84b-9dd63c6c6301 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:41.553777 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b3a30f26-eb79-4cd9-a84b-9dd63c6c6301 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 28728 microversion: 2.1 time: 0.071173 Oct 15 04:10:41.554377 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1183/2261] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:41 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 28728 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:42.566023 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-386dd693-1974-42a2-b1dd-892ec6508544 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:42.567269 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-386dd693-1974-42a2-b1dd-892ec6508544 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:42.573646 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-386dd693-1974-42a2-b1dd-892ec6508544 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:42.574095 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-386dd693-1974-42a2-b1dd-892ec6508544 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:42.574882 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-386dd693-1974-42a2-b1dd-892ec6508544 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:42.575318 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-386dd693-1974-42a2-b1dd-892ec6508544 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:42.648261 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-386dd693-1974-42a2-b1dd-892ec6508544 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 28881 microversion: 2.1 time: 0.086062 Oct 15 04:10:42.648875 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1079/2262] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:42 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 28881 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:43.660341 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e79da9ba-45db-426c-aae0-fe980a9e4415 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:43.661362 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e79da9ba-45db-426c-aae0-fe980a9e4415 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:43.667631 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e79da9ba-45db-426c-aae0-fe980a9e4415 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:43.668107 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e79da9ba-45db-426c-aae0-fe980a9e4415 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:43.668857 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e79da9ba-45db-426c-aae0-fe980a9e4415 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:43.669286 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e79da9ba-45db-426c-aae0-fe980a9e4415 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:43.738721 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e79da9ba-45db-426c-aae0-fe980a9e4415 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 31165 microversion: 2.1 time: 0.082225 Oct 15 04:10:43.739327 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1184/2263] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:43 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 31165 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:44.750225 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-74a756c3-d0e2-46af-93d7-07846272804b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:44.751228 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-74a756c3-d0e2-46af-93d7-07846272804b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:44.757618 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-74a756c3-d0e2-46af-93d7-07846272804b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:44.758067 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-74a756c3-d0e2-46af-93d7-07846272804b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:44.758829 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-74a756c3-d0e2-46af-93d7-07846272804b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:44.759267 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-74a756c3-d0e2-46af-93d7-07846272804b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:44.828188 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-74a756c3-d0e2-46af-93d7-07846272804b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 32645 microversion: 2.1 time: 0.082277 Oct 15 04:10:44.828965 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1080/2264] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:44 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 32645 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:45.840784 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-112ed3b1-028a-487b-b45c-e5f8ca9e289d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:45.841803 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-112ed3b1-028a-487b-b45c-e5f8ca9e289d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:45.848670 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-112ed3b1-028a-487b-b45c-e5f8ca9e289d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:45.849054 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-112ed3b1-028a-487b-b45c-e5f8ca9e289d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:45.849805 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-112ed3b1-028a-487b-b45c-e5f8ca9e289d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:45.850234 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-112ed3b1-028a-487b-b45c-e5f8ca9e289d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:45.922320 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-112ed3b1-028a-487b-b45c-e5f8ca9e289d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 33631 microversion: 2.1 time: 0.085860 Oct 15 04:10:45.922920 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1185/2265] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:45 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 33631 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 04:10:46.934375 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-20b101ec-58c3-46cc-ab9f-8835d995cc3f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:46.935349 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-20b101ec-58c3-46cc-ab9f-8835d995cc3f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:46.941945 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-20b101ec-58c3-46cc-ab9f-8835d995cc3f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:46.942653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-20b101ec-58c3-46cc-ab9f-8835d995cc3f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:46.943403 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-20b101ec-58c3-46cc-ab9f-8835d995cc3f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:46.943872 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-20b101ec-58c3-46cc-ab9f-8835d995cc3f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:47.015673 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-20b101ec-58c3-46cc-ab9f-8835d995cc3f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 35030 microversion: 2.1 time: 0.085252 Oct 15 04:10:47.016331 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1081/2266] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:46 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 35030 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:48.027738 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0ae1b46f-091f-45d0-81cd-19087b164ddc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:48.028776 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0ae1b46f-091f-45d0-81cd-19087b164ddc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:48.035808 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0ae1b46f-091f-45d0-81cd-19087b164ddc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:48.036258 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0ae1b46f-091f-45d0-81cd-19087b164ddc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:48.037021 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0ae1b46f-091f-45d0-81cd-19087b164ddc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:48.037451 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0ae1b46f-091f-45d0-81cd-19087b164ddc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:48.113825 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0ae1b46f-091f-45d0-81cd-19087b164ddc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 36592 microversion: 2.1 time: 0.089957 Oct 15 04:10:48.117882 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1186/2267] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:48 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 36592 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:49.126447 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-329d8686-4e88-409b-ab7c-2f5106a8df02 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:49.127508 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-329d8686-4e88-409b-ab7c-2f5106a8df02 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:49.133887 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-329d8686-4e88-409b-ab7c-2f5106a8df02 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:49.134333 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-329d8686-4e88-409b-ab7c-2f5106a8df02 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:49.135088 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-329d8686-4e88-409b-ab7c-2f5106a8df02 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:49.135518 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-329d8686-4e88-409b-ab7c-2f5106a8df02 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:49.203530 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-329d8686-4e88-409b-ab7c-2f5106a8df02 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 38067 microversion: 2.1 time: 0.081501 Oct 15 04:10:49.204169 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1082/2268] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:49 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 38067 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:50.215090 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a2a0339f-2f36-486d-ba53-3f95910deeed tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:50.216038 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a2a0339f-2f36-486d-ba53-3f95910deeed tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:50.222969 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a2a0339f-2f36-486d-ba53-3f95910deeed tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:50.223412 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a2a0339f-2f36-486d-ba53-3f95910deeed tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:50.224185 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a2a0339f-2f36-486d-ba53-3f95910deeed tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:50.224614 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a2a0339f-2f36-486d-ba53-3f95910deeed tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:50.295320 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a2a0339f-2f36-486d-ba53-3f95910deeed tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 38263 microversion: 2.1 time: 0.084130 Oct 15 04:10:50.295958 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1187/2269] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:50 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 38263 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:51.306791 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5ea0ce0c-d123-4ffe-a437-a48bc4550117 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:51.307814 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5ea0ce0c-d123-4ffe-a437-a48bc4550117 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:51.314708 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ea0ce0c-d123-4ffe-a437-a48bc4550117 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:51.315167 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ea0ce0c-d123-4ffe-a437-a48bc4550117 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:51.315950 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ea0ce0c-d123-4ffe-a437-a48bc4550117 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:51.316388 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5ea0ce0c-d123-4ffe-a437-a48bc4550117 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:51.375671 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5ea0ce0c-d123-4ffe-a437-a48bc4550117 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 38263 microversion: 2.1 time: 0.072764 Oct 15 04:10:51.376616 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1083/2270] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:51 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 38263 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:52.388013 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b9aa884f-41a2-47d0-964d-ccb74a57ffdb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:52.389009 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b9aa884f-41a2-47d0-964d-ccb74a57ffdb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:52.395951 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b9aa884f-41a2-47d0-964d-ccb74a57ffdb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:52.396396 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b9aa884f-41a2-47d0-964d-ccb74a57ffdb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:52.397150 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b9aa884f-41a2-47d0-964d-ccb74a57ffdb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:52.397581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b9aa884f-41a2-47d0-964d-ccb74a57ffdb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:52.455281 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b9aa884f-41a2-47d0-964d-ccb74a57ffdb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 38263 microversion: 2.1 time: 0.071248 Oct 15 04:10:52.456180 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1188/2271] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:52 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 38263 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:53.467448 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8af9ad8d-fac8-44f8-bed3-65c2273cde0e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:10:53.468544 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8af9ad8d-fac8-44f8-bed3-65c2273cde0e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:53.474850 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8af9ad8d-fac8-44f8-bed3-65c2273cde0e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:53.475299 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8af9ad8d-fac8-44f8-bed3-65c2273cde0e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:53.476089 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8af9ad8d-fac8-44f8-bed3-65c2273cde0e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:53.476526 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8af9ad8d-fac8-44f8-bed3-65c2273cde0e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:53.543937 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8af9ad8d-fac8-44f8-bed3-65c2273cde0e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 200 len: 38394 microversion: 2.1 time: 0.080304 Oct 15 04:10:53.544798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1084/2272] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:10:53 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 38394 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:10:53.555107 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e1ea1dc0-cc91-4760-b317-edfee0db74d7 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:10:53.555702 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e1ea1dc0-cc91-4760-b317-edfee0db74d7 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:10:53.562241 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1ea1dc0-cc91-4760-b317-edfee0db74d7 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:53.562744 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1ea1dc0-cc91-4760-b317-edfee0db74d7 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:53.563566 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1ea1dc0-cc91-4760-b317-edfee0db74d7 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:10:53.564032 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e1ea1dc0-cc91-4760-b317-edfee0db74d7 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:10:53.590824 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e1ea1dc0-cc91-4760-b317-edfee0db74d7 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/ips" status: 200 len: 147 microversion: 2.1 time: 0.039693 Oct 15 04:10:53.591397 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1189/2273] 10.222.0.30 () {58 vars in 1247 bytes} [Fri Oct 15 04:10:53 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:11:50.890641 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:11:50.891212 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 04:11:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:12:44.386904 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2cb6eeca-07af-4ae5-80a9-8aa19f0b75e3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff00d256-970d-49ed-8cec-9d97ea4ad3af"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:12:44.388111 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2cb6eeca-07af-4ae5-80a9-8aa19f0b75e3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:12:44.394523 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2cb6eeca-07af-4ae5-80a9-8aa19f0b75e3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:12:44.394972 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2cb6eeca-07af-4ae5-80a9-8aa19f0b75e3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:12:44.395760 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2cb6eeca-07af-4ae5-80a9-8aa19f0b75e3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:12:44.396198 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2cb6eeca-07af-4ae5-80a9-8aa19f0b75e3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:12:44.615292 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2cb6eeca-07af-4ae5-80a9-8aa19f0b75e3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.233153 Oct 15 04:12:44.615837 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1085/2274] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Oct 15 04:12:44 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/os-volume_attachments => generated 194 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:12:52.072692 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-56c5c52d-149d-4024-92d0-6d19fe23849a tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:12:52.079777 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-56c5c52d-149d-4024-92d0-6d19fe23849a tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:12:52.080230 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-56c5c52d-149d-4024-92d0-6d19fe23849a tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:12:52.143133 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-56c5c52d-149d-4024-92d0-6d19fe23849a tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Going to try to stop instance {{(pid=120897) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 15 04:12:52.184210 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-56c5c52d-149d-4024-92d0-6d19fe23849a tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 202 len: 0 microversion: 2.1 time: 0.115604 Oct 15 04:12:52.184792 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1190/2275] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:12:52 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 04:12:52.194029 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-918e310e-d88d-4deb-814c-e46f350ab130 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:12:52.194857 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-918e310e-d88d-4deb-814c-e46f350ab130 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:12:52.201199 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-918e310e-d88d-4deb-814c-e46f350ab130 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:12:52.202016 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-918e310e-d88d-4deb-814c-e46f350ab130 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:12:52.203066 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-918e310e-d88d-4deb-814c-e46f350ab130 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:12:52.203763 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-918e310e-d88d-4deb-814c-e46f350ab130 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:12:52.372079 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-918e310e-d88d-4deb-814c-e46f350ab130 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:12:52.380301 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-918e310e-d88d-4deb-814c-e46f350ab130 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1725 microversion: 2.1 time: 0.191172 Oct 15 04:12:52.380863 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1086/2276] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:12:52 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:12:53.398372 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-07635f93-a447-4813-a91f-ad794c061c57 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:12:53.399077 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-07635f93-a447-4813-a91f-ad794c061c57 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:12:53.405081 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-07635f93-a447-4813-a91f-ad794c061c57 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:12:53.405532 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-07635f93-a447-4813-a91f-ad794c061c57 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:12:53.406294 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-07635f93-a447-4813-a91f-ad794c061c57 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:12:53.406725 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-07635f93-a447-4813-a91f-ad794c061c57 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:12:53.522831 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-07635f93-a447-4813-a91f-ad794c061c57 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:12:53.530446 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-07635f93-a447-4813-a91f-ad794c061c57 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1725 microversion: 2.1 time: 0.136676 Oct 15 04:12:53.531003 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1191/2277] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:12:53 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1725 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:12:54.547973 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ce76a802-9ab4-4958-a5ec-d956aa398f20 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:12:54.548567 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ce76a802-9ab4-4958-a5ec-d956aa398f20 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:12:54.555001 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce76a802-9ab4-4958-a5ec-d956aa398f20 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:12:54.555478 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce76a802-9ab4-4958-a5ec-d956aa398f20 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:12:54.556265 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce76a802-9ab4-4958-a5ec-d956aa398f20 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:12:54.556696 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ce76a802-9ab4-4958-a5ec-d956aa398f20 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:12:54.674959 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ce76a802-9ab4-4958-a5ec-d956aa398f20 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:12:54.682520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ce76a802-9ab4-4958-a5ec-d956aa398f20 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1725 microversion: 2.1 time: 0.138274 Oct 15 04:12:54.683074 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1087/2278] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:12:54 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1725 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:12:55.699730 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a2bbe4b9-1caf-49c1-b1fc-f2fc14366375 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:12:55.700350 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a2bbe4b9-1caf-49c1-b1fc-f2fc14366375 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:12:55.706542 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a2bbe4b9-1caf-49c1-b1fc-f2fc14366375 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:12:55.706989 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a2bbe4b9-1caf-49c1-b1fc-f2fc14366375 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:12:55.707773 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a2bbe4b9-1caf-49c1-b1fc-f2fc14366375 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:12:55.708212 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a2bbe4b9-1caf-49c1-b1fc-f2fc14366375 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:12:55.825102 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a2bbe4b9-1caf-49c1-b1fc-f2fc14366375 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:12:55.833235 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a2bbe4b9-1caf-49c1-b1fc-f2fc14366375 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1725 microversion: 2.1 time: 0.137211 Oct 15 04:12:55.833793 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1192/2279] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:12:55 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1725 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:12:56.849917 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-102dc401-b65b-4f9d-8f99-98ea16c9d96d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:12:56.850525 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-102dc401-b65b-4f9d-8f99-98ea16c9d96d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:12:56.856451 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-102dc401-b65b-4f9d-8f99-98ea16c9d96d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:12:56.856899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-102dc401-b65b-4f9d-8f99-98ea16c9d96d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:12:56.857951 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-102dc401-b65b-4f9d-8f99-98ea16c9d96d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:12:56.858758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-102dc401-b65b-4f9d-8f99-98ea16c9d96d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:12:56.975987 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-102dc401-b65b-4f9d-8f99-98ea16c9d96d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:12:56.983633 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-102dc401-b65b-4f9d-8f99-98ea16c9d96d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1725 microversion: 2.1 time: 0.137404 Oct 15 04:12:56.984218 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1088/2280] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:12:56 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1725 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:12:58.001355 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-79572c7a-f6db-47c6-8d96-4519ae9c4853 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:12:58.001952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-79572c7a-f6db-47c6-8d96-4519ae9c4853 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:12:58.007645 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-79572c7a-f6db-47c6-8d96-4519ae9c4853 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:12:58.008116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-79572c7a-f6db-47c6-8d96-4519ae9c4853 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:12:58.008866 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-79572c7a-f6db-47c6-8d96-4519ae9c4853 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:12:58.009297 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-79572c7a-f6db-47c6-8d96-4519ae9c4853 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:12:58.127089 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-79572c7a-f6db-47c6-8d96-4519ae9c4853 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:12:58.134588 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-79572c7a-f6db-47c6-8d96-4519ae9c4853 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1725 microversion: 2.1 time: 0.137372 Oct 15 04:12:58.135136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1193/2281] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:12:57 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1725 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:12:59.152021 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-82a5dfe3-2e71-4009-801e-a94cafb478fb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:12:59.152626 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-82a5dfe3-2e71-4009-801e-a94cafb478fb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:12:59.158786 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-82a5dfe3-2e71-4009-801e-a94cafb478fb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:12:59.159228 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-82a5dfe3-2e71-4009-801e-a94cafb478fb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:12:59.160008 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-82a5dfe3-2e71-4009-801e-a94cafb478fb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:12:59.160434 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-82a5dfe3-2e71-4009-801e-a94cafb478fb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:12:59.279015 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-82a5dfe3-2e71-4009-801e-a94cafb478fb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:12:59.286756 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-82a5dfe3-2e71-4009-801e-a94cafb478fb tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1725 microversion: 2.1 time: 0.138353 Oct 15 04:12:59.287333 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1089/2282] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:12:59 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1725 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:00.304397 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-795a4c52-9dd7-46ee-8669-3a3b6de92cad tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:00.305002 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-795a4c52-9dd7-46ee-8669-3a3b6de92cad tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:00.311199 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-795a4c52-9dd7-46ee-8669-3a3b6de92cad tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:00.311652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-795a4c52-9dd7-46ee-8669-3a3b6de92cad tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:00.312439 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-795a4c52-9dd7-46ee-8669-3a3b6de92cad tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:00.312876 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-795a4c52-9dd7-46ee-8669-3a3b6de92cad tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:00.430328 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-795a4c52-9dd7-46ee-8669-3a3b6de92cad tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:00.438043 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-795a4c52-9dd7-46ee-8669-3a3b6de92cad tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1725 microversion: 2.1 time: 0.137210 Oct 15 04:13:00.438609 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1194/2283] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:00 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1725 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:01.455396 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-15d7de9c-bdd5-49e1-ba9a-66a62a8068c6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:01.455949 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-15d7de9c-bdd5-49e1-ba9a-66a62a8068c6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:01.461697 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-15d7de9c-bdd5-49e1-ba9a-66a62a8068c6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:01.462140 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-15d7de9c-bdd5-49e1-ba9a-66a62a8068c6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:01.463043 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-15d7de9c-bdd5-49e1-ba9a-66a62a8068c6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:01.463312 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-15d7de9c-bdd5-49e1-ba9a-66a62a8068c6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:01.584608 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-15d7de9c-bdd5-49e1-ba9a-66a62a8068c6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:01.592199 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-15d7de9c-bdd5-49e1-ba9a-66a62a8068c6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1725 microversion: 2.1 time: 0.141035 Oct 15 04:13:01.592759 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1090/2284] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:01 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1725 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:02.609331 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0eee6e50-5e1f-482c-8dc5-21644cd24630 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:02.610563 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0eee6e50-5e1f-482c-8dc5-21644cd24630 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:02.616301 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0eee6e50-5e1f-482c-8dc5-21644cd24630 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:02.616749 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0eee6e50-5e1f-482c-8dc5-21644cd24630 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:02.617531 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0eee6e50-5e1f-482c-8dc5-21644cd24630 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:02.617967 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0eee6e50-5e1f-482c-8dc5-21644cd24630 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:02.735858 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0eee6e50-5e1f-482c-8dc5-21644cd24630 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:02.743391 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0eee6e50-5e1f-482c-8dc5-21644cd24630 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1702 microversion: 2.1 time: 0.137681 Oct 15 04:13:02.743987 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1195/2285] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:02 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1702 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:02.759815 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5d485d1c-d8d4-4ceb-937d-4cc19a766757 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:13:02.765403 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5d485d1c-d8d4-4ceb-937d-4cc19a766757 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:02.765846 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5d485d1c-d8d4-4ceb-937d-4cc19a766757 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:02.827764 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5d485d1c-d8d4-4ceb-937d-4cc19a766757 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Going to try to start instance {{(pid=120899) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 15 04:13:02.866456 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5d485d1c-d8d4-4ceb-937d-4cc19a766757 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 202 len: 0 microversion: 2.1 time: 0.110208 Oct 15 04:13:02.867281 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1091/2286] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:13:02 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 04:13:02.875210 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-63917660-6958-476b-9b47-482c9eae3864 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:02.876686 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-63917660-6958-476b-9b47-482c9eae3864 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:02.882531 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-63917660-6958-476b-9b47-482c9eae3864 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:02.883018 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-63917660-6958-476b-9b47-482c9eae3864 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:02.883837 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-63917660-6958-476b-9b47-482c9eae3864 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:02.884266 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-63917660-6958-476b-9b47-482c9eae3864 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:03.032450 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-63917660-6958-476b-9b47-482c9eae3864 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:03.041341 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-63917660-6958-476b-9b47-482c9eae3864 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1711 microversion: 2.1 time: 0.169748 Oct 15 04:13:03.041898 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1196/2287] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:02 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1711 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:04.059726 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6b47c1a2-c701-434d-b3dd-fb14e37d9e27 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:04.060423 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6b47c1a2-c701-434d-b3dd-fb14e37d9e27 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:04.067285 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b47c1a2-c701-434d-b3dd-fb14e37d9e27 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:04.067892 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b47c1a2-c701-434d-b3dd-fb14e37d9e27 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:04.068707 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b47c1a2-c701-434d-b3dd-fb14e37d9e27 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:04.069216 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6b47c1a2-c701-434d-b3dd-fb14e37d9e27 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:04.208972 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6b47c1a2-c701-434d-b3dd-fb14e37d9e27 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:04.216563 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6b47c1a2-c701-434d-b3dd-fb14e37d9e27 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1711 microversion: 2.1 time: 0.161018 Oct 15 04:13:04.217119 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1092/2288] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:04 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1711 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:05.232374 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e39b68e3-eecc-452a-831d-9fc74921d244 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:05.233061 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e39b68e3-eecc-452a-831d-9fc74921d244 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:05.238912 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e39b68e3-eecc-452a-831d-9fc74921d244 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:05.239363 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e39b68e3-eecc-452a-831d-9fc74921d244 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:05.240155 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e39b68e3-eecc-452a-831d-9fc74921d244 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:05.240587 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e39b68e3-eecc-452a-831d-9fc74921d244 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:05.362354 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e39b68e3-eecc-452a-831d-9fc74921d244 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:05.370201 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e39b68e3-eecc-452a-831d-9fc74921d244 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1715 microversion: 2.1 time: 0.141467 Oct 15 04:13:05.370807 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1197/2289] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:05 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1715 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:18.217149 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:13:18.218725 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 04:13:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:13:19.128255 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:13:19.128698 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 04:13:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:13:30.639938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-59d9aa24-8826-4863-8877-626db1c4ea03 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Action: 'create', calling method: .version_select at 0x7f4ac18d81f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2140268227"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:13:30.657789 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-59d9aa24-8826-4863-8877-626db1c4ea03 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Getting quotas for project adf86994ea4b42f08d65aefa85065d65. Resources: {'key_pairs'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 04:13:30.661439 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-59d9aa24-8826-4863-8877-626db1c4ea03 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Getting quotas for user 5ec3ec37e88a492ca616718e83e15816 and project adf86994ea4b42f08d65aefa85065d65. Resources: {'key_pairs'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 04:13:30.920842 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-59d9aa24-8826-4863-8877-626db1c4ea03 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Getting quotas for project adf86994ea4b42f08d65aefa85065d65. Resources: {'key_pairs'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 04:13:30.924389 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-59d9aa24-8826-4863-8877-626db1c4ea03 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Getting quotas for user 5ec3ec37e88a492ca616718e83e15816 and project adf86994ea4b42f08d65aefa85065d65. Resources: {'key_pairs'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 04:13:30.936491 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-59d9aa24-8826-4863-8877-626db1c4ea03 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.300184 Oct 15 04:13:30.937077 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1093/2290] 10.222.0.30 () {60 vars in 1157 bytes} [Fri Oct 15 04:13:30 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:30.988065 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-053c7da4-7e9d-4e58-8d83-b97f8f671c2e tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1025881770", "imageRef": "f664925f-7f22-47da-bafb-f7d0d4401954", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2140268227", "networks": [{"uuid": "2917b26e-8bfc-434a-a653-0e4085be2d55"}]}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:13:31.036725 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.network.neutron [None req-053c7da4-7e9d-4e58-8d83-b97f8f671c2e tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] validate_networks() for [('2917b26e-8bfc-434a-a653-0e4085be2d55', None, None, None, None, None)] {{(pid=120897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 15 04:13:31.491645 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-053c7da4-7e9d-4e58-8d83-b97f8f671c2e tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Flavor limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 04:13:31.492099 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-053c7da4-7e9d-4e58-8d83-b97f8f671c2e tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Image limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 04:13:31.492570 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-053c7da4-7e9d-4e58-8d83-b97f8f671c2e tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Flavor pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 04:13:31.492978 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-053c7da4-7e9d-4e58-8d83-b97f8f671c2e tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Image pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 04:13:31.493421 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-053c7da4-7e9d-4e58-8d83-b97f8f671c2e tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 04:13:31.502572 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-053c7da4-7e9d-4e58-8d83-b97f8f671c2e tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:31.503015 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-053c7da4-7e9d-4e58-8d83-b97f8f671c2e tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:31.503835 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-053c7da4-7e9d-4e58-8d83-b97f8f671c2e tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:31.504270 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-053c7da4-7e9d-4e58-8d83-b97f8f671c2e tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:31.520326 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-053c7da4-7e9d-4e58-8d83-b97f8f671c2e tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Getting quotas for project adf86994ea4b42f08d65aefa85065d65. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 04:13:31.524146 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-053c7da4-7e9d-4e58-8d83-b97f8f671c2e tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Getting quotas for user 5ec3ec37e88a492ca616718e83e15816 and project adf86994ea4b42f08d65aefa85065d65. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 04:13:31.535061 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-053c7da4-7e9d-4e58-8d83-b97f8f671c2e tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Going to run 1 instances... {{(pid=120897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 15 04:13:31.537313 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-053c7da4-7e9d-4e58-8d83-b97f8f671c2e tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f664925f-7f22-47da-bafb-f7d0d4401954',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 15 04:13:31.581249 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-053c7da4-7e9d-4e58-8d83-b97f8f671c2e tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597347 Oct 15 04:13:31.581874 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1198/2291] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Oct 15 04:13:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 04:13:31.591380 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e1fdbc3a-c22a-42dd-9416-7b0100ed9027 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:31.592020 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e1fdbc3a-c22a-42dd-9416-7b0100ed9027 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:31.642844 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e1fdbc3a-c22a-42dd-9416-7b0100ed9027 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:31.650845 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e1fdbc3a-c22a-42dd-9416-7b0100ed9027 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1259 microversion: 2.1 time: 0.063150 Oct 15 04:13:31.651486 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1094/2292] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:31 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1259 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:32.668614 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-71a4e8fe-35c3-4f03-80c9-d2065c2abb18 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:32.669310 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-71a4e8fe-35c3-4f03-80c9-d2065c2abb18 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:32.676658 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-71a4e8fe-35c3-4f03-80c9-d2065c2abb18 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:32.677109 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-71a4e8fe-35c3-4f03-80c9-d2065c2abb18 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:32.677879 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-71a4e8fe-35c3-4f03-80c9-d2065c2abb18 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:32.678312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-71a4e8fe-35c3-4f03-80c9-d2065c2abb18 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:32.762952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-71a4e8fe-35c3-4f03-80c9-d2065c2abb18 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:32.771058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-71a4e8fe-35c3-4f03-80c9-d2065c2abb18 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1317 microversion: 2.1 time: 0.106366 Oct 15 04:13:32.771836 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1199/2293] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:32 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1317 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:33.788731 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b4e76a2a-9362-438e-b660-48e40a858cd8 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:33.789498 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b4e76a2a-9362-438e-b660-48e40a858cd8 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:33.795544 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b4e76a2a-9362-438e-b660-48e40a858cd8 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:33.796099 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b4e76a2a-9362-438e-b660-48e40a858cd8 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:33.796879 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b4e76a2a-9362-438e-b660-48e40a858cd8 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:33.797311 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b4e76a2a-9362-438e-b660-48e40a858cd8 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:33.924857 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b4e76a2a-9362-438e-b660-48e40a858cd8 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:33.935375 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b4e76a2a-9362-438e-b660-48e40a858cd8 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1359 microversion: 2.1 time: 0.150841 Oct 15 04:13:33.935985 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1095/2294] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:33 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:34.953741 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f6a43cb4-2e9c-40b2-a85d-b7dddff4836a tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:34.956955 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f6a43cb4-2e9c-40b2-a85d-b7dddff4836a tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:34.963762 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6a43cb4-2e9c-40b2-a85d-b7dddff4836a tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:34.964453 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6a43cb4-2e9c-40b2-a85d-b7dddff4836a tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:34.965524 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6a43cb4-2e9c-40b2-a85d-b7dddff4836a tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:34.966203 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f6a43cb4-2e9c-40b2-a85d-b7dddff4836a tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:35.103998 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f6a43cb4-2e9c-40b2-a85d-b7dddff4836a tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:35.111826 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f6a43cb4-2e9c-40b2-a85d-b7dddff4836a tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1359 microversion: 2.1 time: 0.162660 Oct 15 04:13:35.112409 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1200/2295] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:34 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:36.128857 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e7750596-e2aa-48d0-bced-4d1dec8a8e93 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:36.129384 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e7750596-e2aa-48d0-bced-4d1dec8a8e93 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:36.135162 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7750596-e2aa-48d0-bced-4d1dec8a8e93 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:36.135611 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7750596-e2aa-48d0-bced-4d1dec8a8e93 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:36.136397 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7750596-e2aa-48d0-bced-4d1dec8a8e93 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:36.136831 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e7750596-e2aa-48d0-bced-4d1dec8a8e93 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:36.260153 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e7750596-e2aa-48d0-bced-4d1dec8a8e93 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:36.267209 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e7750596-e2aa-48d0-bced-4d1dec8a8e93 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1359 microversion: 2.1 time: 0.142815 Oct 15 04:13:36.267795 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1096/2296] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:36 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1359 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:37.283543 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d3d0c971-c328-419e-8a17-4555cc5bc0bc tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:37.284181 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d3d0c971-c328-419e-8a17-4555cc5bc0bc tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:37.289962 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d3d0c971-c328-419e-8a17-4555cc5bc0bc tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:37.290409 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d3d0c971-c328-419e-8a17-4555cc5bc0bc tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:37.291166 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d3d0c971-c328-419e-8a17-4555cc5bc0bc tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:37.291599 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d3d0c971-c328-419e-8a17-4555cc5bc0bc tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:37.546936 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d3d0c971-c328-419e-8a17-4555cc5bc0bc tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:37.554161 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d3d0c971-c328-419e-8a17-4555cc5bc0bc tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1359 microversion: 2.1 time: 0.274314 Oct 15 04:13:37.554715 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1201/2297] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:37 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1359 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:38.571647 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-baa01d90-c01a-46f4-98ba-1701332536bd tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:38.572570 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-baa01d90-c01a-46f4-98ba-1701332536bd tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:38.579263 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baa01d90-c01a-46f4-98ba-1701332536bd tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:38.579743 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baa01d90-c01a-46f4-98ba-1701332536bd tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:38.580524 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baa01d90-c01a-46f4-98ba-1701332536bd tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:38.580962 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baa01d90-c01a-46f4-98ba-1701332536bd tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:38.663244 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-55f1b0a4-df40-4e59-be1a-6eccc84a0b56 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:38.663804 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-55f1b0a4-df40-4e59-be1a-6eccc84a0b56 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:38.669509 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-55f1b0a4-df40-4e59-be1a-6eccc84a0b56 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:38.669964 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-55f1b0a4-df40-4e59-be1a-6eccc84a0b56 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:38.670727 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-55f1b0a4-df40-4e59-be1a-6eccc84a0b56 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:38.671167 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-55f1b0a4-df40-4e59-be1a-6eccc84a0b56 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:38.714812 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-baa01d90-c01a-46f4-98ba-1701332536bd tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:38.723143 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-baa01d90-c01a-46f4-98ba-1701332536bd tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1359 microversion: 2.1 time: 0.155291 Oct 15 04:13:38.723961 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1097/2298] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:38 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:38.775820 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.objects.instance [None req-55f1b0a4-df40-4e59-be1a-6eccc84a0b56 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lazy-loading 'services' on Instance uuid ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e {{(pid=120897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 04:13:38.857057 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-55f1b0a4-df40-4e59-be1a-6eccc84a0b56 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/os-volume_attachments/ff00d256-970d-49ed-8cec-9d97ea4ad3af" status: 202 len: 0 microversion: 2.1 time: 0.197262 Oct 15 04:13:38.857650 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1202/2299] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Oct 15 04:13:38 2021] DELETE /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/os-volume_attachments/ff00d256-970d-49ed-8cec-9d97ea4ad3af => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 15 04:13:39.740032 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-612a0924-f0b4-492e-a5e3-fc270aef45dd tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:39.740647 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-612a0924-f0b4-492e-a5e3-fc270aef45dd tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:39.746534 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-612a0924-f0b4-492e-a5e3-fc270aef45dd tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:39.746981 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-612a0924-f0b4-492e-a5e3-fc270aef45dd tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:39.747759 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-612a0924-f0b4-492e-a5e3-fc270aef45dd tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:39.748196 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-612a0924-f0b4-492e-a5e3-fc270aef45dd tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:39.868406 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-612a0924-f0b4-492e-a5e3-fc270aef45dd tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:39.875515 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-612a0924-f0b4-492e-a5e3-fc270aef45dd tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1359 microversion: 2.1 time: 0.139202 Oct 15 04:13:39.876114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1098/2300] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:39 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1359 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:40.892926 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-294060b2-551a-4e15-a77a-913f58a2f61d tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:40.893501 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-294060b2-551a-4e15-a77a-913f58a2f61d tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:40.900271 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-294060b2-551a-4e15-a77a-913f58a2f61d tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:40.900720 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-294060b2-551a-4e15-a77a-913f58a2f61d tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:40.901493 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-294060b2-551a-4e15-a77a-913f58a2f61d tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:40.901925 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-294060b2-551a-4e15-a77a-913f58a2f61d tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:41.050345 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-294060b2-551a-4e15-a77a-913f58a2f61d tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:41.057715 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-294060b2-551a-4e15-a77a-913f58a2f61d tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1359 microversion: 2.1 time: 0.169600 Oct 15 04:13:41.058281 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1203/2301] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:40 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 04:13:42.074167 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a80251cc-e718-4e00-a201-3172117bfd92 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:42.075548 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a80251cc-e718-4e00-a201-3172117bfd92 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:42.084224 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a80251cc-e718-4e00-a201-3172117bfd92 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:42.084988 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a80251cc-e718-4e00-a201-3172117bfd92 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:42.086415 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a80251cc-e718-4e00-a201-3172117bfd92 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:42.087221 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a80251cc-e718-4e00-a201-3172117bfd92 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:42.218347 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-a80251cc-e718-4e00-a201-3172117bfd92 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:42.225520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a80251cc-e718-4e00-a201-3172117bfd92 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1359 microversion: 2.1 time: 0.155020 Oct 15 04:13:42.226080 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1099/2302] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:42 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:43.243030 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ba461e68-45dd-458c-92c6-fcb2c20e9ec9 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:43.243673 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ba461e68-45dd-458c-92c6-fcb2c20e9ec9 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:43.249961 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ba461e68-45dd-458c-92c6-fcb2c20e9ec9 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:43.250409 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ba461e68-45dd-458c-92c6-fcb2c20e9ec9 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:43.251165 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ba461e68-45dd-458c-92c6-fcb2c20e9ec9 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:43.251598 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ba461e68-45dd-458c-92c6-fcb2c20e9ec9 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:43.371833 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ba461e68-45dd-458c-92c6-fcb2c20e9ec9 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:43.378942 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ba461e68-45dd-458c-92c6-fcb2c20e9ec9 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1359 microversion: 2.1 time: 0.140596 Oct 15 04:13:43.379488 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1204/2303] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:43 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1359 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:44.380560 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-7b67f0ea-0450-4c11-ac4f-7afe4302ac1b req-86ed542d-6866-4210-a2d4-582a3f9ecf10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd14ae5-f09a-4319-b2b9-09dd098e1920", "tag": "1d58d15a-222e-45c7-b26b-bbe742a5dcbd"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:13:44.382146 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:13:44.382146 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 04:13:44.394382 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-7b67f0ea-0450-4c11-ac4f-7afe4302ac1b req-86ed542d-6866-4210-a2d4-582a3f9ecf10 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:44.394843 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-7b67f0ea-0450-4c11-ac4f-7afe4302ac1b req-86ed542d-6866-4210-a2d4-582a3f9ecf10 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:44.397691 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-edae5a08-a36d-4bc4-b430-6b7a93976762 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:44.398882 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-edae5a08-a36d-4bc4-b430-6b7a93976762 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:44.405270 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edae5a08-a36d-4bc4-b430-6b7a93976762 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:44.406287 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edae5a08-a36d-4bc4-b430-6b7a93976762 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:44.407645 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-7b67f0ea-0450-4c11-ac4f-7afe4302ac1b req-86ed542d-6866-4210-a2d4-582a3f9ecf10 service nova] Creating event network-changed:1d58d15a-222e-45c7-b26b-bbe742a5dcbd for instance 5bd14ae5-f09a-4319-b2b9-09dd098e1920 on hv-cinder-81410 Oct 15 04:13:44.407866 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edae5a08-a36d-4bc4-b430-6b7a93976762 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:44.408622 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-edae5a08-a36d-4bc4-b430-6b7a93976762 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:44.413027 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-7b67f0ea-0450-4c11-ac4f-7afe4302ac1b req-86ed542d-6866-4210-a2d4-582a3f9ecf10 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036109 Oct 15 04:13:44.413780 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1100/2304] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:13:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:13:44.641700 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-edae5a08-a36d-4bc4-b430-6b7a93976762 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:44.649036 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-edae5a08-a36d-4bc4-b430-6b7a93976762 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1359 microversion: 2.1 time: 0.257367 Oct 15 04:13:44.649594 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1205/2305] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:44 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:45.287116 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-497a01f1-70ca-4a56-a6cb-5b00dffc77c8 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:13:45.292945 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-497a01f1-70ca-4a56-a6cb-5b00dffc77c8 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:45.293391 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-497a01f1-70ca-4a56-a6cb-5b00dffc77c8 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:45.315089 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-497a01f1-70ca-4a56-a6cb-5b00dffc77c8 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Going to try to stop instance {{(pid=120899) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 15 04:13:45.356812 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-497a01f1-70ca-4a56-a6cb-5b00dffc77c8 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 202 len: 0 microversion: 2.1 time: 0.073457 Oct 15 04:13:45.357404 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1101/2306] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:13:45 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 04:13:45.366518 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c3a6ce76-0959-4e04-b7d1-992523da04b4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:45.367126 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c3a6ce76-0959-4e04-b7d1-992523da04b4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:45.373286 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c3a6ce76-0959-4e04-b7d1-992523da04b4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:45.373809 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c3a6ce76-0959-4e04-b7d1-992523da04b4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:45.374819 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c3a6ce76-0959-4e04-b7d1-992523da04b4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:45.375376 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c3a6ce76-0959-4e04-b7d1-992523da04b4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:45.499503 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c3a6ce76-0959-4e04-b7d1-992523da04b4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:45.506645 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c3a6ce76-0959-4e04-b7d1-992523da04b4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1679 microversion: 2.1 time: 0.144587 Oct 15 04:13:45.507218 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1206/2307] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:45 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1679 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:45.666463 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2485601d-06b5-4f71-ab55-056fdc607f60 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:45.667166 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2485601d-06b5-4f71-ab55-056fdc607f60 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:45.673160 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2485601d-06b5-4f71-ab55-056fdc607f60 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:45.673612 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2485601d-06b5-4f71-ab55-056fdc607f60 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:45.674372 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2485601d-06b5-4f71-ab55-056fdc607f60 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:45.674810 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2485601d-06b5-4f71-ab55-056fdc607f60 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:45.791404 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2485601d-06b5-4f71-ab55-056fdc607f60 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:45.798443 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2485601d-06b5-4f71-ab55-056fdc607f60 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1359 microversion: 2.1 time: 0.135934 Oct 15 04:13:45.799001 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1102/2308] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:45 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1359 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:46.524248 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b84cc330-633d-450b-b6bb-ae94f59a5602 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:46.524849 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b84cc330-633d-450b-b6bb-ae94f59a5602 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:46.530615 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b84cc330-633d-450b-b6bb-ae94f59a5602 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:46.531075 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b84cc330-633d-450b-b6bb-ae94f59a5602 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:46.531829 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b84cc330-633d-450b-b6bb-ae94f59a5602 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:46.532257 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b84cc330-633d-450b-b6bb-ae94f59a5602 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:46.649098 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b84cc330-633d-450b-b6bb-ae94f59a5602 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:46.656896 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b84cc330-633d-450b-b6bb-ae94f59a5602 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1679 microversion: 2.1 time: 0.136260 Oct 15 04:13:46.657447 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1207/2309] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:46 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1679 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:46.814034 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3882c8d8-a708-40c8-b981-88dbc05a335f tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:46.814568 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3882c8d8-a708-40c8-b981-88dbc05a335f tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:46.820836 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3882c8d8-a708-40c8-b981-88dbc05a335f tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:46.821283 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3882c8d8-a708-40c8-b981-88dbc05a335f tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:46.822032 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3882c8d8-a708-40c8-b981-88dbc05a335f tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:46.822456 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3882c8d8-a708-40c8-b981-88dbc05a335f tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:46.942213 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-3882c8d8-a708-40c8-b981-88dbc05a335f tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:46.949234 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3882c8d8-a708-40c8-b981-88dbc05a335f tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1359 microversion: 2.1 time: 0.138917 Oct 15 04:13:46.949789 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1103/2310] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:46 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1359 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:47.674954 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-80a01d34-ec9f-4158-b991-10b78a5009f9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:47.675482 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-80a01d34-ec9f-4158-b991-10b78a5009f9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:47.681344 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-80a01d34-ec9f-4158-b991-10b78a5009f9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:47.681784 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-80a01d34-ec9f-4158-b991-10b78a5009f9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:47.682522 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-80a01d34-ec9f-4158-b991-10b78a5009f9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:47.682947 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-80a01d34-ec9f-4158-b991-10b78a5009f9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:47.800122 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-80a01d34-ec9f-4158-b991-10b78a5009f9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:47.807121 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-80a01d34-ec9f-4158-b991-10b78a5009f9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1679 microversion: 2.1 time: 0.137067 Oct 15 04:13:47.807695 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1208/2311] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:47 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1679 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:47.966167 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-76f1577f-0133-4bba-a132-03e42239bc6c tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:47.966918 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-76f1577f-0133-4bba-a132-03e42239bc6c tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:47.972730 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-76f1577f-0133-4bba-a132-03e42239bc6c tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:47.973183 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-76f1577f-0133-4bba-a132-03e42239bc6c tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:47.973947 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-76f1577f-0133-4bba-a132-03e42239bc6c tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:47.974387 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-76f1577f-0133-4bba-a132-03e42239bc6c tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:48.092668 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-76f1577f-0133-4bba-a132-03e42239bc6c tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:48.099853 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-76f1577f-0133-4bba-a132-03e42239bc6c tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1359 microversion: 2.1 time: 0.137230 Oct 15 04:13:48.100415 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1104/2312] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:47 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1359 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:48.824157 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e8b11e9a-7552-4eda-a74a-518fdf679308 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:48.824765 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e8b11e9a-7552-4eda-a74a-518fdf679308 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:48.831085 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e8b11e9a-7552-4eda-a74a-518fdf679308 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:48.831555 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e8b11e9a-7552-4eda-a74a-518fdf679308 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:48.832323 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e8b11e9a-7552-4eda-a74a-518fdf679308 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:48.832750 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e8b11e9a-7552-4eda-a74a-518fdf679308 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:48.951951 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-e8b11e9a-7552-4eda-a74a-518fdf679308 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:48.960074 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e8b11e9a-7552-4eda-a74a-518fdf679308 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1679 microversion: 2.1 time: 0.139518 Oct 15 04:13:48.960646 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1209/2313] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:48 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1679 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:49.116666 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-838d8297-e5dd-4b3c-a39f-3f0c1bf4e89b tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:49.117198 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-838d8297-e5dd-4b3c-a39f-3f0c1bf4e89b tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:49.122973 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-838d8297-e5dd-4b3c-a39f-3f0c1bf4e89b tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:49.123421 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-838d8297-e5dd-4b3c-a39f-3f0c1bf4e89b tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:49.124713 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-838d8297-e5dd-4b3c-a39f-3f0c1bf4e89b tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:49.125149 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-838d8297-e5dd-4b3c-a39f-3f0c1bf4e89b tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:49.240467 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-838d8297-e5dd-4b3c-a39f-3f0c1bf4e89b tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:49.247890 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-838d8297-e5dd-4b3c-a39f-3f0c1bf4e89b tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1359 microversion: 2.1 time: 0.134884 Oct 15 04:13:49.248457 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1105/2314] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:49 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1359 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:49.976751 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a75fe4d2-5efb-4f42-a194-5cea648bac8c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:49.977360 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a75fe4d2-5efb-4f42-a194-5cea648bac8c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:49.983009 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a75fe4d2-5efb-4f42-a194-5cea648bac8c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:49.983471 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a75fe4d2-5efb-4f42-a194-5cea648bac8c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:49.984268 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a75fe4d2-5efb-4f42-a194-5cea648bac8c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:49.984701 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a75fe4d2-5efb-4f42-a194-5cea648bac8c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:50.008925 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-9504c8be-4c59-4a29-b452-6891fed2873d req-af40cda0-31d3-4fd0-8ef7-b51b3537f46e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd14ae5-f09a-4319-b2b9-09dd098e1920", "name": "network-vif-plugged", "status": "completed", "tag": "1d58d15a-222e-45c7-b26b-bbe742a5dcbd"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:13:50.010498 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:13:50.010498 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 04:13:50.018491 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-9504c8be-4c59-4a29-b452-6891fed2873d req-af40cda0-31d3-4fd0-8ef7-b51b3537f46e service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:50.018981 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-9504c8be-4c59-4a29-b452-6891fed2873d req-af40cda0-31d3-4fd0-8ef7-b51b3537f46e service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:50.031918 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-9504c8be-4c59-4a29-b452-6891fed2873d req-af40cda0-31d3-4fd0-8ef7-b51b3537f46e service nova] Creating event network-vif-plugged:1d58d15a-222e-45c7-b26b-bbe742a5dcbd for instance 5bd14ae5-f09a-4319-b2b9-09dd098e1920 on hv-cinder-81410 Oct 15 04:13:50.037380 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-9504c8be-4c59-4a29-b452-6891fed2873d req-af40cda0-31d3-4fd0-8ef7-b51b3537f46e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032942 Oct 15 04:13:50.038433 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1106/2315] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:13:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:13:50.121565 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a75fe4d2-5efb-4f42-a194-5cea648bac8c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:50.130444 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a75fe4d2-5efb-4f42-a194-5cea648bac8c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1679 microversion: 2.1 time: 0.157319 Oct 15 04:13:50.131293 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1210/2316] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:49 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:50.265230 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-74796933-6965-41a6-a426-aedcb8a803fc tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:50.265928 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-74796933-6965-41a6-a426-aedcb8a803fc tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:50.271967 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-74796933-6965-41a6-a426-aedcb8a803fc tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:50.272419 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-74796933-6965-41a6-a426-aedcb8a803fc tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:50.273173 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-74796933-6965-41a6-a426-aedcb8a803fc tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:50.273606 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-74796933-6965-41a6-a426-aedcb8a803fc tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:50.390407 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-74796933-6965-41a6-a426-aedcb8a803fc tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:50.397457 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-74796933-6965-41a6-a426-aedcb8a803fc tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1359 microversion: 2.1 time: 0.136422 Oct 15 04:13:50.398018 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1107/2317] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:50 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1359 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 04:13:51.147666 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-dc92fb87-e925-4e21-b5d4-900e612e8d03 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:51.148322 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-dc92fb87-e925-4e21-b5d4-900e612e8d03 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:51.154180 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dc92fb87-e925-4e21-b5d4-900e612e8d03 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:51.154628 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dc92fb87-e925-4e21-b5d4-900e612e8d03 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:51.155965 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dc92fb87-e925-4e21-b5d4-900e612e8d03 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:51.156416 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dc92fb87-e925-4e21-b5d4-900e612e8d03 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:51.298191 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-dc92fb87-e925-4e21-b5d4-900e612e8d03 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:51.305501 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-dc92fb87-e925-4e21-b5d4-900e612e8d03 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1679 microversion: 2.1 time: 0.161343 Oct 15 04:13:51.307011 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1211/2318] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:51 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:51.414210 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c42d5a71-9a5f-4bd3-843d-ef60d627621a tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:51.414846 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c42d5a71-9a5f-4bd3-843d-ef60d627621a tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:51.420653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c42d5a71-9a5f-4bd3-843d-ef60d627621a tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:51.421161 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c42d5a71-9a5f-4bd3-843d-ef60d627621a tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:51.421931 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c42d5a71-9a5f-4bd3-843d-ef60d627621a tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:51.422358 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c42d5a71-9a5f-4bd3-843d-ef60d627621a tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:51.541291 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-c42d5a71-9a5f-4bd3-843d-ef60d627621a tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:51.549026 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c42d5a71-9a5f-4bd3-843d-ef60d627621a tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1549 microversion: 2.1 time: 0.138409 Oct 15 04:13:51.549520 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1108/2319] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:51 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1549 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:51.565231 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-518122e8-68c5-4044-9e0c-47601b68b625 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:51.565845 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-518122e8-68c5-4044-9e0c-47601b68b625 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:51.571504 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-518122e8-68c5-4044-9e0c-47601b68b625 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:51.572000 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-518122e8-68c5-4044-9e0c-47601b68b625 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:51.572760 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-518122e8-68c5-4044-9e0c-47601b68b625 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:51.573195 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-518122e8-68c5-4044-9e0c-47601b68b625 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:51.688936 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-518122e8-68c5-4044-9e0c-47601b68b625 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:51.696328 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-518122e8-68c5-4044-9e0c-47601b68b625 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1549 microversion: 2.1 time: 0.135604 Oct 15 04:13:51.696881 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1212/2320] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:51 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1549 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:51.712009 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8a49ff31-b07b-4aee-85ac-fe30cd9e5885 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:51.715326 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:13:51.715326 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 04:13:51.716340 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8a49ff31-b07b-4aee-85ac-fe30cd9e5885 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:51.717085 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8a49ff31-b07b-4aee-85ac-fe30cd9e5885 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Searching by: {'deleted': False, 'project_id': 'adf86994ea4b42f08d65aefa85065d65'} {{(pid=120899) get_all /opt/stack/nova/nova/compute/api.py:2905}} Oct 15 04:13:51.724121 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8a49ff31-b07b-4aee-85ac-fe30cd9e5885 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:51.724574 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8a49ff31-b07b-4aee-85ac-fe30cd9e5885 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:51.725365 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8a49ff31-b07b-4aee-85ac-fe30cd9e5885 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:51.725798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8a49ff31-b07b-4aee-85ac-fe30cd9e5885 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:51.814252 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.multi_cell_list [None req-8a49ff31-b07b-4aee-85ac-fe30cd9e5885 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120899) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Oct 15 04:13:51.904876 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8a49ff31-b07b-4aee-85ac-fe30cd9e5885 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.196374 Oct 15 04:13:51.905991 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1109/2321] 10.222.0.30 () {58 vars in 1124 bytes} [Fri Oct 15 04:13:51 2021] GET /compute/v2.1/servers => generated 343 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:13:51.915947 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-56f3427a-2100-48aa-8151-fe0e95228825 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:51.916557 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-56f3427a-2100-48aa-8151-fe0e95228825 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:51.922850 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-56f3427a-2100-48aa-8151-fe0e95228825 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:51.923296 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-56f3427a-2100-48aa-8151-fe0e95228825 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:51.924082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-56f3427a-2100-48aa-8151-fe0e95228825 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:51.924518 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-56f3427a-2100-48aa-8151-fe0e95228825 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:52.039015 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-56f3427a-2100-48aa-8151-fe0e95228825 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:52.046838 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-56f3427a-2100-48aa-8151-fe0e95228825 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1549 microversion: 2.1 time: 0.133927 Oct 15 04:13:52.047394 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1213/2322] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:51 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1549 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:52.323472 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e48e315e-9313-45a0-be5c-04014b1c3ff2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:52.324203 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e48e315e-9313-45a0-be5c-04014b1c3ff2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:52.329881 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e48e315e-9313-45a0-be5c-04014b1c3ff2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:52.330334 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e48e315e-9313-45a0-be5c-04014b1c3ff2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:52.331098 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e48e315e-9313-45a0-be5c-04014b1c3ff2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:52.331532 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e48e315e-9313-45a0-be5c-04014b1c3ff2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:52.453449 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-e48e315e-9313-45a0-be5c-04014b1c3ff2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:52.460591 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e48e315e-9313-45a0-be5c-04014b1c3ff2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1679 microversion: 2.1 time: 0.140752 Oct 15 04:13:52.461158 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1110/2323] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:52 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1679 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:53.477111 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-97df59a6-3d63-4622-b921-173f7fdf10b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:53.477713 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-97df59a6-3d63-4622-b921-173f7fdf10b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:53.483673 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-97df59a6-3d63-4622-b921-173f7fdf10b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:53.484151 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-97df59a6-3d63-4622-b921-173f7fdf10b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:53.484903 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-97df59a6-3d63-4622-b921-173f7fdf10b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:53.485329 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-97df59a6-3d63-4622-b921-173f7fdf10b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:53.526472 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-77a8c641-9cad-48d9-bfcf-9b89a37c5d44 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41a59ca9-ca31-4a11-a365-18e224da71c7"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:13:53.527521 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-77a8c641-9cad-48d9-bfcf-9b89a37c5d44 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:53.533178 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-77a8c641-9cad-48d9-bfcf-9b89a37c5d44 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:53.533625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-77a8c641-9cad-48d9-bfcf-9b89a37c5d44 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:53.534378 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-77a8c641-9cad-48d9-bfcf-9b89a37c5d44 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:53.534808 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-77a8c641-9cad-48d9-bfcf-9b89a37c5d44 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:53.606327 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-97df59a6-3d63-4622-b921-173f7fdf10b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:53.614429 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-97df59a6-3d63-4622-b921-173f7fdf10b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1679 microversion: 2.1 time: 0.140873 Oct 15 04:13:53.614990 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1214/2324] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:53 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1679 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:53.758760 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-77a8c641-9cad-48d9-bfcf-9b89a37c5d44 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "POST /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.235780 Oct 15 04:13:53.759364 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1111/2325] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Oct 15 04:13:53 2021] POST /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920/os-volume_attachments => generated 194 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 04:13:54.630908 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ffaa4906-7efb-4220-b07e-2aabe72134a5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:54.631517 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ffaa4906-7efb-4220-b07e-2aabe72134a5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:54.637276 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ffaa4906-7efb-4220-b07e-2aabe72134a5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:54.637723 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ffaa4906-7efb-4220-b07e-2aabe72134a5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:54.638472 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ffaa4906-7efb-4220-b07e-2aabe72134a5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:54.638902 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ffaa4906-7efb-4220-b07e-2aabe72134a5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:54.755518 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ffaa4906-7efb-4220-b07e-2aabe72134a5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:54.762763 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ffaa4906-7efb-4220-b07e-2aabe72134a5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1679 microversion: 2.1 time: 0.135479 Oct 15 04:13:54.763316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1215/2326] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:54 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1679 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:55.779896 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-08a4a895-2f65-4056-b905-2ba9cf915a9e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:55.780597 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-08a4a895-2f65-4056-b905-2ba9cf915a9e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:55.787355 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08a4a895-2f65-4056-b905-2ba9cf915a9e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:55.787836 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08a4a895-2f65-4056-b905-2ba9cf915a9e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:55.788594 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08a4a895-2f65-4056-b905-2ba9cf915a9e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:55.789029 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-08a4a895-2f65-4056-b905-2ba9cf915a9e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:55.909125 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-08a4a895-2f65-4056-b905-2ba9cf915a9e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:55.916462 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-08a4a895-2f65-4056-b905-2ba9cf915a9e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1656 microversion: 2.1 time: 0.141073 Oct 15 04:13:55.917016 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1112/2327] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:55 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1656 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:55.933532 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-78da242a-8c3c-4e3e-9095-565ffe11e0f4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:13:55.939392 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-78da242a-8c3c-4e3e-9095-565ffe11e0f4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:55.940132 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-78da242a-8c3c-4e3e-9095-565ffe11e0f4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:55.961558 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-78da242a-8c3c-4e3e-9095-565ffe11e0f4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Going to try to start instance {{(pid=120897) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 15 04:13:56.000312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-78da242a-8c3c-4e3e-9095-565ffe11e0f4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action" status: 202 len: 0 microversion: 2.1 time: 0.070186 Oct 15 04:13:56.000879 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1216/2328] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:13:55 2021] POST /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/action => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 04:13:56.008975 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-63fcfee5-3b24-4203-9d7c-097c57a75636 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:56.009799 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-63fcfee5-3b24-4203-9d7c-097c57a75636 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:56.016594 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-63fcfee5-3b24-4203-9d7c-097c57a75636 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:56.017129 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-63fcfee5-3b24-4203-9d7c-097c57a75636 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:56.018468 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-63fcfee5-3b24-4203-9d7c-097c57a75636 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:56.019095 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-63fcfee5-3b24-4203-9d7c-097c57a75636 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:56.161560 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-63fcfee5-3b24-4203-9d7c-097c57a75636 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:56.168826 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-63fcfee5-3b24-4203-9d7c-097c57a75636 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1665 microversion: 2.1 time: 0.163495 Oct 15 04:13:56.169395 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1113/2329] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:56 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1665 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:13:57.187137 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-a808988a-806d-4f7e-b526-10956b857aaf tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:13:57.187781 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-a808988a-806d-4f7e-b526-10956b857aaf tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:13:57.193963 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a808988a-806d-4f7e-b526-10956b857aaf tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:57.194412 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a808988a-806d-4f7e-b526-10956b857aaf tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:57.195166 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a808988a-806d-4f7e-b526-10956b857aaf tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:13:57.195598 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-a808988a-806d-4f7e-b526-10956b857aaf tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:13:57.311313 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-a808988a-806d-4f7e-b526-10956b857aaf tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:13:57.319391 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-a808988a-806d-4f7e-b526-10956b857aaf tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1669 microversion: 2.1 time: 0.136970 Oct 15 04:13:57.319975 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1217/2330] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:13:57 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1669 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:00.204573 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6d2f6f5d-8d29-4cf5-ae5c-fee3af9f9d8b tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:00.205183 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6d2f6f5d-8d29-4cf5-ae5c-fee3af9f9d8b tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:00.211247 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6d2f6f5d-8d29-4cf5-ae5c-fee3af9f9d8b tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:00.211708 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6d2f6f5d-8d29-4cf5-ae5c-fee3af9f9d8b tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:00.212479 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6d2f6f5d-8d29-4cf5-ae5c-fee3af9f9d8b tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:00.212908 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6d2f6f5d-8d29-4cf5-ae5c-fee3af9f9d8b tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:00.332363 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6d2f6f5d-8d29-4cf5-ae5c-fee3af9f9d8b tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:00.339962 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6d2f6f5d-8d29-4cf5-ae5c-fee3af9f9d8b tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1595 microversion: 2.1 time: 0.139507 Oct 15 04:14:00.340526 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1114/2331] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:00 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1595 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:02.203506 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-77a11b05-b702-49c5-b84f-0ff265538341 req-1df41550-aa9b-4e0a-b6c4-acddadaae97e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd14ae5-f09a-4319-b2b9-09dd098e1920", "tag": "1d58d15a-222e-45c7-b26b-bbe742a5dcbd"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:14:02.204826 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:14:02.204826 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 04:14:02.211471 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-77a11b05-b702-49c5-b84f-0ff265538341 req-1df41550-aa9b-4e0a-b6c4-acddadaae97e service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:02.211942 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-77a11b05-b702-49c5-b84f-0ff265538341 req-1df41550-aa9b-4e0a-b6c4-acddadaae97e service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:02.223566 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-77a11b05-b702-49c5-b84f-0ff265538341 req-1df41550-aa9b-4e0a-b6c4-acddadaae97e service nova] Creating event network-changed:1d58d15a-222e-45c7-b26b-bbe742a5dcbd for instance 5bd14ae5-f09a-4319-b2b9-09dd098e1920 on hv-cinder-81410 Oct 15 04:14:02.229417 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-77a11b05-b702-49c5-b84f-0ff265538341 req-1df41550-aa9b-4e0a-b6c4-acddadaae97e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029963 Oct 15 04:14:02.230460 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1218/2332] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:14:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:14:03.150873 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a7ed87e0-5389-4249-acea-75cbd96e8b5d tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-279767775"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:14:03.151410 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a7ed87e0-5389-4249-acea-75cbd96e8b5d tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:03.158041 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a7ed87e0-5389-4249-acea-75cbd96e8b5d tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:03.158492 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a7ed87e0-5389-4249-acea-75cbd96e8b5d tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:03.159279 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a7ed87e0-5389-4249-acea-75cbd96e8b5d tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:03.159731 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a7ed87e0-5389-4249-acea-75cbd96e8b5d tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:03.282283 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.network.security_group_api [None req-a7ed87e0-5389-4249-acea-75cbd96e8b5d tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Adding security group 76fd7d02-2f0d-4dcd-9628-82e48394adc4 to port 1d58d15a-222e-45c7-b26b-bbe742a5dcbd Oct 15 04:14:03.618858 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a7ed87e0-5389-4249-acea-75cbd96e8b5d tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "POST /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920/action" status: 202 len: 0 microversion: 2.1 time: 0.471637 Oct 15 04:14:03.619722 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1115/2333] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:14:03 2021] POST /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 04:14:03.628260 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4794ed9b-061b-42da-95c9-1bae8df7fb25 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:03.628967 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4794ed9b-061b-42da-95c9-1bae8df7fb25 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:03.635046 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4794ed9b-061b-42da-95c9-1bae8df7fb25 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:03.635501 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4794ed9b-061b-42da-95c9-1bae8df7fb25 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:03.636306 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4794ed9b-061b-42da-95c9-1bae8df7fb25 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:03.640285 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4794ed9b-061b-42da-95c9-1bae8df7fb25 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:03.792090 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-4794ed9b-061b-42da-95c9-1bae8df7fb25 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:03.801408 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4794ed9b-061b-42da-95c9-1bae8df7fb25 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1760 microversion: 2.1 time: 0.177107 Oct 15 04:14:03.812144 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1219/2334] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:03 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1760 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 04:14:04.245255 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-307ccf5b-73d0-4579-aac9-e2ba9e83706c req-d151543e-c56d-49b1-b112-c34a1021be06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd14ae5-f09a-4319-b2b9-09dd098e1920", "tag": "1d58d15a-222e-45c7-b26b-bbe742a5dcbd"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:14:04.246807 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:14:04.246807 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 04:14:04.253610 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-307ccf5b-73d0-4579-aac9-e2ba9e83706c req-d151543e-c56d-49b1-b112-c34a1021be06 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:04.254067 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-307ccf5b-73d0-4579-aac9-e2ba9e83706c req-d151543e-c56d-49b1-b112-c34a1021be06 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:04.266145 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-307ccf5b-73d0-4579-aac9-e2ba9e83706c req-d151543e-c56d-49b1-b112-c34a1021be06 service nova] Creating event network-changed:1d58d15a-222e-45c7-b26b-bbe742a5dcbd for instance 5bd14ae5-f09a-4319-b2b9-09dd098e1920 on hv-cinder-81410 Oct 15 04:14:04.271698 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-307ccf5b-73d0-4579-aac9-e2ba9e83706c req-d151543e-c56d-49b1-b112-c34a1021be06 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030463 Oct 15 04:14:04.272280 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1116/2335] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:14:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:14:27.253579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bb95cd8f-927f-4ca5-b7dc-8eab9bfe0eb5 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:14:27.254518 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bb95cd8f-927f-4ca5-b7dc-8eab9bfe0eb5 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:27.260437 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bb95cd8f-927f-4ca5-b7dc-8eab9bfe0eb5 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:27.260884 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bb95cd8f-927f-4ca5-b7dc-8eab9bfe0eb5 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:27.261638 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bb95cd8f-927f-4ca5-b7dc-8eab9bfe0eb5 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:27.262077 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bb95cd8f-927f-4ca5-b7dc-8eab9bfe0eb5 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:27.329385 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bb95cd8f-927f-4ca5-b7dc-8eab9bfe0eb5 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "POST /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920/action" status: 202 len: 0 microversion: 2.1 time: 0.079282 Oct 15 04:14:27.330022 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1220/2336] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:14:27 2021] POST /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 04:14:27.338255 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-10d7e56e-72ce-4461-851a-512ef4d4cab0 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:27.339028 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-10d7e56e-72ce-4461-851a-512ef4d4cab0 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:27.345705 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10d7e56e-72ce-4461-851a-512ef4d4cab0 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:27.346161 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10d7e56e-72ce-4461-851a-512ef4d4cab0 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:27.347029 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10d7e56e-72ce-4461-851a-512ef4d4cab0 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:27.347466 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-10d7e56e-72ce-4461-851a-512ef4d4cab0 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:27.522710 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-10d7e56e-72ce-4461-851a-512ef4d4cab0 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:27.530851 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-10d7e56e-72ce-4461-851a-512ef4d4cab0 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1752 microversion: 2.1 time: 0.196574 Oct 15 04:14:27.531405 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1117/2337] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:27 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1752 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:28.548700 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0cf84fdc-47c2-4f4f-a65e-31c0d497df29 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:28.549312 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-0cf84fdc-47c2-4f4f-a65e-31c0d497df29 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:28.555215 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0cf84fdc-47c2-4f4f-a65e-31c0d497df29 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:28.555655 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0cf84fdc-47c2-4f4f-a65e-31c0d497df29 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:28.556455 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0cf84fdc-47c2-4f4f-a65e-31c0d497df29 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:28.556880 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-0cf84fdc-47c2-4f4f-a65e-31c0d497df29 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:28.675225 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-0cf84fdc-47c2-4f4f-a65e-31c0d497df29 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:28.682807 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0cf84fdc-47c2-4f4f-a65e-31c0d497df29 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1757 microversion: 2.1 time: 0.138674 Oct 15 04:14:28.683376 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1221/2338] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:28 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1757 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:29.700099 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-16a52215-ec0d-4119-8445-dfbca5104fdf tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:29.700617 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-16a52215-ec0d-4119-8445-dfbca5104fdf tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:29.706666 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-16a52215-ec0d-4119-8445-dfbca5104fdf tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:29.707108 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-16a52215-ec0d-4119-8445-dfbca5104fdf tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:29.707916 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-16a52215-ec0d-4119-8445-dfbca5104fdf tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:29.708323 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-16a52215-ec0d-4119-8445-dfbca5104fdf tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:29.836696 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-16a52215-ec0d-4119-8445-dfbca5104fdf tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:29.844871 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-16a52215-ec0d-4119-8445-dfbca5104fdf tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1757 microversion: 2.1 time: 0.148439 Oct 15 04:14:29.845432 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1118/2339] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:29 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1757 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:30.861205 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-31bf7fc8-cb3b-4dcd-bd59-1fd8a68a12ae tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:30.861822 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-31bf7fc8-cb3b-4dcd-bd59-1fd8a68a12ae tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:30.867474 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-31bf7fc8-cb3b-4dcd-bd59-1fd8a68a12ae tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:30.867953 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-31bf7fc8-cb3b-4dcd-bd59-1fd8a68a12ae tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:30.868707 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-31bf7fc8-cb3b-4dcd-bd59-1fd8a68a12ae tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:30.869140 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-31bf7fc8-cb3b-4dcd-bd59-1fd8a68a12ae tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:30.987121 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-31bf7fc8-cb3b-4dcd-bd59-1fd8a68a12ae tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:30.994697 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-31bf7fc8-cb3b-4dcd-bd59-1fd8a68a12ae tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1757 microversion: 2.1 time: 0.137077 Oct 15 04:14:30.995243 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1222/2340] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:30 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1757 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:32.011049 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9f59ad48-029b-42dd-8253-963c61f3ebb7 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:32.011658 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9f59ad48-029b-42dd-8253-963c61f3ebb7 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:32.018092 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9f59ad48-029b-42dd-8253-963c61f3ebb7 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:32.018542 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9f59ad48-029b-42dd-8253-963c61f3ebb7 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:32.019307 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9f59ad48-029b-42dd-8253-963c61f3ebb7 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:32.019776 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9f59ad48-029b-42dd-8253-963c61f3ebb7 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:32.141611 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-9f59ad48-029b-42dd-8253-963c61f3ebb7 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:32.149699 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9f59ad48-029b-42dd-8253-963c61f3ebb7 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1757 microversion: 2.1 time: 0.142324 Oct 15 04:14:32.150266 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1119/2341] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:32 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1757 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:32.171873 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-e85717fe-d7db-430d-9e10-30048cc7f786 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:32.172793 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-e85717fe-d7db-430d-9e10-30048cc7f786 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:32.178413 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e85717fe-d7db-430d-9e10-30048cc7f786 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:32.178863 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e85717fe-d7db-430d-9e10-30048cc7f786 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:32.179613 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e85717fe-d7db-430d-9e10-30048cc7f786 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:32.180069 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-e85717fe-d7db-430d-9e10-30048cc7f786 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:32.208241 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-e85717fe-d7db-430d-9e10-30048cc7f786 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040563 Oct 15 04:14:32.208775 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1223/2342] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 04:14:32 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:14:32.262358 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8d9c1e5d-5001-4f17-80f9-fc1d2d518a75 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:32.262856 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8d9c1e5d-5001-4f17-80f9-fc1d2d518a75 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:32.268606 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8d9c1e5d-5001-4f17-80f9-fc1d2d518a75 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:32.269060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8d9c1e5d-5001-4f17-80f9-fc1d2d518a75 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:32.269822 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8d9c1e5d-5001-4f17-80f9-fc1d2d518a75 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:32.270260 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8d9c1e5d-5001-4f17-80f9-fc1d2d518a75 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:32.293412 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8d9c1e5d-5001-4f17-80f9-fc1d2d518a75 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Going to try to terminate instance {{(pid=120899) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 15 04:14:32.365310 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8d9c1e5d-5001-4f17-80f9-fc1d2d518a75 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 204 len: 0 microversion: 2.1 time: 0.106241 Oct 15 04:14:32.365820 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1120/2343] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 04:14:32 2021] DELETE /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 04:14:32.374657 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-01a45950-a02f-484d-8024-8dbd8de68ca3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:32.375274 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-01a45950-a02f-484d-8024-8dbd8de68ca3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:32.381088 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-01a45950-a02f-484d-8024-8dbd8de68ca3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:32.381544 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-01a45950-a02f-484d-8024-8dbd8de68ca3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:32.382311 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-01a45950-a02f-484d-8024-8dbd8de68ca3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:32.382750 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-01a45950-a02f-484d-8024-8dbd8de68ca3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:32.502825 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-01a45950-a02f-484d-8024-8dbd8de68ca3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:32.510000 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-01a45950-a02f-484d-8024-8dbd8de68ca3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1675 microversion: 2.1 time: 0.139625 Oct 15 04:14:32.510560 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1224/2344] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:32 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1675 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 04:14:33.165895 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d70e75ec-ba56-43dd-9ada-64e9c7eba224 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:33.166513 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d70e75ec-ba56-43dd-9ada-64e9c7eba224 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:33.172792 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d70e75ec-ba56-43dd-9ada-64e9c7eba224 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:33.173233 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d70e75ec-ba56-43dd-9ada-64e9c7eba224 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:33.173984 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d70e75ec-ba56-43dd-9ada-64e9c7eba224 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:33.174409 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d70e75ec-ba56-43dd-9ada-64e9c7eba224 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:33.293341 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-d70e75ec-ba56-43dd-9ada-64e9c7eba224 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:33.300835 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d70e75ec-ba56-43dd-9ada-64e9c7eba224 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1757 microversion: 2.1 time: 0.139003 Oct 15 04:14:33.301391 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1121/2345] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:33 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1757 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:33.526790 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-84722005-07b1-4c0a-8171-e9b4cef0d435 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:33.527401 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-84722005-07b1-4c0a-8171-e9b4cef0d435 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:33.533203 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84722005-07b1-4c0a-8171-e9b4cef0d435 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:33.533652 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84722005-07b1-4c0a-8171-e9b4cef0d435 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:33.534408 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84722005-07b1-4c0a-8171-e9b4cef0d435 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:33.534843 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-84722005-07b1-4c0a-8171-e9b4cef0d435 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:33.649820 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-84722005-07b1-4c0a-8171-e9b4cef0d435 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:33.657081 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-84722005-07b1-4c0a-8171-e9b4cef0d435 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1675 microversion: 2.1 time: 0.133823 Oct 15 04:14:33.657633 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1225/2346] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:33 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1675 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:34.317767 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-95fbb5c1-ba1a-4378-8fd7-de62f3d63444 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:34.318373 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-95fbb5c1-ba1a-4378-8fd7-de62f3d63444 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:34.324192 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-95fbb5c1-ba1a-4378-8fd7-de62f3d63444 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:34.324638 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-95fbb5c1-ba1a-4378-8fd7-de62f3d63444 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:34.325396 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-95fbb5c1-ba1a-4378-8fd7-de62f3d63444 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:34.325828 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-95fbb5c1-ba1a-4378-8fd7-de62f3d63444 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:34.519809 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-95fbb5c1-ba1a-4378-8fd7-de62f3d63444 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:34.527765 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-95fbb5c1-ba1a-4378-8fd7-de62f3d63444 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1757 microversion: 2.1 time: 0.213875 Oct 15 04:14:34.528338 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1122/2347] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:34 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1757 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:34.673625 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-736be825-d38b-49ad-8137-0a45447b75d2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:34.674232 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-736be825-d38b-49ad-8137-0a45447b75d2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:34.680253 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-736be825-d38b-49ad-8137-0a45447b75d2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:34.680704 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-736be825-d38b-49ad-8137-0a45447b75d2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:34.681469 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-736be825-d38b-49ad-8137-0a45447b75d2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:34.681904 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-736be825-d38b-49ad-8137-0a45447b75d2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:34.879963 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-736be825-d38b-49ad-8137-0a45447b75d2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:34.887362 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-736be825-d38b-49ad-8137-0a45447b75d2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1675 microversion: 2.1 time: 0.217954 Oct 15 04:14:34.888172 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1226/2348] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:34 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1675 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:35.515734 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-fadf5322-0860-44d7-80ec-02f7608bc8df req-3a4cbdbb-1c50-451e-8c71-154b8cb686ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e", "name": "network-vif-deleted", "tag": "1a982e98-69d2-46fe-948f-0bb47e46c5c4"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:14:35.517316 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:14:35.517316 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 04:14:35.524257 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-fadf5322-0860-44d7-80ec-02f7608bc8df req-3a4cbdbb-1c50-451e-8c71-154b8cb686ab service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:35.524698 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-fadf5322-0860-44d7-80ec-02f7608bc8df req-3a4cbdbb-1c50-451e-8c71-154b8cb686ab service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:35.537453 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-fadf5322-0860-44d7-80ec-02f7608bc8df req-3a4cbdbb-1c50-451e-8c71-154b8cb686ab service nova] Creating event network-vif-deleted:1a982e98-69d2-46fe-948f-0bb47e46c5c4 for instance ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e on hv-cinder-81410 Oct 15 04:14:35.543297 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-fadf5322-0860-44d7-80ec-02f7608bc8df req-3a4cbdbb-1c50-451e-8c71-154b8cb686ab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031820 Oct 15 04:14:35.544083 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1123/2349] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:14:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:14:35.544782 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-dbcedebe-3693-4f8f-83f1-375c8c9b227c tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:35.546365 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-dbcedebe-3693-4f8f-83f1-375c8c9b227c tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:35.552569 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dbcedebe-3693-4f8f-83f1-375c8c9b227c tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:35.553021 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dbcedebe-3693-4f8f-83f1-375c8c9b227c tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:35.553852 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dbcedebe-3693-4f8f-83f1-375c8c9b227c tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:35.554217 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-dbcedebe-3693-4f8f-83f1-375c8c9b227c tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:35.683293 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-dbcedebe-3693-4f8f-83f1-375c8c9b227c tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:35.691912 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-dbcedebe-3693-4f8f-83f1-375c8c9b227c tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1757 microversion: 2.1 time: 0.150727 Oct 15 04:14:35.692734 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1227/2350] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:35 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1757 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 04:14:35.905488 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b88390c9-90b6-4ced-8013-c04518ce9da2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:35.906212 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b88390c9-90b6-4ced-8013-c04518ce9da2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:35.913680 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b88390c9-90b6-4ced-8013-c04518ce9da2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:35.914211 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b88390c9-90b6-4ced-8013-c04518ce9da2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:35.915100 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b88390c9-90b6-4ced-8013-c04518ce9da2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:35.915720 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b88390c9-90b6-4ced-8013-c04518ce9da2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:35.950098 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b88390c9-90b6-4ced-8013-c04518ce9da2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:35.950663 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b88390c9-90b6-4ced-8013-c04518ce9da2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:35.951953 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.objects.instance [None req-b88390c9-90b6-4ced-8013-c04518ce9da2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lazy-loading 'fault' on Instance uuid ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e {{(pid=120899) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 04:14:35.998533 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-b88390c9-90b6-4ced-8013-c04518ce9da2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:36.005173 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b88390c9-90b6-4ced-8013-c04518ce9da2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 200 len: 1328 microversion: 2.1 time: 0.104108 Oct 15 04:14:36.005734 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1124/2351] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:35 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 1328 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:36.709599 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ac1014c5-f2ab-4ede-9e4c-498c3f0492d3 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:36.710208 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ac1014c5-f2ab-4ede-9e4c-498c3f0492d3 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:36.715970 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ac1014c5-f2ab-4ede-9e4c-498c3f0492d3 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:36.716402 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ac1014c5-f2ab-4ede-9e4c-498c3f0492d3 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:36.717154 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ac1014c5-f2ab-4ede-9e4c-498c3f0492d3 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:36.717581 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ac1014c5-f2ab-4ede-9e4c-498c3f0492d3 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:36.840081 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ac1014c5-f2ab-4ede-9e4c-498c3f0492d3 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:36.848222 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ac1014c5-f2ab-4ede-9e4c-498c3f0492d3 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1757 microversion: 2.1 time: 0.142652 Oct 15 04:14:36.848785 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1228/2352] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:36 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1757 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:37.023044 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9053ef22-55c6-4a43-85cb-59bb742ccd4c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:37.023709 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9053ef22-55c6-4a43-85cb-59bb742ccd4c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:37.029504 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9053ef22-55c6-4a43-85cb-59bb742ccd4c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:37.029952 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9053ef22-55c6-4a43-85cb-59bb742ccd4c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:37.030709 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9053ef22-55c6-4a43-85cb-59bb742ccd4c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:37.031143 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9053ef22-55c6-4a43-85cb-59bb742ccd4c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:37.043775 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-9053ef22-55c6-4a43-85cb-59bb742ccd4c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] HTTP exception thrown: Instance ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e could not be found. Oct 15 04:14:37.044283 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9053ef22-55c6-4a43-85cb-59bb742ccd4c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Returning 404 to user: Instance ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 04:14:37.045114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9053ef22-55c6-4a43-85cb-59bb742ccd4c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 404 len: 111 microversion: 2.1 time: 0.025677 Oct 15 04:14:37.045620 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1125/2353] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:37 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 04:14:37.053413 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c31e602a-3923-486d-b470-463043aa6a8f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '.version_select at 0x7f4abcc67820>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:37.056567 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c31e602a-3923-486d-b470-463043aa6a8f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [63ac3031-30ce-4001-9f80-bf1ea5d43fc0] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 15 04:14:37.865000 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7eca7ca3-a750-4ced-bc57-a397da88cd58 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:37.865633 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7eca7ca3-a750-4ced-bc57-a397da88cd58 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:37.871402 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7eca7ca3-a750-4ced-bc57-a397da88cd58 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:37.871907 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7eca7ca3-a750-4ced-bc57-a397da88cd58 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:37.873212 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7eca7ca3-a750-4ced-bc57-a397da88cd58 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:37.873661 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7eca7ca3-a750-4ced-bc57-a397da88cd58 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:37.991935 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-7eca7ca3-a750-4ced-bc57-a397da88cd58 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:38.000234 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7eca7ca3-a750-4ced-bc57-a397da88cd58 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1757 microversion: 2.1 time: 0.138923 Oct 15 04:14:38.000797 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1126/2354] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:37 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1757 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:38.074797 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [None req-c31e602a-3923-486d-b470-463043aa6a8f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [63ac3031-30ce-4001-9f80-bf1ea5d43fc0] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 44344. Oct 15 04:14:38.092369 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c31e602a-3923-486d-b470-463043aa6a8f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419519068" status: 202 len: 0 microversion: 2.1 time: 1.042453 Oct 15 04:14:38.092938 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1229/2355] 10.222.0.30 () {58 vars in 1220 bytes} [Fri Oct 15 04:14:37 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419519068 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 04:14:38.721438 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ff5b3b01-5d15-4c87-868b-950f6623d4be tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'create', calling method: .version_select at 0x7f4abd386700>, body: {"keypair": {"name": "tempest-keypair-466423041"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:14:38.740299 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-ff5b3b01-5d15-4c87-868b-950f6623d4be tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Getting quotas for project 8a2f64c8564f447d84849db55e0b0573. Resources: {'key_pairs'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 04:14:38.744005 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-ff5b3b01-5d15-4c87-868b-950f6623d4be tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Getting quotas for user 987993288a1a42dfa808e39eab41c82c and project 8a2f64c8564f447d84849db55e0b0573. Resources: {'key_pairs'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 04:14:38.833120 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-ff5b3b01-5d15-4c87-868b-950f6623d4be tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Getting quotas for project 8a2f64c8564f447d84849db55e0b0573. Resources: {'key_pairs'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 04:14:38.836615 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-ff5b3b01-5d15-4c87-868b-950f6623d4be tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Getting quotas for user 987993288a1a42dfa808e39eab41c82c and project 8a2f64c8564f447d84849db55e0b0573. Resources: {'key_pairs'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 04:14:38.848786 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ff5b3b01-5d15-4c87-868b-950f6623d4be tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.132861 Oct 15 04:14:38.849373 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1127/2356] 10.222.0.30 () {60 vars in 1157 bytes} [Fri Oct 15 04:14:38 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:39.017280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d537bf4b-d719-4e1e-aa9c-273daf1e0add tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:39.018028 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d537bf4b-d719-4e1e-aa9c-273daf1e0add tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:39.023651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d537bf4b-d719-4e1e-aa9c-273daf1e0add tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:39.024136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d537bf4b-d719-4e1e-aa9c-273daf1e0add tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:39.024900 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d537bf4b-d719-4e1e-aa9c-273daf1e0add tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:39.025338 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d537bf4b-d719-4e1e-aa9c-273daf1e0add tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:39.157500 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d537bf4b-d719-4e1e-aa9c-273daf1e0add tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:39.165261 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d537bf4b-d719-4e1e-aa9c-273daf1e0add tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1760 microversion: 2.1 time: 0.152217 Oct 15 04:14:39.165812 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1230/2357] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:39 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1760 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:40.064463 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c88e25a1-e631-47da-be4e-59f286524ae4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1995173170", "imageRef": "0ec12dbd-23ec-4d58-b215-4e3cd5f17594", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4fa67cb1-3493-4482-a3e1-9660863c9411"}], "security_groups": [{"name": "tempest-securitygroup--1494906656"}], "key_name": "tempest-keypair-466423041", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:14:40.152017 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.network.neutron [None req-c88e25a1-e631-47da-be4e-59f286524ae4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] validate_networks() for [('4fa67cb1-3493-4482-a3e1-9660863c9411', None, None, None, None, None)] {{(pid=120899) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 15 04:14:40.511632 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-c88e25a1-e631-47da-be4e-59f286524ae4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Flavor limits 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 04:14:40.512099 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-c88e25a1-e631-47da-be4e-59f286524ae4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Image limits 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 04:14:40.512575 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-c88e25a1-e631-47da-be4e-59f286524ae4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Flavor pref 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 04:14:40.512985 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-c88e25a1-e631-47da-be4e-59f286524ae4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Image pref 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 04:14:40.513397 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-c88e25a1-e631-47da-be4e-59f286524ae4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 04:14:40.522191 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c88e25a1-e631-47da-be4e-59f286524ae4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:40.522638 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c88e25a1-e631-47da-be4e-59f286524ae4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:40.523431 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c88e25a1-e631-47da-be4e-59f286524ae4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:40.523899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c88e25a1-e631-47da-be4e-59f286524ae4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:40.539641 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-c88e25a1-e631-47da-be4e-59f286524ae4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Getting quotas for project 8a2f64c8564f447d84849db55e0b0573. Resources: {'cores', 'instances', 'ram'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 04:14:40.543461 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-c88e25a1-e631-47da-be4e-59f286524ae4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Getting quotas for user 987993288a1a42dfa808e39eab41c82c and project 8a2f64c8564f447d84849db55e0b0573. Resources: {'cores', 'instances', 'ram'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 04:14:40.554325 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c88e25a1-e631-47da-be4e-59f286524ae4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Going to run 1 instances... {{(pid=120899) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 15 04:14:40.556658 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c88e25a1-e631-47da-be4e-59f286524ae4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ec12dbd-23ec-4d58-b215-4e3cd5f17594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120899) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 15 04:14:40.603274 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c88e25a1-e631-47da-be4e-59f286524ae4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.543631 Oct 15 04:14:40.603938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1128/2358] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Oct 15 04:14:40 2021] POST /compute/v2.1/servers => generated 402 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 04:14:40.614106 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bc5d4625-15f6-4bf3-8230-d479bb673f9d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:40.614720 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bc5d4625-15f6-4bf3-8230-d479bb673f9d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:40.666138 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bc5d4625-15f6-4bf3-8230-d479bb673f9d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:40.673180 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bc5d4625-15f6-4bf3-8230-d479bb673f9d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e" status: 200 len: 1237 microversion: 2.1 time: 0.062734 Oct 15 04:14:40.673743 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1231/2359] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:40 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e => generated 1237 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:41.690292 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-474779fc-6100-4bf2-bf22-93519e52b813 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:41.690909 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-474779fc-6100-4bf2-bf22-93519e52b813 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:41.697326 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-474779fc-6100-4bf2-bf22-93519e52b813 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:41.697815 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-474779fc-6100-4bf2-bf22-93519e52b813 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:41.698580 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-474779fc-6100-4bf2-bf22-93519e52b813 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:41.699008 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-474779fc-6100-4bf2-bf22-93519e52b813 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:41.779997 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-474779fc-6100-4bf2-bf22-93519e52b813 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:41.787176 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-474779fc-6100-4bf2-bf22-93519e52b813 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e" status: 200 len: 1295 microversion: 2.1 time: 0.101243 Oct 15 04:14:41.787670 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1129/2360] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:41 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e => generated 1295 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:42.731429 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-452bf324-a033-4319-a063-efe159ab46a2 req-83e4a602-a7a7-46e7-ba17-277f5369304e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aac61cb-6478-4440-93fa-bdc4d748b09e", "tag": "c92d7dd8-897b-4c6e-b2a2-767e2bcfa2eb"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:14:42.733938 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:14:42.733938 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 04:14:42.751486 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-452bf324-a033-4319-a063-efe159ab46a2 req-83e4a602-a7a7-46e7-ba17-277f5369304e service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:42.751954 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-452bf324-a033-4319-a063-efe159ab46a2 req-83e4a602-a7a7-46e7-ba17-277f5369304e service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:42.770926 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-452bf324-a033-4319-a063-efe159ab46a2 req-83e4a602-a7a7-46e7-ba17-277f5369304e service nova] Creating event network-changed:c92d7dd8-897b-4c6e-b2a2-767e2bcfa2eb for instance 0aac61cb-6478-4440-93fa-bdc4d748b09e on hv-cinder-81410 Oct 15 04:14:42.775946 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-452bf324-a033-4319-a063-efe159ab46a2 req-83e4a602-a7a7-46e7-ba17-277f5369304e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048579 Oct 15 04:14:42.776549 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1232/2361] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:14:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:14:42.804009 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2f0cbf85-d030-4759-8260-c01981ba21fc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:42.804738 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2f0cbf85-d030-4759-8260-c01981ba21fc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:42.811987 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2f0cbf85-d030-4759-8260-c01981ba21fc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:42.812456 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2f0cbf85-d030-4759-8260-c01981ba21fc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:42.813238 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2f0cbf85-d030-4759-8260-c01981ba21fc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:42.813672 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2f0cbf85-d030-4759-8260-c01981ba21fc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:43.010415 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2f0cbf85-d030-4759-8260-c01981ba21fc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:43.017990 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2f0cbf85-d030-4759-8260-c01981ba21fc tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e" status: 200 len: 1363 microversion: 2.1 time: 0.217797 Oct 15 04:14:43.018552 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1130/2362] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:42 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:44.035703 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ce93cec7-ccb8-4312-9b5f-1d48576d70a4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:44.036449 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ce93cec7-ccb8-4312-9b5f-1d48576d70a4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:44.042435 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ce93cec7-ccb8-4312-9b5f-1d48576d70a4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:44.042885 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ce93cec7-ccb8-4312-9b5f-1d48576d70a4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:44.043643 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ce93cec7-ccb8-4312-9b5f-1d48576d70a4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:44.044097 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ce93cec7-ccb8-4312-9b5f-1d48576d70a4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:44.162923 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ce93cec7-ccb8-4312-9b5f-1d48576d70a4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:44.170427 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ce93cec7-ccb8-4312-9b5f-1d48576d70a4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e" status: 200 len: 1363 microversion: 2.1 time: 0.139325 Oct 15 04:14:44.170985 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1233/2363] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:44 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e => generated 1363 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:45.186506 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-27c46621-44d9-413a-acdc-f4ef8627c29d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:45.187114 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-27c46621-44d9-413a-acdc-f4ef8627c29d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:45.193594 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-27c46621-44d9-413a-acdc-f4ef8627c29d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:45.194050 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-27c46621-44d9-413a-acdc-f4ef8627c29d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:45.194812 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-27c46621-44d9-413a-acdc-f4ef8627c29d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:45.195246 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-27c46621-44d9-413a-acdc-f4ef8627c29d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:45.312222 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-27c46621-44d9-413a-acdc-f4ef8627c29d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:45.319455 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-27c46621-44d9-413a-acdc-f4ef8627c29d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e" status: 200 len: 1363 microversion: 2.1 time: 0.137168 Oct 15 04:14:45.320058 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1131/2364] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:45 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e => generated 1363 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:46.336162 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-94a62f93-d1b8-4cbe-a2fd-0797eed0ab4e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:46.336795 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-94a62f93-d1b8-4cbe-a2fd-0797eed0ab4e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:46.342681 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-94a62f93-d1b8-4cbe-a2fd-0797eed0ab4e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:46.343125 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-94a62f93-d1b8-4cbe-a2fd-0797eed0ab4e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:46.343905 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-94a62f93-d1b8-4cbe-a2fd-0797eed0ab4e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:46.344333 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-94a62f93-d1b8-4cbe-a2fd-0797eed0ab4e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:46.463827 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-94a62f93-d1b8-4cbe-a2fd-0797eed0ab4e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:46.470946 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-94a62f93-d1b8-4cbe-a2fd-0797eed0ab4e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e" status: 200 len: 1363 microversion: 2.1 time: 0.138457 Oct 15 04:14:46.471494 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1234/2365] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:46 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e => generated 1363 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:47.487240 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-51caaf36-2715-41cc-b883-c91bb098ff26 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:47.487881 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-51caaf36-2715-41cc-b883-c91bb098ff26 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:47.493717 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51caaf36-2715-41cc-b883-c91bb098ff26 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:47.494102 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51caaf36-2715-41cc-b883-c91bb098ff26 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:47.494857 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51caaf36-2715-41cc-b883-c91bb098ff26 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:47.495280 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-51caaf36-2715-41cc-b883-c91bb098ff26 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:47.613988 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-51caaf36-2715-41cc-b883-c91bb098ff26 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:47.621082 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-51caaf36-2715-41cc-b883-c91bb098ff26 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e" status: 200 len: 1363 microversion: 2.1 time: 0.137438 Oct 15 04:14:47.621626 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1132/2366] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:47 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e => generated 1363 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:48.350203 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-5a152173-8a83-405a-99e6-a2fcb6fb5aca req-2a7ec597-710b-4dc6-8bdd-d2937256202e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aac61cb-6478-4440-93fa-bdc4d748b09e", "name": "network-vif-plugged", "status": "completed", "tag": "c92d7dd8-897b-4c6e-b2a2-767e2bcfa2eb"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:14:48.351708 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:14:48.351708 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 04:14:48.359279 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-5a152173-8a83-405a-99e6-a2fcb6fb5aca req-2a7ec597-710b-4dc6-8bdd-d2937256202e service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:48.359718 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-5a152173-8a83-405a-99e6-a2fcb6fb5aca req-2a7ec597-710b-4dc6-8bdd-d2937256202e service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:48.370772 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-5a152173-8a83-405a-99e6-a2fcb6fb5aca req-2a7ec597-710b-4dc6-8bdd-d2937256202e service nova] Creating event network-vif-plugged:c92d7dd8-897b-4c6e-b2a2-767e2bcfa2eb for instance 0aac61cb-6478-4440-93fa-bdc4d748b09e on hv-cinder-81410 Oct 15 04:14:48.375669 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-5a152173-8a83-405a-99e6-a2fcb6fb5aca req-2a7ec597-710b-4dc6-8bdd-d2937256202e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028996 Oct 15 04:14:48.376121 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1235/2367] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:14:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:14:48.637471 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-430532ff-b736-4b50-90cd-55ea25b304f5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:48.638658 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-430532ff-b736-4b50-90cd-55ea25b304f5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:48.644297 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-430532ff-b736-4b50-90cd-55ea25b304f5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:48.644769 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-430532ff-b736-4b50-90cd-55ea25b304f5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:48.645523 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-430532ff-b736-4b50-90cd-55ea25b304f5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:48.645949 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-430532ff-b736-4b50-90cd-55ea25b304f5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:48.761683 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-430532ff-b736-4b50-90cd-55ea25b304f5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:48.769384 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-430532ff-b736-4b50-90cd-55ea25b304f5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e" status: 200 len: 1363 microversion: 2.1 time: 0.135450 Oct 15 04:14:48.769947 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1133/2368] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:48 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e => generated 1363 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:49.786304 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1d97bb8a-0d69-4bde-95b5-a19d8ea2fe82 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:49.787115 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1d97bb8a-0d69-4bde-95b5-a19d8ea2fe82 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:49.793197 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1d97bb8a-0d69-4bde-95b5-a19d8ea2fe82 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:49.793654 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1d97bb8a-0d69-4bde-95b5-a19d8ea2fe82 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:49.794455 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1d97bb8a-0d69-4bde-95b5-a19d8ea2fe82 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:49.794890 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1d97bb8a-0d69-4bde-95b5-a19d8ea2fe82 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:49.915574 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-1d97bb8a-0d69-4bde-95b5-a19d8ea2fe82 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:14:49.922677 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1d97bb8a-0d69-4bde-95b5-a19d8ea2fe82 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e" status: 200 len: 1550 microversion: 2.1 time: 0.140351 Oct 15 04:14:49.923229 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1236/2369] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:14:49 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e => generated 1550 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:14:49.938900 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fd53346e-1613-4854-9c94-640847b2a043 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:14:49.939639 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fd53346e-1613-4854-9c94-640847b2a043 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:49.945179 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd53346e-1613-4854-9c94-640847b2a043 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:49.945625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd53346e-1613-4854-9c94-640847b2a043 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:49.946371 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd53346e-1613-4854-9c94-640847b2a043 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:49.946804 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fd53346e-1613-4854-9c94-640847b2a043 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:50.024353 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fd53346e-1613-4854-9c94-640847b2a043 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089514 Oct 15 04:14:50.024959 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1134/2370] 10.222.0.30 () {58 vars in 1274 bytes} [Fri Oct 15 04:14:49 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:14:51.165135 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6d207ccc-e6ed-4751-9bd3-bc35e37d77c8 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:14:51.166132 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6d207ccc-e6ed-4751-9bd3-bc35e37d77c8 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:51.166703 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-5b94f632-1797-4a77-b6dc-78b9d2d75bcb req-ef462976-6eea-48de-8915-efe1b1368916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aac61cb-6478-4440-93fa-bdc4d748b09e", "tag": "c92d7dd8-897b-4c6e-b2a2-767e2bcfa2eb"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:14:51.168755 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:14:51.168755 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 04:14:51.172182 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6d207ccc-e6ed-4751-9bd3-bc35e37d77c8 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:51.172706 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6d207ccc-e6ed-4751-9bd3-bc35e37d77c8 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:51.173564 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6d207ccc-e6ed-4751-9bd3-bc35e37d77c8 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:51.174072 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6d207ccc-e6ed-4751-9bd3-bc35e37d77c8 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:51.176309 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-5b94f632-1797-4a77-b6dc-78b9d2d75bcb req-ef462976-6eea-48de-8915-efe1b1368916 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:51.176745 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-5b94f632-1797-4a77-b6dc-78b9d2d75bcb req-ef462976-6eea-48de-8915-efe1b1368916 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:51.188675 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-5b94f632-1797-4a77-b6dc-78b9d2d75bcb req-ef462976-6eea-48de-8915-efe1b1368916 service nova] Creating event network-changed:c92d7dd8-897b-4c6e-b2a2-767e2bcfa2eb for instance 0aac61cb-6478-4440-93fa-bdc4d748b09e on hv-cinder-81410 Oct 15 04:14:51.194472 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-5b94f632-1797-4a77-b6dc-78b9d2d75bcb req-ef462976-6eea-48de-8915-efe1b1368916 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031333 Oct 15 04:14:51.195235 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1135/2371] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:14:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 04:14:51.241458 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6d207ccc-e6ed-4751-9bd3-bc35e37d77c8 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 14 microversion: 2.1 time: 0.080437 Oct 15 04:14:51.243332 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1237/2372] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:14:51 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:14:52.255019 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c4901fb8-a4e0-4eb2-896b-fd4496432c75 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:14:52.256053 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c4901fb8-a4e0-4eb2-896b-fd4496432c75 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:52.262026 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c4901fb8-a4e0-4eb2-896b-fd4496432c75 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:52.262452 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c4901fb8-a4e0-4eb2-896b-fd4496432c75 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:52.263810 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c4901fb8-a4e0-4eb2-896b-fd4496432c75 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:52.264241 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c4901fb8-a4e0-4eb2-896b-fd4496432c75 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:52.321627 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c4901fb8-a4e0-4eb2-896b-fd4496432c75 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 14 microversion: 2.1 time: 0.071207 Oct 15 04:14:52.322417 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1136/2373] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:14:52 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:14:53.332280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4a0fca53-f401-424d-984a-b1c983b6f850 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:14:53.333275 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4a0fca53-f401-424d-984a-b1c983b6f850 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:53.339638 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4a0fca53-f401-424d-984a-b1c983b6f850 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:53.340122 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4a0fca53-f401-424d-984a-b1c983b6f850 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:53.340878 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4a0fca53-f401-424d-984a-b1c983b6f850 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:53.341357 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4a0fca53-f401-424d-984a-b1c983b6f850 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:53.400441 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4a0fca53-f401-424d-984a-b1c983b6f850 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 14 microversion: 2.1 time: 0.072144 Oct 15 04:14:53.401033 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1238/2374] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:14:53 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:14:54.411566 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-c08da050-0168-4ce1-9c0b-138a63e4ff7c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:14:54.412540 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-c08da050-0168-4ce1-9c0b-138a63e4ff7c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:54.418938 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c08da050-0168-4ce1-9c0b-138a63e4ff7c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:54.419390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c08da050-0168-4ce1-9c0b-138a63e4ff7c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:54.420180 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c08da050-0168-4ce1-9c0b-138a63e4ff7c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:54.420618 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-c08da050-0168-4ce1-9c0b-138a63e4ff7c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:54.477913 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-c08da050-0168-4ce1-9c0b-138a63e4ff7c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 14 microversion: 2.1 time: 0.070306 Oct 15 04:14:54.478695 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1137/2375] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:14:54 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:14:55.489173 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-29c5fb0b-5315-458c-ae39-9be982312e9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:14:55.490183 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-29c5fb0b-5315-458c-ae39-9be982312e9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:55.496765 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-29c5fb0b-5315-458c-ae39-9be982312e9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:55.497160 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-29c5fb0b-5315-458c-ae39-9be982312e9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:55.498517 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-29c5fb0b-5315-458c-ae39-9be982312e9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:55.498949 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-29c5fb0b-5315-458c-ae39-9be982312e9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:55.558835 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-29c5fb0b-5315-458c-ae39-9be982312e9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 14 microversion: 2.1 time: 0.073546 Oct 15 04:14:55.559420 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1239/2376] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:14:55 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:14:56.570638 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-69326394-5a73-437a-8bcb-bf252ea5ad60 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:14:56.571651 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-69326394-5a73-437a-8bcb-bf252ea5ad60 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:56.578298 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-69326394-5a73-437a-8bcb-bf252ea5ad60 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:56.578740 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-69326394-5a73-437a-8bcb-bf252ea5ad60 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:56.579482 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-69326394-5a73-437a-8bcb-bf252ea5ad60 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:56.579953 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-69326394-5a73-437a-8bcb-bf252ea5ad60 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:56.636776 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-69326394-5a73-437a-8bcb-bf252ea5ad60 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 14 microversion: 2.1 time: 0.070038 Oct 15 04:14:56.637351 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1138/2377] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:14:56 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:14:57.648593 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-de274f11-c7ed-49de-8b87-54f4ac6da5b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:14:57.649562 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-de274f11-c7ed-49de-8b87-54f4ac6da5b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:57.656537 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-de274f11-c7ed-49de-8b87-54f4ac6da5b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:57.656983 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-de274f11-c7ed-49de-8b87-54f4ac6da5b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:57.657746 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-de274f11-c7ed-49de-8b87-54f4ac6da5b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:57.658178 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-de274f11-c7ed-49de-8b87-54f4ac6da5b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:57.719797 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-de274f11-c7ed-49de-8b87-54f4ac6da5b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 14 microversion: 2.1 time: 0.075166 Oct 15 04:14:57.720391 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1240/2378] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:14:57 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:14:58.731144 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-3b8c2225-8f45-4774-beb6-550b9b5724fe tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:14:58.732236 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-3b8c2225-8f45-4774-beb6-550b9b5724fe tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:58.738536 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3b8c2225-8f45-4774-beb6-550b9b5724fe tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:58.738981 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3b8c2225-8f45-4774-beb6-550b9b5724fe tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:58.739750 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3b8c2225-8f45-4774-beb6-550b9b5724fe tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:58.740182 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-3b8c2225-8f45-4774-beb6-550b9b5724fe tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:58.794972 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-3b8c2225-8f45-4774-beb6-550b9b5724fe tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 14 microversion: 2.1 time: 0.067838 Oct 15 04:14:58.795550 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1139/2379] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:14:58 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:14:59.806505 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b29cd969-e18a-49e8-a58e-6678f79c1bb2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:14:59.807532 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b29cd969-e18a-49e8-a58e-6678f79c1bb2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:14:59.814769 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b29cd969-e18a-49e8-a58e-6678f79c1bb2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:59.815207 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b29cd969-e18a-49e8-a58e-6678f79c1bb2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:59.815985 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b29cd969-e18a-49e8-a58e-6678f79c1bb2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:14:59.816412 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b29cd969-e18a-49e8-a58e-6678f79c1bb2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:14:59.873882 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b29cd969-e18a-49e8-a58e-6678f79c1bb2 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 14 microversion: 2.1 time: 0.071260 Oct 15 04:14:59.874478 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1241/2380] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:14:59 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:15:00.885275 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f87400f4-0ee0-424f-b46c-f1dc7897a557 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:00.886263 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f87400f4-0ee0-424f-b46c-f1dc7897a557 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:00.893077 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f87400f4-0ee0-424f-b46c-f1dc7897a557 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:00.893516 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f87400f4-0ee0-424f-b46c-f1dc7897a557 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:00.894262 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f87400f4-0ee0-424f-b46c-f1dc7897a557 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:00.894692 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f87400f4-0ee0-424f-b46c-f1dc7897a557 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:00.959414 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f87400f4-0ee0-424f-b46c-f1dc7897a557 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 14 microversion: 2.1 time: 0.077652 Oct 15 04:15:00.960075 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1140/2381] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:00 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:15:02.030446 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-50434b09-c3b9-4056-9849-7543c05da787 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:02.031569 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-50434b09-c3b9-4056-9849-7543c05da787 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:02.037691 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50434b09-c3b9-4056-9849-7543c05da787 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:02.038134 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50434b09-c3b9-4056-9849-7543c05da787 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:02.038920 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50434b09-c3b9-4056-9849-7543c05da787 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:02.039348 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-50434b09-c3b9-4056-9849-7543c05da787 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:02.114941 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-50434b09-c3b9-4056-9849-7543c05da787 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 6451 microversion: 2.1 time: 0.147472 Oct 15 04:15:02.115543 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1242/2382] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:01 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 6451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:15:03.126780 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-1a98d1dd-993a-4e4a-8ca2-0cb07fc13f6d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:03.127818 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-1a98d1dd-993a-4e4a-8ca2-0cb07fc13f6d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:03.134214 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1a98d1dd-993a-4e4a-8ca2-0cb07fc13f6d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:03.134665 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1a98d1dd-993a-4e4a-8ca2-0cb07fc13f6d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:03.135437 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1a98d1dd-993a-4e4a-8ca2-0cb07fc13f6d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:03.135909 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-1a98d1dd-993a-4e4a-8ca2-0cb07fc13f6d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:03.211047 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-1a98d1dd-993a-4e4a-8ca2-0cb07fc13f6d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 15025 microversion: 2.1 time: 0.088730 Oct 15 04:15:03.211643 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1141/2383] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:03 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 15025 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:04.223120 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-81a3ba47-32a0-422c-9997-02ae331bfdff tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:04.224228 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-81a3ba47-32a0-422c-9997-02ae331bfdff tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:04.230649 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81a3ba47-32a0-422c-9997-02ae331bfdff tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:04.231096 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81a3ba47-32a0-422c-9997-02ae331bfdff tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:04.232478 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81a3ba47-32a0-422c-9997-02ae331bfdff tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:04.232905 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-81a3ba47-32a0-422c-9997-02ae331bfdff tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:04.303134 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-81a3ba47-32a0-422c-9997-02ae331bfdff tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 18398 microversion: 2.1 time: 0.083858 Oct 15 04:15:04.303778 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1243/2384] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:04 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 18398 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:05.314529 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-7bd38bd2-3632-402f-8689-1f07342225a6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:05.315531 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-7bd38bd2-3632-402f-8689-1f07342225a6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:05.321605 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7bd38bd2-3632-402f-8689-1f07342225a6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:05.322044 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7bd38bd2-3632-402f-8689-1f07342225a6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:05.322796 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7bd38bd2-3632-402f-8689-1f07342225a6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:05.323221 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-7bd38bd2-3632-402f-8689-1f07342225a6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:05.410694 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-7bd38bd2-3632-402f-8689-1f07342225a6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 19342 microversion: 2.1 time: 0.100773 Oct 15 04:15:05.411518 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1142/2385] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:05 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 19342 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:06.422236 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1f4ca6cb-d0e2-4ef2-a7d7-23082bf8b117 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:06.423233 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1f4ca6cb-d0e2-4ef2-a7d7-23082bf8b117 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:06.429594 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1f4ca6cb-d0e2-4ef2-a7d7-23082bf8b117 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:06.430037 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1f4ca6cb-d0e2-4ef2-a7d7-23082bf8b117 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:06.430786 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1f4ca6cb-d0e2-4ef2-a7d7-23082bf8b117 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:06.431222 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1f4ca6cb-d0e2-4ef2-a7d7-23082bf8b117 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:06.507160 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1f4ca6cb-d0e2-4ef2-a7d7-23082bf8b117 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 22119 microversion: 2.1 time: 0.088873 Oct 15 04:15:06.507774 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1244/2386] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:06 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 22119 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:07.518877 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-bdd3463f-be66-4cd8-9090-8d712a658952 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:07.519856 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-bdd3463f-be66-4cd8-9090-8d712a658952 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:07.526194 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bdd3463f-be66-4cd8-9090-8d712a658952 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:07.526637 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bdd3463f-be66-4cd8-9090-8d712a658952 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:07.527384 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bdd3463f-be66-4cd8-9090-8d712a658952 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:07.527841 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bdd3463f-be66-4cd8-9090-8d712a658952 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:07.601946 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-bdd3463f-be66-4cd8-9090-8d712a658952 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 23605 microversion: 2.1 time: 0.087063 Oct 15 04:15:07.602798 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1143/2387] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:07 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 23605 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:08.614102 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-3a1864ff-b524-4be1-8ec4-930eb8d6d048 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:08.615039 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-3a1864ff-b524-4be1-8ec4-930eb8d6d048 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:08.621432 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3a1864ff-b524-4be1-8ec4-930eb8d6d048 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:08.622384 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3a1864ff-b524-4be1-8ec4-930eb8d6d048 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:08.623138 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3a1864ff-b524-4be1-8ec4-930eb8d6d048 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:08.623569 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-3a1864ff-b524-4be1-8ec4-930eb8d6d048 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:08.692009 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-3a1864ff-b524-4be1-8ec4-930eb8d6d048 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 25124 microversion: 2.1 time: 0.081800 Oct 15 04:15:08.692628 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1245/2388] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:08 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 25124 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:09.704155 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b6f3002f-ac70-4bcc-bbf1-aee49a8fe9d4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:09.705157 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b6f3002f-ac70-4bcc-bbf1-aee49a8fe9d4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:09.711509 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b6f3002f-ac70-4bcc-bbf1-aee49a8fe9d4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:09.711990 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b6f3002f-ac70-4bcc-bbf1-aee49a8fe9d4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:09.712753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b6f3002f-ac70-4bcc-bbf1-aee49a8fe9d4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:09.713189 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b6f3002f-ac70-4bcc-bbf1-aee49a8fe9d4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:09.786348 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b6f3002f-ac70-4bcc-bbf1-aee49a8fe9d4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 26487 microversion: 2.1 time: 0.086248 Oct 15 04:15:09.786915 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1144/2389] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:09 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 26487 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:10.798214 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-5b4249a3-f38a-4690-96d1-80c902705533 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:10.799154 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-5b4249a3-f38a-4690-96d1-80c902705533 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:10.805433 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5b4249a3-f38a-4690-96d1-80c902705533 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:10.805880 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5b4249a3-f38a-4690-96d1-80c902705533 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:10.806626 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5b4249a3-f38a-4690-96d1-80c902705533 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:10.807056 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-5b4249a3-f38a-4690-96d1-80c902705533 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:10.880248 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-5b4249a3-f38a-4690-96d1-80c902705533 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 27570 microversion: 2.1 time: 0.086611 Oct 15 04:15:10.880860 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1246/2390] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:10 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 27570 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:11.702514 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-914a792d-6e5b-4de0-b68f-099a67b7b5df tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-279767775"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:11.703136 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-914a792d-6e5b-4de0-b68f-099a67b7b5df tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:11.709562 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-914a792d-6e5b-4de0-b68f-099a67b7b5df tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:11.710019 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-914a792d-6e5b-4de0-b68f-099a67b7b5df tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:11.710777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-914a792d-6e5b-4de0-b68f-099a67b7b5df tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:11.711220 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-914a792d-6e5b-4de0-b68f-099a67b7b5df tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:11.826255 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.network.security_group_api [None req-914a792d-6e5b-4de0-b68f-099a67b7b5df tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Removing security group 76fd7d02-2f0d-4dcd-9628-82e48394adc4 from port 1d58d15a-222e-45c7-b26b-bbe742a5dcbd Oct 15 04:15:11.892868 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d1995411-abd6-4247-9bd7-00b78762b02c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:11.893874 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d1995411-abd6-4247-9bd7-00b78762b02c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:11.900203 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1995411-abd6-4247-9bd7-00b78762b02c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:11.900650 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1995411-abd6-4247-9bd7-00b78762b02c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:11.901414 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1995411-abd6-4247-9bd7-00b78762b02c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:11.901848 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d1995411-abd6-4247-9bd7-00b78762b02c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:11.977209 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d1995411-abd6-4247-9bd7-00b78762b02c tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 28028 microversion: 2.1 time: 0.088159 Oct 15 04:15:11.981280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1247/2391] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:11 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 28028 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 04:15:12.155491 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-914a792d-6e5b-4de0-b68f-099a67b7b5df tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "POST /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920/action" status: 202 len: 0 microversion: 2.1 time: 0.457620 Oct 15 04:15:12.157226 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1145/2392] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:11 2021] POST /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 04:15:12.243329 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-30ffe75f-9ada-4c3e-9a1b-9d2af1605c3c req-2a544d45-d92e-4f45-93c7-db39c7adf50a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd14ae5-f09a-4319-b2b9-09dd098e1920", "tag": "1d58d15a-222e-45c7-b26b-bbe742a5dcbd"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:12.247508 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:15:12.247508 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 04:15:12.257451 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-30ffe75f-9ada-4c3e-9a1b-9d2af1605c3c req-2a544d45-d92e-4f45-93c7-db39c7adf50a service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:12.258108 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-30ffe75f-9ada-4c3e-9a1b-9d2af1605c3c req-2a544d45-d92e-4f45-93c7-db39c7adf50a service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:12.273133 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-30ffe75f-9ada-4c3e-9a1b-9d2af1605c3c req-2a544d45-d92e-4f45-93c7-db39c7adf50a service nova] Creating event network-changed:1d58d15a-222e-45c7-b26b-bbe742a5dcbd for instance 5bd14ae5-f09a-4319-b2b9-09dd098e1920 on hv-cinder-81410 Oct 15 04:15:12.278613 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-30ffe75f-9ada-4c3e-9a1b-9d2af1605c3c req-2a544d45-d92e-4f45-93c7-db39c7adf50a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117085 Oct 15 04:15:12.279936 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1248/2393] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:15:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:15:12.989316 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a997c18d-6634-4e29-be74-4015bedd52a6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:12.990231 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a997c18d-6634-4e29-be74-4015bedd52a6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:12.995929 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a997c18d-6634-4e29-be74-4015bedd52a6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:12.996382 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a997c18d-6634-4e29-be74-4015bedd52a6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:12.997655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a997c18d-6634-4e29-be74-4015bedd52a6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:12.998090 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a997c18d-6634-4e29-be74-4015bedd52a6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:13.071127 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a997c18d-6634-4e29-be74-4015bedd52a6 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 28215 microversion: 2.1 time: 0.085746 Oct 15 04:15:13.072613 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1146/2394] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:12 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 28215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:13.827587 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-418365a4-220c-4fdf-9f61-bcdfe5cb12a0 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:15:13.828352 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-418365a4-220c-4fdf-9f61-bcdfe5cb12a0 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:13.836588 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-418365a4-220c-4fdf-9f61-bcdfe5cb12a0 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:13.837190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-418365a4-220c-4fdf-9f61-bcdfe5cb12a0 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:13.837955 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-418365a4-220c-4fdf-9f61-bcdfe5cb12a0 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:13.838386 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-418365a4-220c-4fdf-9f61-bcdfe5cb12a0 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:13.893631 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-3c197283-e69b-4f0e-88d1-31664f24fa8b req-ad21d442-a520-4cf6-ab4a-a497a2997fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd14ae5-f09a-4319-b2b9-09dd098e1920", "tag": "1d58d15a-222e-45c7-b26b-bbe742a5dcbd"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:13.895398 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:15:13.895398 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 04:15:13.902615 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-3c197283-e69b-4f0e-88d1-31664f24fa8b req-ad21d442-a520-4cf6-ab4a-a497a2997fed service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:13.903600 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-3c197283-e69b-4f0e-88d1-31664f24fa8b req-ad21d442-a520-4cf6-ab4a-a497a2997fed service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:13.915151 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-3c197283-e69b-4f0e-88d1-31664f24fa8b req-ad21d442-a520-4cf6-ab4a-a497a2997fed service nova] Creating event network-changed:1d58d15a-222e-45c7-b26b-bbe742a5dcbd for instance 5bd14ae5-f09a-4319-b2b9-09dd098e1920 on hv-cinder-81410 Oct 15 04:15:13.923153 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-3c197283-e69b-4f0e-88d1-31664f24fa8b req-ad21d442-a520-4cf6-ab4a-a497a2997fed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099404 Oct 15 04:15:13.923947 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1147/2395] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:15:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:15:13.926648 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.objects.instance [None req-418365a4-220c-4fdf-9f61-bcdfe5cb12a0 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lazy-loading 'services' on Instance uuid 5bd14ae5-f09a-4319-b2b9-09dd098e1920 {{(pid=120897) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 04:15:14.002520 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-418365a4-220c-4fdf-9f61-bcdfe5cb12a0 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920/os-volume_attachments/41a59ca9-ca31-4a11-a365-18e224da71c7" status: 202 len: 0 microversion: 2.1 time: 0.181098 Oct 15 04:15:14.003433 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1249/2396] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Oct 15 04:15:13 2021] DELETE /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920/os-volume_attachments/41a59ca9-ca31-4a11-a365-18e224da71c7 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 04:15:14.018184 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0a83fafe-8bd0-4cf0-97ac-5d68db9915e6 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:15:14.019251 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0a83fafe-8bd0-4cf0-97ac-5d68db9915e6 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:14.025397 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0a83fafe-8bd0-4cf0-97ac-5d68db9915e6 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:14.025860 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0a83fafe-8bd0-4cf0-97ac-5d68db9915e6 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:14.026701 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0a83fafe-8bd0-4cf0-97ac-5d68db9915e6 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:14.027391 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0a83fafe-8bd0-4cf0-97ac-5d68db9915e6 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:14.057764 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0a83fafe-8bd0-4cf0-97ac-5d68db9915e6 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049490 Oct 15 04:15:14.058603 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1148/2397] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 04:15:14 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:15:14.082667 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ece499c9-19b8-401e-b83b-c3c37934c27f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:14.083753 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ece499c9-19b8-401e-b83b-c3c37934c27f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:14.090011 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ece499c9-19b8-401e-b83b-c3c37934c27f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:14.091243 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ece499c9-19b8-401e-b83b-c3c37934c27f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:14.092216 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ece499c9-19b8-401e-b83b-c3c37934c27f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:14.096516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ece499c9-19b8-401e-b83b-c3c37934c27f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:14.169848 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ece499c9-19b8-401e-b83b-c3c37934c27f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 28215 microversion: 2.1 time: 0.090940 Oct 15 04:15:14.171369 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1250/2398] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:14 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 28215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:15.070121 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-29427f44-4e0c-4597-a4c2-66a6573d52ed tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:15:15.071023 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-29427f44-4e0c-4597-a4c2-66a6573d52ed tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:15.078145 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-29427f44-4e0c-4597-a4c2-66a6573d52ed tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:15.078592 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-29427f44-4e0c-4597-a4c2-66a6573d52ed tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:15.079339 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-29427f44-4e0c-4597-a4c2-66a6573d52ed tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:15.079795 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-29427f44-4e0c-4597-a4c2-66a6573d52ed tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:15.109579 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-29427f44-4e0c-4597-a4c2-66a6573d52ed tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043184 Oct 15 04:15:15.110126 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1149/2399] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 04:15:15 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:15:15.120681 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d4aef93e-0ba9-490f-9172-f394512da7af tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:15:15.121212 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d4aef93e-0ba9-490f-9172-f394512da7af tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:15.127583 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4aef93e-0ba9-490f-9172-f394512da7af tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:15.128075 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4aef93e-0ba9-490f-9172-f394512da7af tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:15.128851 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4aef93e-0ba9-490f-9172-f394512da7af tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:15.129272 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d4aef93e-0ba9-490f-9172-f394512da7af tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:15.181390 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-27cce515-75c2-44d1-9c1c-57c8e5c831d3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:15.182307 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-27cce515-75c2-44d1-9c1c-57c8e5c831d3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:15.188871 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-27cce515-75c2-44d1-9c1c-57c8e5c831d3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:15.189322 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-27cce515-75c2-44d1-9c1c-57c8e5c831d3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:15.190081 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-27cce515-75c2-44d1-9c1c-57c8e5c831d3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:15.190508 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-27cce515-75c2-44d1-9c1c-57c8e5c831d3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:15.200466 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.wsgi [None req-d4aef93e-0ba9-490f-9172-f394512da7af tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] HTTP exception thrown: Instance 5bd14ae5-f09a-4319-b2b9-09dd098e1920 is not attached to volume 41a59ca9-ca31-4a11-a365-18e224da71c7 Oct 15 04:15:15.201078 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d4aef93e-0ba9-490f-9172-f394512da7af tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Returning 404 to user: Instance 5bd14ae5-f09a-4319-b2b9-09dd098e1920 is not attached to volume 41a59ca9-ca31-4a11-a365-18e224da71c7 {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 04:15:15.201900 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d4aef93e-0ba9-490f-9172-f394512da7af tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920/os-volume_attachments/41a59ca9-ca31-4a11-a365-18e224da71c7" status: 404 len: 154 microversion: 2.1 time: 0.085491 Oct 15 04:15:15.202438 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1251/2400] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Oct 15 04:15:15 2021] DELETE /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920/os-volume_attachments/41a59ca9-ca31-4a11-a365-18e224da71c7 => generated 154 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 04:15:15.263862 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-27cce515-75c2-44d1-9c1c-57c8e5c831d3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 28506 microversion: 2.1 time: 0.085981 Oct 15 04:15:15.268119 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1150/2401] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:15 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 28506 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 04:15:16.275642 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4453da03-f2f1-4cf3-8c33-864eb5357428 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:16.276579 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4453da03-f2f1-4cf3-8c33-864eb5357428 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:16.283311 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4453da03-f2f1-4cf3-8c33-864eb5357428 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:16.283786 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4453da03-f2f1-4cf3-8c33-864eb5357428 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:16.284534 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4453da03-f2f1-4cf3-8c33-864eb5357428 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:16.284964 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4453da03-f2f1-4cf3-8c33-864eb5357428 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:16.330398 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-531dbb9d-4868-445c-85f3-ffe2671dd162 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:15:16.330976 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-531dbb9d-4868-445c-85f3-ffe2671dd162 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:16.337354 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-531dbb9d-4868-445c-85f3-ffe2671dd162 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:16.337796 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-531dbb9d-4868-445c-85f3-ffe2671dd162 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:16.338556 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-531dbb9d-4868-445c-85f3-ffe2671dd162 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:16.338980 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-531dbb9d-4868-445c-85f3-ffe2671dd162 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:16.359923 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4453da03-f2f1-4cf3-8c33-864eb5357428 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 28674 microversion: 2.1 time: 0.087663 Oct 15 04:15:16.360559 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1252/2402] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:16 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 28674 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:16.363171 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-531dbb9d-4868-445c-85f3-ffe2671dd162 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Going to try to terminate instance {{(pid=120899) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 15 04:15:16.433665 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-531dbb9d-4868-445c-85f3-ffe2671dd162 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 204 len: 0 microversion: 2.1 time: 0.106767 Oct 15 04:15:16.434307 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1151/2403] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 04:15:16 2021] DELETE /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 04:15:16.444090 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-970c3fad-bc6d-49bb-8989-b1c18f9786d7 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:15:16.444793 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-970c3fad-bc6d-49bb-8989-b1c18f9786d7 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:16.451143 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-970c3fad-bc6d-49bb-8989-b1c18f9786d7 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:16.451593 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-970c3fad-bc6d-49bb-8989-b1c18f9786d7 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:16.452392 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-970c3fad-bc6d-49bb-8989-b1c18f9786d7 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:16.452830 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-970c3fad-bc6d-49bb-8989-b1c18f9786d7 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:16.573131 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-970c3fad-bc6d-49bb-8989-b1c18f9786d7 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:15:16.580273 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-970c3fad-bc6d-49bb-8989-b1c18f9786d7 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1555 microversion: 2.1 time: 0.140251 Oct 15 04:15:16.580849 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1253/2404] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:15:16 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1555 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:15:17.371996 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-bde692fa-48c8-4629-9c58-b800fe2d9e1e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:17.372987 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-bde692fa-48c8-4629-9c58-b800fe2d9e1e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:17.379096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bde692fa-48c8-4629-9c58-b800fe2d9e1e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:17.379547 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bde692fa-48c8-4629-9c58-b800fe2d9e1e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:17.380318 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bde692fa-48c8-4629-9c58-b800fe2d9e1e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:17.380740 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bde692fa-48c8-4629-9c58-b800fe2d9e1e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:17.441491 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-bde692fa-48c8-4629-9c58-b800fe2d9e1e tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 28674 microversion: 2.1 time: 0.073366 Oct 15 04:15:17.442089 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1152/2405] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:17 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 28674 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:17.597139 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b039ca00-3415-4e89-bf88-11f75aafed31 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:15:17.597681 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b039ca00-3415-4e89-bf88-11f75aafed31 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:17.603895 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b039ca00-3415-4e89-bf88-11f75aafed31 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:17.604347 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b039ca00-3415-4e89-bf88-11f75aafed31 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:17.605137 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b039ca00-3415-4e89-bf88-11f75aafed31 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:17.605567 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b039ca00-3415-4e89-bf88-11f75aafed31 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:17.720018 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-b039ca00-3415-4e89-bf88-11f75aafed31 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:15:17.727127 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b039ca00-3415-4e89-bf88-11f75aafed31 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1555 microversion: 2.1 time: 0.133657 Oct 15 04:15:17.727703 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1254/2406] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:15:17 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1555 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:15:18.453418 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6ebb64bd-a73f-41ee-8b11-7eaeba314c9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:18.454414 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6ebb64bd-a73f-41ee-8b11-7eaeba314c9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:18.460679 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6ebb64bd-a73f-41ee-8b11-7eaeba314c9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:18.461127 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6ebb64bd-a73f-41ee-8b11-7eaeba314c9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:18.461873 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6ebb64bd-a73f-41ee-8b11-7eaeba314c9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:18.462335 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6ebb64bd-a73f-41ee-8b11-7eaeba314c9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:18.524901 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6ebb64bd-a73f-41ee-8b11-7eaeba314c9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 28674 microversion: 2.1 time: 0.075292 Oct 15 04:15:18.529534 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1153/2407] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:18 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 28674 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 04:15:18.744491 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ccc535c1-3bb2-49da-8f10-df236b7e6667 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:15:18.744997 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ccc535c1-3bb2-49da-8f10-df236b7e6667 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:18.751080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ccc535c1-3bb2-49da-8f10-df236b7e6667 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:18.752076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ccc535c1-3bb2-49da-8f10-df236b7e6667 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:18.752481 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-d3a73690-f478-41c4-9f3b-721ac401b0a7 req-5ec039a2-c7eb-49a7-84b9-5f0c27fc937d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd14ae5-f09a-4319-b2b9-09dd098e1920", "name": "network-vif-deleted", "tag": "1d58d15a-222e-45c7-b26b-bbe742a5dcbd"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:18.753076 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ccc535c1-3bb2-49da-8f10-df236b7e6667 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:18.753496 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ccc535c1-3bb2-49da-8f10-df236b7e6667 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:18.754242 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:15:18.754242 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 04:15:18.764042 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-d3a73690-f478-41c4-9f3b-721ac401b0a7 req-5ec039a2-c7eb-49a7-84b9-5f0c27fc937d service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:18.765062 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-d3a73690-f478-41c4-9f3b-721ac401b0a7 req-5ec039a2-c7eb-49a7-84b9-5f0c27fc937d service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:18.777762 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-d3a73690-f478-41c4-9f3b-721ac401b0a7 req-5ec039a2-c7eb-49a7-84b9-5f0c27fc937d service nova] Creating event network-vif-deleted:1d58d15a-222e-45c7-b26b-bbe742a5dcbd for instance 5bd14ae5-f09a-4319-b2b9-09dd098e1920 on hv-cinder-81410 Oct 15 04:15:18.784796 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-d3a73690-f478-41c4-9f3b-721ac401b0a7 req-5ec039a2-c7eb-49a7-84b9-5f0c27fc937d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036655 Oct 15 04:15:18.785654 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1154/2408] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:15:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 04:15:18.817758 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ccc535c1-3bb2-49da-8f10-df236b7e6667 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec3ec37e88a492ca616718e83e15816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf86994ea4b42f08d65aefa85065d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:15:18.825122 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ccc535c1-3bb2-49da-8f10-df236b7e6667 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 200 len: 1513 microversion: 2.1 time: 0.084391 Oct 15 04:15:18.826230 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1255/2409] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:15:18 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 1513 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:15:19.537641 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0152af7e-5682-4f63-b046-27b1de6b3164 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:19.538640 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0152af7e-5682-4f63-b046-27b1de6b3164 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:19.545193 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0152af7e-5682-4f63-b046-27b1de6b3164 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:19.545639 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0152af7e-5682-4f63-b046-27b1de6b3164 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:19.546389 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0152af7e-5682-4f63-b046-27b1de6b3164 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:19.546821 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0152af7e-5682-4f63-b046-27b1de6b3164 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:19.617900 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0152af7e-5682-4f63-b046-27b1de6b3164 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 29359 microversion: 2.1 time: 0.084123 Oct 15 04:15:19.618504 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1155/2410] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:19 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 29359 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:19.843082 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d594e058-ac73-454f-9065-159288771a90 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:15:19.843709 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d594e058-ac73-454f-9065-159288771a90 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] [instance: 5bd14ae5-f09a-4319-b2b9-09dd098e1920] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:19.849857 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d594e058-ac73-454f-9065-159288771a90 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:19.850305 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d594e058-ac73-454f-9065-159288771a90 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:19.851063 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d594e058-ac73-454f-9065-159288771a90 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:19.851498 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d594e058-ac73-454f-9065-159288771a90 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:19.864374 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.wsgi [None req-d594e058-ac73-454f-9065-159288771a90 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] HTTP exception thrown: Instance 5bd14ae5-f09a-4319-b2b9-09dd098e1920 could not be found. Oct 15 04:15:19.864952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d594e058-ac73-454f-9065-159288771a90 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Returning 404 to user: Instance 5bd14ae5-f09a-4319-b2b9-09dd098e1920 could not be found. {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 04:15:19.865744 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d594e058-ac73-454f-9065-159288771a90 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920" status: 404 len: 111 microversion: 2.1 time: 0.026329 Oct 15 04:15:19.866246 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1256/2411] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:15:19 2021] GET /compute/v2.1/servers/5bd14ae5-f09a-4319-b2b9-09dd098e1920 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 04:15:19.874914 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ee8bacb3-f5c6-4f24-a4a5-5fa06e974f10 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] Calling method '.version_select at 0x7f4ac179ce50>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:15:19.891655 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ee8bacb3-f5c6-4f24-a4a5-5fa06e974f10 tempest-TestMinimumBasicScenario-998923249 tempest-TestMinimumBasicScenario-998923249-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2140268227" status: 202 len: 0 microversion: 2.1 time: 0.021161 Oct 15 04:15:19.892213 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1156/2412] 10.222.0.30 () {58 vars in 1271 bytes} [Fri Oct 15 04:15:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2140268227 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 04:15:20.629430 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-eef522f6-5371-4ea7-be53-16b59607f6a4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:20.630409 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-eef522f6-5371-4ea7-be53-16b59607f6a4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:20.636110 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eef522f6-5371-4ea7-be53-16b59607f6a4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:20.636558 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eef522f6-5371-4ea7-be53-16b59607f6a4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:20.637318 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eef522f6-5371-4ea7-be53-16b59607f6a4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:20.637763 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eef522f6-5371-4ea7-be53-16b59607f6a4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:20.711839 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-eef522f6-5371-4ea7-be53-16b59607f6a4 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 31543 microversion: 2.1 time: 0.086008 Oct 15 04:15:20.715814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1257/2413] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:20 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 31543 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:21.723639 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5875057b-b31c-4076-aed5-c216b721c24b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:21.724636 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5875057b-b31c-4076-aed5-c216b721c24b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:21.732330 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5875057b-b31c-4076-aed5-c216b721c24b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:21.732775 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5875057b-b31c-4076-aed5-c216b721c24b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:21.733525 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5875057b-b31c-4076-aed5-c216b721c24b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:21.733956 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5875057b-b31c-4076-aed5-c216b721c24b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:21.804017 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5875057b-b31c-4076-aed5-c216b721c24b tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 33266 microversion: 2.1 time: 0.084739 Oct 15 04:15:21.804563 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1157/2414] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:21 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 33266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:22.817131 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7ffbdf7f-8465-44f9-8263-993fe886a824 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:22.818138 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7ffbdf7f-8465-44f9-8263-993fe886a824 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:22.825139 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7ffbdf7f-8465-44f9-8263-993fe886a824 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:22.826264 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7ffbdf7f-8465-44f9-8263-993fe886a824 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:22.827281 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7ffbdf7f-8465-44f9-8263-993fe886a824 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:22.827734 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7ffbdf7f-8465-44f9-8263-993fe886a824 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:22.906071 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7ffbdf7f-8465-44f9-8263-993fe886a824 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 34238 microversion: 2.1 time: 0.093053 Oct 15 04:15:22.906764 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1258/2415] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:22 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 34238 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:23.918902 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2a3189d1-cae0-471c-af63-542ab80d61b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:23.919939 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2a3189d1-cae0-471c-af63-542ab80d61b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:23.926271 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2a3189d1-cae0-471c-af63-542ab80d61b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:23.926724 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2a3189d1-cae0-471c-af63-542ab80d61b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:23.927492 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2a3189d1-cae0-471c-af63-542ab80d61b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:23.927979 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2a3189d1-cae0-471c-af63-542ab80d61b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:23.997812 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2a3189d1-cae0-471c-af63-542ab80d61b3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 35354 microversion: 2.1 time: 0.082727 Oct 15 04:15:24.001777 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1158/2416] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:23 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 35354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:25.011419 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-b6b5fcf4-7653-4503-b6e5-dd8050f508ca tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:25.013163 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-b6b5fcf4-7653-4503-b6e5-dd8050f508ca tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:25.019447 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b6b5fcf4-7653-4503-b6e5-dd8050f508ca tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:25.019934 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b6b5fcf4-7653-4503-b6e5-dd8050f508ca tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:25.020875 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b6b5fcf4-7653-4503-b6e5-dd8050f508ca tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:25.021514 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-b6b5fcf4-7653-4503-b6e5-dd8050f508ca tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:25.096537 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-b6b5fcf4-7653-4503-b6e5-dd8050f508ca tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 36892 microversion: 2.1 time: 0.089742 Oct 15 04:15:25.102532 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1259/2417] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:25 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 36892 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:26.111734 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5413b49b-09c4-4892-9edc-8ea1e6d3ed72 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:26.115950 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-5413b49b-09c4-4892-9edc-8ea1e6d3ed72 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:26.123035 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5413b49b-09c4-4892-9edc-8ea1e6d3ed72 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:26.123557 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5413b49b-09c4-4892-9edc-8ea1e6d3ed72 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:26.124422 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5413b49b-09c4-4892-9edc-8ea1e6d3ed72 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:26.124921 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-5413b49b-09c4-4892-9edc-8ea1e6d3ed72 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:26.195443 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5413b49b-09c4-4892-9edc-8ea1e6d3ed72 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 38209 microversion: 2.1 time: 0.087202 Oct 15 04:15:26.195763 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1159/2418] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:26 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 38209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:27.207493 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-6cd9e0f2-4f69-4e27-8b83-96ee14042dfd tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:27.208517 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-6cd9e0f2-4f69-4e27-8b83-96ee14042dfd tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:27.214743 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6cd9e0f2-4f69-4e27-8b83-96ee14042dfd tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:27.215190 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6cd9e0f2-4f69-4e27-8b83-96ee14042dfd tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:27.216484 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6cd9e0f2-4f69-4e27-8b83-96ee14042dfd tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:27.216934 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-6cd9e0f2-4f69-4e27-8b83-96ee14042dfd tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:27.276315 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-6cd9e0f2-4f69-4e27-8b83-96ee14042dfd tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 38209 microversion: 2.1 time: 0.073196 Oct 15 04:15:27.277171 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1260/2419] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:27 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 38209 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 04:15:28.290193 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8c63e25b-d55f-4319-ac9e-f53952f5b759 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:28.291201 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8c63e25b-d55f-4319-ac9e-f53952f5b759 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:28.297855 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8c63e25b-d55f-4319-ac9e-f53952f5b759 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:28.298309 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8c63e25b-d55f-4319-ac9e-f53952f5b759 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:28.299071 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8c63e25b-d55f-4319-ac9e-f53952f5b759 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:28.299509 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8c63e25b-d55f-4319-ac9e-f53952f5b759 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:28.357892 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8c63e25b-d55f-4319-ac9e-f53952f5b759 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 38209 microversion: 2.1 time: 0.071436 Oct 15 04:15:28.358538 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1160/2420] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:28 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 38209 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:29.369884 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c2a723b9-0b97-4417-8418-dc4deede4504 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:29.370908 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c2a723b9-0b97-4417-8418-dc4deede4504 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:29.377840 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c2a723b9-0b97-4417-8418-dc4deede4504 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:29.378288 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c2a723b9-0b97-4417-8418-dc4deede4504 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:29.379040 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c2a723b9-0b97-4417-8418-dc4deede4504 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:29.379474 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c2a723b9-0b97-4417-8418-dc4deede4504 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:29.436984 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c2a723b9-0b97-4417-8418-dc4deede4504 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 38209 microversion: 2.1 time: 0.070916 Oct 15 04:15:29.437603 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1261/2421] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:29 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 38209 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:30.449102 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e8a7bd00-3c6c-47bd-98da-3433e9dcdcb9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:30.450184 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e8a7bd00-3c6c-47bd-98da-3433e9dcdcb9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:30.456518 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e8a7bd00-3c6c-47bd-98da-3433e9dcdcb9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:30.456965 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e8a7bd00-3c6c-47bd-98da-3433e9dcdcb9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:30.457718 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e8a7bd00-3c6c-47bd-98da-3433e9dcdcb9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:30.458151 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e8a7bd00-3c6c-47bd-98da-3433e9dcdcb9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:30.525297 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e8a7bd00-3c6c-47bd-98da-3433e9dcdcb9 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action" status: 200 len: 38340 microversion: 2.1 time: 0.079916 Oct 15 04:15:30.525877 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1161/2422] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Oct 15 04:15:30 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/action => generated 38340 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 04:15:30.536642 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-eec2a363-7842-49e4-bef8-c9139a37c241 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:15:30.537215 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-eec2a363-7842-49e4-bef8-c9139a37c241 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:30.543481 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eec2a363-7842-49e4-bef8-c9139a37c241 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:30.543959 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eec2a363-7842-49e4-bef8-c9139a37c241 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:30.544709 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eec2a363-7842-49e4-bef8-c9139a37c241 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:30.545139 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eec2a363-7842-49e4-bef8-c9139a37c241 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:30.567179 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-eec2a363-7842-49e4-bef8-c9139a37c241 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/ips" status: 200 len: 147 microversion: 2.1 time: 0.034503 Oct 15 04:15:30.567734 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1262/2423] 10.222.0.30 () {58 vars in 1247 bytes} [Fri Oct 15 04:15:30 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/ips => generated 147 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:15:31.855128 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0f034335-70b2-4874-a539-84c9190fb196 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07e90c67-e386-48c9-8c19-0c0e0b1c73ca"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:31.856287 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0f034335-70b2-4874-a539-84c9190fb196 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:31.863420 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0f034335-70b2-4874-a539-84c9190fb196 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:31.863904 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0f034335-70b2-4874-a539-84c9190fb196 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:31.864653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0f034335-70b2-4874-a539-84c9190fb196 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:31.865084 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0f034335-70b2-4874-a539-84c9190fb196 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:32.082837 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0f034335-70b2-4874-a539-84c9190fb196 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.231532 Oct 15 04:15:32.083430 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1162/2424] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Oct 15 04:15:31 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments => generated 194 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:15:38.486298 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f05a87b7-e30d-46ab-9495-33ef21519674 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:15:38.487243 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f05a87b7-e30d-46ab-9495-33ef21519674 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:38.493438 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f05a87b7-e30d-46ab-9495-33ef21519674 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:38.493891 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f05a87b7-e30d-46ab-9495-33ef21519674 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:38.494656 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f05a87b7-e30d-46ab-9495-33ef21519674 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:38.495095 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f05a87b7-e30d-46ab-9495-33ef21519674 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:38.524752 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f05a87b7-e30d-46ab-9495-33ef21519674 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042076 Oct 15 04:15:38.525300 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1263/2425] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 04:15:38 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:15:38.540076 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-f9f6340e-d9ac-465e-8ecb-c1912b136762 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:15:38.540923 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-f9f6340e-d9ac-465e-8ecb-c1912b136762 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:38.548186 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f9f6340e-d9ac-465e-8ecb-c1912b136762 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:38.548637 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f9f6340e-d9ac-465e-8ecb-c1912b136762 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:38.549402 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f9f6340e-d9ac-465e-8ecb-c1912b136762 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:38.549833 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-f9f6340e-d9ac-465e-8ecb-c1912b136762 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:38.584461 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-f9f6340e-d9ac-465e-8ecb-c1912b136762 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments/07e90c67-e386-48c9-8c19-0c0e0b1c73ca" status: 200 len: 194 microversion: 2.1 time: 0.050445 Oct 15 04:15:38.585068 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1163/2426] 10.222.0.30 () {58 vars in 1412 bytes} [Fri Oct 15 04:15:38 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments/07e90c67-e386-48c9-8c19-0c0e0b1c73ca => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:15:39.870481 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-658c2606-b1ca-4134-99e6-9e4e79d5cd9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf4408e2-f78d-474a-a8bb-53092c1ae7b8"}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:15:39.871534 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-658c2606-b1ca-4134-99e6-9e4e79d5cd9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:39.877695 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-658c2606-b1ca-4134-99e6-9e4e79d5cd9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:39.878139 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-658c2606-b1ca-4134-99e6-9e4e79d5cd9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:39.878894 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-658c2606-b1ca-4134-99e6-9e4e79d5cd9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:39.879328 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-658c2606-b1ca-4134-99e6-9e4e79d5cd9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:40.094769 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-658c2606-b1ca-4134-99e6-9e4e79d5cd9f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.227795 Oct 15 04:15:40.095357 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1264/2427] 10.222.0.30 () {60 vars in 1322 bytes} [Fri Oct 15 04:15:39 2021] POST /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments => generated 194 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:15:41.940549 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4fd96877-133a-4934-b8b0-a4c42ac70b72 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:15:41.941048 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4fd96877-133a-4934-b8b0-a4c42ac70b72 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:41.947119 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4fd96877-133a-4934-b8b0-a4c42ac70b72 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:41.947568 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4fd96877-133a-4934-b8b0-a4c42ac70b72 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:41.948373 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4fd96877-133a-4934-b8b0-a4c42ac70b72 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:41.948808 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4fd96877-133a-4934-b8b0-a4c42ac70b72 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:41.962386 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-4fd96877-133a-4934-b8b0-a4c42ac70b72 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] HTTP exception thrown: Instance 3594fddd-dbb7-4731-8f30-b3512198e1a9 could not be found. Oct 15 04:15:41.962971 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4fd96877-133a-4934-b8b0-a4c42ac70b72 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Returning 404 to user: Instance 3594fddd-dbb7-4731-8f30-b3512198e1a9 could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 04:15:41.963810 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4fd96877-133a-4934-b8b0-a4c42ac70b72 tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 404 len: 111 microversion: 2.1 time: 0.027136 Oct 15 04:15:41.964316 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1164/2428] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 04:15:41 2021] DELETE /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 04:15:41.973492 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-60ceecf6-f743-497a-b7a0-11404b74936e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:15:41.974184 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-60ceecf6-f743-497a-b7a0-11404b74936e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] [instance: 3594fddd-dbb7-4731-8f30-b3512198e1a9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:41.980106 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-60ceecf6-f743-497a-b7a0-11404b74936e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:41.980556 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-60ceecf6-f743-497a-b7a0-11404b74936e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:41.981311 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-60ceecf6-f743-497a-b7a0-11404b74936e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:41.981745 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-60ceecf6-f743-497a-b7a0-11404b74936e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:41.994995 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.wsgi [None req-60ceecf6-f743-497a-b7a0-11404b74936e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] HTTP exception thrown: Instance 3594fddd-dbb7-4731-8f30-b3512198e1a9 could not be found. Oct 15 04:15:41.995615 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-60ceecf6-f743-497a-b7a0-11404b74936e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] Returning 404 to user: Instance 3594fddd-dbb7-4731-8f30-b3512198e1a9 could not be found. {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 04:15:41.996449 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-60ceecf6-f743-497a-b7a0-11404b74936e tempest-AttachVolumeShelveTestJSON-1874262311 tempest-AttachVolumeShelveTestJSON-1874262311-project] 10.222.0.30 "GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9" status: 404 len: 111 microversion: 2.1 time: 0.028095 Oct 15 04:15:41.996988 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1265/2429] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:15:41 2021] GET /compute/v2.1/servers/3594fddd-dbb7-4731-8f30-b3512198e1a9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 04:15:47.594452 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-d6763f0b-805c-4f2a-ae31-07d2b6d7e28f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:15:47.595935 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-d6763f0b-805c-4f2a-ae31-07d2b6d7e28f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:15:47.602432 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d6763f0b-805c-4f2a-ae31-07d2b6d7e28f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:47.602939 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d6763f0b-805c-4f2a-ae31-07d2b6d7e28f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:47.603815 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d6763f0b-805c-4f2a-ae31-07d2b6d7e28f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:15:47.604250 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-d6763f0b-805c-4f2a-ae31-07d2b6d7e28f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:15:47.634512 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-d6763f0b-805c-4f2a-ae31-07d2b6d7e28f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043727 Oct 15 04:15:47.639817 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1165/2430] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 04:15:47 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:16:03.174721 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-37730cbe-6c68-43cb-9733-ad5374776833 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:03.175229 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-37730cbe-6c68-43cb-9733-ad5374776833 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:03.181272 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-37730cbe-6c68-43cb-9733-ad5374776833 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:03.181722 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-37730cbe-6c68-43cb-9733-ad5374776833 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:03.182476 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-37730cbe-6c68-43cb-9733-ad5374776833 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:03.182911 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-37730cbe-6c68-43cb-9733-ad5374776833 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:03.213302 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-37730cbe-6c68-43cb-9733-ad5374776833 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments/07e90c67-e386-48c9-8c19-0c0e0b1c73ca" status: 200 len: 194 microversion: 2.1 time: 0.042276 Oct 15 04:16:03.214104 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1266/2431] 10.222.0.30 () {58 vars in 1412 bytes} [Fri Oct 15 04:16:03 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments/07e90c67-e386-48c9-8c19-0c0e0b1c73ca => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:16:03.224601 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8392f4ef-cf5b-4cc0-802a-29712a5b1465 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:03.225164 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8392f4ef-cf5b-4cc0-802a-29712a5b1465 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:03.231338 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8392f4ef-cf5b-4cc0-802a-29712a5b1465 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:03.231819 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8392f4ef-cf5b-4cc0-802a-29712a5b1465 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:03.232587 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8392f4ef-cf5b-4cc0-802a-29712a5b1465 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:03.233016 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8392f4ef-cf5b-4cc0-802a-29712a5b1465 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:03.319533 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.objects.instance [None req-8392f4ef-cf5b-4cc0-802a-29712a5b1465 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lazy-loading 'services' on Instance uuid 0aac61cb-6478-4440-93fa-bdc4d748b09e {{(pid=120899) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 04:16:03.392662 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8392f4ef-cf5b-4cc0-802a-29712a5b1465 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments/07e90c67-e386-48c9-8c19-0c0e0b1c73ca" status: 202 len: 0 microversion: 2.1 time: 0.171820 Oct 15 04:16:03.393279 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1166/2432] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Oct 15 04:16:03 2021] DELETE /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments/07e90c67-e386-48c9-8c19-0c0e0b1c73ca => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 04:16:04.495650 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-22d4df64-7495-4567-95e0-3f31d5e2ab50 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:04.496164 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-22d4df64-7495-4567-95e0-3f31d5e2ab50 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:04.502490 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-22d4df64-7495-4567-95e0-3f31d5e2ab50 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:04.502939 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-22d4df64-7495-4567-95e0-3f31d5e2ab50 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:04.503725 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-22d4df64-7495-4567-95e0-3f31d5e2ab50 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:04.504166 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-22d4df64-7495-4567-95e0-3f31d5e2ab50 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:04.531985 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-22d4df64-7495-4567-95e0-3f31d5e2ab50 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments/cf4408e2-f78d-474a-a8bb-53092c1ae7b8" status: 200 len: 194 microversion: 2.1 time: 0.039916 Oct 15 04:16:04.533119 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1267/2433] 10.222.0.30 () {58 vars in 1412 bytes} [Fri Oct 15 04:16:04 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments/cf4408e2-f78d-474a-a8bb-53092c1ae7b8 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:16:04.545072 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9fc7bcdb-1348-4f66-af2d-59768f6596df tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:04.545764 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9fc7bcdb-1348-4f66-af2d-59768f6596df tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:04.552982 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9fc7bcdb-1348-4f66-af2d-59768f6596df tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:04.553424 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9fc7bcdb-1348-4f66-af2d-59768f6596df tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:04.554182 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9fc7bcdb-1348-4f66-af2d-59768f6596df tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:04.554719 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9fc7bcdb-1348-4f66-af2d-59768f6596df tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:04.630960 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.objects.instance [None req-9fc7bcdb-1348-4f66-af2d-59768f6596df tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lazy-loading 'services' on Instance uuid 0aac61cb-6478-4440-93fa-bdc4d748b09e {{(pid=120899) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 04:16:04.698294 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9fc7bcdb-1348-4f66-af2d-59768f6596df tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments/cf4408e2-f78d-474a-a8bb-53092c1ae7b8" status: 202 len: 0 microversion: 2.1 time: 0.157634 Oct 15 04:16:04.699049 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1167/2434] 10.222.0.30 () {58 vars in 1415 bytes} [Fri Oct 15 04:16:04 2021] DELETE /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments/cf4408e2-f78d-474a-a8bb-53092c1ae7b8 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 04:16:05.866099 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-753c199a-027c-4f5e-9e12-0a8644c452a3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:05.867070 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-753c199a-027c-4f5e-9e12-0a8644c452a3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:05.873345 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-753c199a-027c-4f5e-9e12-0a8644c452a3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:05.873832 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-753c199a-027c-4f5e-9e12-0a8644c452a3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:05.874621 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-753c199a-027c-4f5e-9e12-0a8644c452a3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:05.875146 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-753c199a-027c-4f5e-9e12-0a8644c452a3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:05.903999 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-753c199a-027c-4f5e-9e12-0a8644c452a3 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042243 Oct 15 04:16:05.904565 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1268/2435] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 04:16:05 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 15 04:16:06.003521 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-af844be3-1ce5-4c86-9bed-47475ac22fc1 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:06.004596 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-af844be3-1ce5-4c86-9bed-47475ac22fc1 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:06.010631 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-af844be3-1ce5-4c86-9bed-47475ac22fc1 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:06.011083 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-af844be3-1ce5-4c86-9bed-47475ac22fc1 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:06.011902 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-af844be3-1ce5-4c86-9bed-47475ac22fc1 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:06.012328 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-af844be3-1ce5-4c86-9bed-47475ac22fc1 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:06.044642 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-af844be3-1ce5-4c86-9bed-47475ac22fc1 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044351 Oct 15 04:16:06.045882 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1168/2436] 10.222.0.30 () {58 vars in 1301 bytes} [Fri Oct 15 04:16:05 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 04:16:06.101045 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-2debb5f4-8741-407d-9a84-686f930b0b7f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:06.101481 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2debb5f4-8741-407d-9a84-686f930b0b7f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:06.107093 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2debb5f4-8741-407d-9a84-686f930b0b7f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:06.107542 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2debb5f4-8741-407d-9a84-686f930b0b7f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:06.108343 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2debb5f4-8741-407d-9a84-686f930b0b7f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:06.108783 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-2debb5f4-8741-407d-9a84-686f930b0b7f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:06.132936 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-2debb5f4-8741-407d-9a84-686f930b0b7f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Going to try to terminate instance {{(pid=120897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 15 04:16:06.204651 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-2debb5f4-8741-407d-9a84-686f930b0b7f tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e" status: 204 len: 0 microversion: 2.1 time: 0.106645 Oct 15 04:16:06.205570 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1269/2437] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 04:16:06 2021] DELETE /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 15 04:16:06.213701 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-32a4059e-9529-4b63-a86b-a97f4389e038 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:06.214368 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-32a4059e-9529-4b63-a86b-a97f4389e038 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:06.220037 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-32a4059e-9529-4b63-a86b-a97f4389e038 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:06.220481 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-32a4059e-9529-4b63-a86b-a97f4389e038 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:06.221783 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-32a4059e-9529-4b63-a86b-a97f4389e038 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:06.222299 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-32a4059e-9529-4b63-a86b-a97f4389e038 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:06.339476 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-32a4059e-9529-4b63-a86b-a97f4389e038 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:16:06.347201 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-32a4059e-9529-4b63-a86b-a97f4389e038 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e" status: 200 len: 1675 microversion: 2.1 time: 0.137146 Oct 15 04:16:06.347786 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1169/2438] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:16:06 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e => generated 1675 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:16:07.364617 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d49fc14a-f548-4b35-9fa1-7f3fe0349662 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:07.365279 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d49fc14a-f548-4b35-9fa1-7f3fe0349662 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:07.375659 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d49fc14a-f548-4b35-9fa1-7f3fe0349662 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:07.375659 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d49fc14a-f548-4b35-9fa1-7f3fe0349662 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:07.375659 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d49fc14a-f548-4b35-9fa1-7f3fe0349662 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:07.375659 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d49fc14a-f548-4b35-9fa1-7f3fe0349662 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:07.493280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d49fc14a-f548-4b35-9fa1-7f3fe0349662 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:16:07.500584 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d49fc14a-f548-4b35-9fa1-7f3fe0349662 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e" status: 200 len: 1675 microversion: 2.1 time: 0.140624 Oct 15 04:16:07.501154 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1270/2439] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:16:07 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e => generated 1675 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:16:08.517232 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8e639e8a-23b0-4cc8-918f-b85a73ab10ff tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:08.518528 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8e639e8a-23b0-4cc8-918f-b85a73ab10ff tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:08.524337 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8e639e8a-23b0-4cc8-918f-b85a73ab10ff tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:08.524851 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8e639e8a-23b0-4cc8-918f-b85a73ab10ff tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:08.525671 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8e639e8a-23b0-4cc8-918f-b85a73ab10ff tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:08.526167 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8e639e8a-23b0-4cc8-918f-b85a73ab10ff tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:08.589077 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8e639e8a-23b0-4cc8-918f-b85a73ab10ff tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987993288a1a42dfa808e39eab41c82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2f64c8564f447d84849db55e0b0573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:16:08.596907 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8e639e8a-23b0-4cc8-918f-b85a73ab10ff tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e" status: 200 len: 1607 microversion: 2.1 time: 0.083323 Oct 15 04:16:08.597464 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1170/2440] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:16:08 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e => generated 1607 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:16:08.920088 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-665cd97d-a524-4ed3-940f-be8f7f1eeb8c req-2600dff9-09ca-4398-92c2-91da0a084a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aac61cb-6478-4440-93fa-bdc4d748b09e", "name": "network-vif-deleted", "tag": "c92d7dd8-897b-4c6e-b2a2-767e2bcfa2eb"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:16:08.923572 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:16:08.923572 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 04:16:08.935051 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-665cd97d-a524-4ed3-940f-be8f7f1eeb8c req-2600dff9-09ca-4398-92c2-91da0a084a47 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:08.935935 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-665cd97d-a524-4ed3-940f-be8f7f1eeb8c req-2600dff9-09ca-4398-92c2-91da0a084a47 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:08.951862 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-665cd97d-a524-4ed3-940f-be8f7f1eeb8c req-2600dff9-09ca-4398-92c2-91da0a084a47 service nova] Creating event network-vif-deleted:c92d7dd8-897b-4c6e-b2a2-767e2bcfa2eb for instance 0aac61cb-6478-4440-93fa-bdc4d748b09e on hv-cinder-81410 Oct 15 04:16:08.958332 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-665cd97d-a524-4ed3-940f-be8f7f1eeb8c req-2600dff9-09ca-4398-92c2-91da0a084a47 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045939 Oct 15 04:16:08.960004 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1271/2441] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:16:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:16:09.614047 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ca13ed3a-b634-42aa-b2c2-9f22438b4ac5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:09.614653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ca13ed3a-b634-42aa-b2c2-9f22438b4ac5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:09.621312 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca13ed3a-b634-42aa-b2c2-9f22438b4ac5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:09.621753 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca13ed3a-b634-42aa-b2c2-9f22438b4ac5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:09.622677 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca13ed3a-b634-42aa-b2c2-9f22438b4ac5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:09.623256 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ca13ed3a-b634-42aa-b2c2-9f22438b4ac5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:09.641970 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-ca13ed3a-b634-42aa-b2c2-9f22438b4ac5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] HTTP exception thrown: Instance 0aac61cb-6478-4440-93fa-bdc4d748b09e could not be found. Oct 15 04:16:09.643057 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ca13ed3a-b634-42aa-b2c2-9f22438b4ac5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Returning 404 to user: Instance 0aac61cb-6478-4440-93fa-bdc4d748b09e could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 04:16:09.644107 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ca13ed3a-b634-42aa-b2c2-9f22438b4ac5 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e" status: 404 len: 111 microversion: 2.1 time: 0.033706 Oct 15 04:16:09.645117 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1171/2442] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:16:09 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 04:16:09.654512 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-92bd5d02-baed-4cfc-895c-8f597cac0b3a tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '.version_select at 0x7f4abd60c5e0>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:09.675276 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-92bd5d02-baed-4cfc-895c-8f597cac0b3a tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-466423041" status: 202 len: 0 microversion: 2.1 time: 0.025264 Oct 15 04:16:09.675885 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1272/2443] 10.222.0.30 () {58 vars in 1217 bytes} [Fri Oct 15 04:16:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-466423041 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 04:16:12.581426 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b3922938-4a5b-49da-ac6a-16af43dd1a91 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:12.581914 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-b3922938-4a5b-49da-ac6a-16af43dd1a91 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:12.587749 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b3922938-4a5b-49da-ac6a-16af43dd1a91 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:12.588383 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b3922938-4a5b-49da-ac6a-16af43dd1a91 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:12.589150 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b3922938-4a5b-49da-ac6a-16af43dd1a91 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:12.589576 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-b3922938-4a5b-49da-ac6a-16af43dd1a91 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:12.603462 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-b3922938-4a5b-49da-ac6a-16af43dd1a91 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] HTTP exception thrown: Instance 0aac61cb-6478-4440-93fa-bdc4d748b09e could not be found. Oct 15 04:16:12.604082 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-b3922938-4a5b-49da-ac6a-16af43dd1a91 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Returning 404 to user: Instance 0aac61cb-6478-4440-93fa-bdc4d748b09e could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 04:16:12.604894 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-b3922938-4a5b-49da-ac6a-16af43dd1a91 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e" status: 404 len: 111 microversion: 2.1 time: 0.027740 Oct 15 04:16:12.605417 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1172/2444] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 04:16:12 2021] DELETE /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 04:16:12.613303 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1d22acaf-9e5e-4cb2-919a-0cc1aedcef29 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:12.614034 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-1d22acaf-9e5e-4cb2-919a-0cc1aedcef29 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: 0aac61cb-6478-4440-93fa-bdc4d748b09e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:12.620024 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1d22acaf-9e5e-4cb2-919a-0cc1aedcef29 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:12.620474 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1d22acaf-9e5e-4cb2-919a-0cc1aedcef29 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:12.621350 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1d22acaf-9e5e-4cb2-919a-0cc1aedcef29 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:12.621789 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-1d22acaf-9e5e-4cb2-919a-0cc1aedcef29 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:12.634852 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.wsgi [None req-1d22acaf-9e5e-4cb2-919a-0cc1aedcef29 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] HTTP exception thrown: Instance 0aac61cb-6478-4440-93fa-bdc4d748b09e could not be found. Oct 15 04:16:12.635446 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-1d22acaf-9e5e-4cb2-919a-0cc1aedcef29 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Returning 404 to user: Instance 0aac61cb-6478-4440-93fa-bdc4d748b09e could not be found. {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 04:16:12.636300 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-1d22acaf-9e5e-4cb2-919a-0cc1aedcef29 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e" status: 404 len: 111 microversion: 2.1 time: 0.026721 Oct 15 04:16:12.636829 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1273/2445] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:16:12 2021] GET /compute/v2.1/servers/0aac61cb-6478-4440-93fa-bdc4d748b09e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 04:16:13.760967 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a451127b-fe1e-4c3f-a05b-c21782df0293 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:13.761457 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-a451127b-fe1e-4c3f-a05b-c21782df0293 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:13.767143 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a451127b-fe1e-4c3f-a05b-c21782df0293 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:13.767625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a451127b-fe1e-4c3f-a05b-c21782df0293 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:13.768401 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a451127b-fe1e-4c3f-a05b-c21782df0293 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:13.768830 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-a451127b-fe1e-4c3f-a05b-c21782df0293 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:13.782245 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-a451127b-fe1e-4c3f-a05b-c21782df0293 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] HTTP exception thrown: Instance ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e could not be found. Oct 15 04:16:13.782812 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-a451127b-fe1e-4c3f-a05b-c21782df0293 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Returning 404 to user: Instance ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 04:16:13.784686 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-a451127b-fe1e-4c3f-a05b-c21782df0293 tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 404 len: 111 microversion: 2.1 time: 0.027080 Oct 15 04:16:13.785470 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1173/2446] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 04:16:13 2021] DELETE /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 04:16:13.793334 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-93e6c7e6-ffd3-4c7e-b2e4-cc9989ccac7d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:13.793940 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-93e6c7e6-ffd3-4c7e-b2e4-cc9989ccac7d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] [instance: ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:13.800359 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-93e6c7e6-ffd3-4c7e-b2e4-cc9989ccac7d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:13.800812 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-93e6c7e6-ffd3-4c7e-b2e4-cc9989ccac7d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:13.801567 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-93e6c7e6-ffd3-4c7e-b2e4-cc9989ccac7d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:13.802074 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-93e6c7e6-ffd3-4c7e-b2e4-cc9989ccac7d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:13.815748 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.wsgi [None req-93e6c7e6-ffd3-4c7e-b2e4-cc9989ccac7d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] HTTP exception thrown: Instance ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e could not be found. Oct 15 04:16:13.816342 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-93e6c7e6-ffd3-4c7e-b2e4-cc9989ccac7d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] Returning 404 to user: Instance ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e could not be found. {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 04:16:13.817198 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-93e6c7e6-ffd3-4c7e-b2e4-cc9989ccac7d tempest-AttachVolumeTestJSON-2048639827 tempest-AttachVolumeTestJSON-2048639827-project] 10.222.0.30 "GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e" status: 404 len: 111 microversion: 2.1 time: 0.027482 Oct 15 04:16:13.817782 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1274/2447] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:16:13 2021] GET /compute/v2.1/servers/ee1d4c0f-4a84-49a1-b60f-1e5fdd97415e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 04:16:18.276135 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ad8b21cb-d10b-40f3-89e6-3ce23ab820da tempest-VolumesGetTestJSON-1581005857 tempest-VolumesGetTestJSON-1581005857-project] Action: 'create', calling method: .version_select at 0x7f4abcaa5ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-651394949", "metadata": {"Type": "work"}}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:16:18.560518 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ad8b21cb-d10b-40f3-89e6-3ce23ab820da tempest-VolumesGetTestJSON-1581005857 tempest-VolumesGetTestJSON-1581005857-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.397341 Oct 15 04:16:18.561037 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1174/2448] 10.222.0.30 () {60 vars in 1155 bytes} [Fri Oct 15 04:16:18 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 399 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 15 04:16:18.571981 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-8f902e66-73bc-44b8-afde-7d7d703662b8 tempest-VolumesGetTestJSON-1581005857 tempest-VolumesGetTestJSON-1581005857-project] Calling method '.version_select at 0x7f4abcbcda60>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:18.618734 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-8f902e66-73bc-44b8-afde-7d7d703662b8 tempest-VolumesGetTestJSON-1581005857 tempest-VolumesGetTestJSON-1581005857-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/8ec4d4f7-ee74-41ba-9259-84ad9cc25a14" status: 200 len: 352 microversion: 2.1 time: 0.050312 Oct 15 04:16:18.619328 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1275/2449] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Oct 15 04:16:18 2021] GET /compute/v2.1/os-volumes/8ec4d4f7-ee74-41ba-9259-84ad9cc25a14 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:16:19.631617 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-5f906987-307c-4320-a075-f6b190d5eef5 tempest-VolumesGetTestJSON-1581005857 tempest-VolumesGetTestJSON-1581005857-project] Calling method '.version_select at 0x7f4ac18d81f0>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:19.676600 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-5f906987-307c-4320-a075-f6b190d5eef5 tempest-VolumesGetTestJSON-1581005857 tempest-VolumesGetTestJSON-1581005857-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/8ec4d4f7-ee74-41ba-9259-84ad9cc25a14" status: 200 len: 353 microversion: 2.1 time: 0.049021 Oct 15 04:16:19.677187 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1175/2450] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Oct 15 04:16:19 2021] GET /compute/v2.1/os-volumes/8ec4d4f7-ee74-41ba-9259-84ad9cc25a14 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:16:19.688162 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-0e1b3960-0b6a-4428-aaaa-f462fda97bd4 tempest-VolumesGetTestJSON-1581005857 tempest-VolumesGetTestJSON-1581005857-project] Calling method '.version_select at 0x7f4abcbcdb80>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:19.733357 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-0e1b3960-0b6a-4428-aaaa-f462fda97bd4 tempest-VolumesGetTestJSON-1581005857 tempest-VolumesGetTestJSON-1581005857-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/8ec4d4f7-ee74-41ba-9259-84ad9cc25a14" status: 200 len: 353 microversion: 2.1 time: 0.049145 Oct 15 04:16:19.733911 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1276/2451] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Oct 15 04:16:19 2021] GET /compute/v2.1/os-volumes/8ec4d4f7-ee74-41ba-9259-84ad9cc25a14 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:16:19.749937 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-819842b0-803f-49c5-bb21-2499140c1311 tempest-VolumesGetTestJSON-1581005857 tempest-VolumesGetTestJSON-1581005857-project] Calling method '.version_select at 0x7f4abcac6550>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:19.807180 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-819842b0-803f-49c5-bb21-2499140c1311 tempest-VolumesGetTestJSON-1581005857 tempest-VolumesGetTestJSON-1581005857-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/8ec4d4f7-ee74-41ba-9259-84ad9cc25a14" status: 202 len: 0 microversion: 2.1 time: 0.060715 Oct 15 04:16:19.807764 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1176/2452] 10.222.0.30 () {58 vars in 1247 bytes} [Fri Oct 15 04:16:19 2021] DELETE /compute/v2.1/os-volumes/8ec4d4f7-ee74-41ba-9259-84ad9cc25a14 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 04:16:19.815955 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-dff2165d-8ed8-49b3-9a75-0bd3085b8508 tempest-VolumesGetTestJSON-1581005857 tempest-VolumesGetTestJSON-1581005857-project] Calling method '.version_select at 0x7f4abe7d70d0>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:19.863380 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-dff2165d-8ed8-49b3-9a75-0bd3085b8508 tempest-VolumesGetTestJSON-1581005857 tempest-VolumesGetTestJSON-1581005857-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/8ec4d4f7-ee74-41ba-9259-84ad9cc25a14" status: 200 len: 352 microversion: 2.1 time: 0.051264 Oct 15 04:16:19.864020 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1277/2453] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Oct 15 04:16:19 2021] GET /compute/v2.1/os-volumes/8ec4d4f7-ee74-41ba-9259-84ad9cc25a14 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:16:20.875893 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6576794d-9e3b-400a-ac46-a701c6ebe19f tempest-VolumesGetTestJSON-1581005857 tempest-VolumesGetTestJSON-1581005857-project] Calling method '.version_select at 0x7f4ac18d8550>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:20.901888 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-6576794d-9e3b-400a-ac46-a701c6ebe19f tempest-VolumesGetTestJSON-1581005857 tempest-VolumesGetTestJSON-1581005857-project] HTTP exception thrown: Volume 8ec4d4f7-ee74-41ba-9259-84ad9cc25a14 could not be found. Oct 15 04:16:20.902522 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6576794d-9e3b-400a-ac46-a701c6ebe19f tempest-VolumesGetTestJSON-1581005857 tempest-VolumesGetTestJSON-1581005857-project] Returning 404 to user: Volume 8ec4d4f7-ee74-41ba-9259-84ad9cc25a14 could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 04:16:20.903332 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6576794d-9e3b-400a-ac46-a701c6ebe19f tempest-VolumesGetTestJSON-1581005857 tempest-VolumesGetTestJSON-1581005857-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/8ec4d4f7-ee74-41ba-9259-84ad9cc25a14" status: 404 len: 109 microversion: 2.1 time: 0.031317 Oct 15 04:16:20.903954 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1177/2454] 10.222.0.30 () {58 vars in 1244 bytes} [Fri Oct 15 04:16:20 2021] GET /compute/v2.1/os-volumes/8ec4d4f7-ee74-41ba-9259-84ad9cc25a14 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 04:16:38.240853 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:16:38.241545 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 04:16:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:16:47.452613 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4af05283-1f72-48ab-a169-ec0f28773c92 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-874248411", "imageRef": "0ec12dbd-23ec-4d58-b215-4e3cd5f17594", "flavorRef": "452", "networks": [{"uuid": "295a17c3-ae20-4c08-86de-37b249227dde"}]}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:16:47.503980 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.network.neutron [None req-4af05283-1f72-48ab-a169-ec0f28773c92 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] validate_networks() for [('295a17c3-ae20-4c08-86de-37b249227dde', None, None, None, None, None)] {{(pid=120897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 15 04:16:47.848948 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-4af05283-1f72-48ab-a169-ec0f28773c92 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Flavor limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 04:16:47.849250 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-4af05283-1f72-48ab-a169-ec0f28773c92 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Image limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 04:16:47.849723 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-4af05283-1f72-48ab-a169-ec0f28773c92 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Flavor pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 04:16:47.850130 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-4af05283-1f72-48ab-a169-ec0f28773c92 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Image pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 04:16:47.851281 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-4af05283-1f72-48ab-a169-ec0f28773c92 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 04:16:47.866796 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4af05283-1f72-48ab-a169-ec0f28773c92 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:47.867337 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4af05283-1f72-48ab-a169-ec0f28773c92 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:47.868317 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4af05283-1f72-48ab-a169-ec0f28773c92 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:47.869068 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4af05283-1f72-48ab-a169-ec0f28773c92 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:47.889070 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-4af05283-1f72-48ab-a169-ec0f28773c92 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Getting quotas for project 989f5cd4f7b04ef699892d61ea100130. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 04:16:47.893336 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-4af05283-1f72-48ab-a169-ec0f28773c92 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Getting quotas for user c5000c775b4a4162b27d6fec841d7f2e and project 989f5cd4f7b04ef699892d61ea100130. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 04:16:47.908304 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4af05283-1f72-48ab-a169-ec0f28773c92 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Going to run 1 instances... {{(pid=120897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 15 04:16:47.911043 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4af05283-1f72-48ab-a169-ec0f28773c92 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 5c416962-45b3-446b-a17d-3c10ef4c2374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ec12dbd-23ec-4d58-b215-4e3cd5f17594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 15 04:16:47.958571 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4af05283-1f72-48ab-a169-ec0f28773c92 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510282 Oct 15 04:16:47.959377 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1278/2455] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Oct 15 04:16:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 04:16:47.970138 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-cc76082e-6061-4e25-934e-e67893cc6cc6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:47.970745 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-cc76082e-6061-4e25-934e-e67893cc6cc6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 5c416962-45b3-446b-a17d-3c10ef4c2374] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:48.029714 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-cc76082e-6061-4e25-934e-e67893cc6cc6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:16:48.036289 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-cc76082e-6061-4e25-934e-e67893cc6cc6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374" status: 200 len: 1213 microversion: 2.1 time: 0.070637 Oct 15 04:16:48.037035 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1178/2456] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:16:47 2021] GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:16:49.052080 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-41e1f7af-f0d3-4423-bc68-0ba085f26da6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:49.052936 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-41e1f7af-f0d3-4423-bc68-0ba085f26da6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 5c416962-45b3-446b-a17d-3c10ef4c2374] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:49.060677 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-41e1f7af-f0d3-4423-bc68-0ba085f26da6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:49.061263 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-41e1f7af-f0d3-4423-bc68-0ba085f26da6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:49.062141 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-41e1f7af-f0d3-4423-bc68-0ba085f26da6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:49.062873 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-41e1f7af-f0d3-4423-bc68-0ba085f26da6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:49.133279 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-41e1f7af-f0d3-4423-bc68-0ba085f26da6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:16:49.140159 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-41e1f7af-f0d3-4423-bc68-0ba085f26da6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374" status: 200 len: 1271 microversion: 2.1 time: 0.092156 Oct 15 04:16:49.140712 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1279/2457] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:16:49 2021] GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 04:16:50.158248 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2ff83206-db51-4ca0-9b68-73753ee3830c tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:50.158848 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2ff83206-db51-4ca0-9b68-73753ee3830c tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 5c416962-45b3-446b-a17d-3c10ef4c2374] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:50.165761 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2ff83206-db51-4ca0-9b68-73753ee3830c tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:50.166214 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2ff83206-db51-4ca0-9b68-73753ee3830c tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:50.166982 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2ff83206-db51-4ca0-9b68-73753ee3830c tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:50.167417 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2ff83206-db51-4ca0-9b68-73753ee3830c tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:50.300219 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2ff83206-db51-4ca0-9b68-73753ee3830c tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:16:50.309126 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2ff83206-db51-4ca0-9b68-73753ee3830c tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374" status: 200 len: 1313 microversion: 2.1 time: 0.154705 Oct 15 04:16:50.309844 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1179/2458] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:16:50 2021] GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:16:50.418850 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-795ef213-1537-468a-841f-0741bf680f88 req-bc7daf5d-60d3-4923-a255-98b136694050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c416962-45b3-446b-a17d-3c10ef4c2374", "tag": "3eb2b947-ca62-4af3-8445-919fa226db71"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:16:50.420575 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:16:50.420575 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 04:16:50.433619 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-795ef213-1537-468a-841f-0741bf680f88 req-bc7daf5d-60d3-4923-a255-98b136694050 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:50.434155 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-795ef213-1537-468a-841f-0741bf680f88 req-bc7daf5d-60d3-4923-a255-98b136694050 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:50.445586 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-795ef213-1537-468a-841f-0741bf680f88 req-bc7daf5d-60d3-4923-a255-98b136694050 service nova] Creating event network-changed:3eb2b947-ca62-4af3-8445-919fa226db71 for instance 5c416962-45b3-446b-a17d-3c10ef4c2374 on hv-cinder-81410 Oct 15 04:16:50.451027 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-795ef213-1537-468a-841f-0741bf680f88 req-bc7daf5d-60d3-4923-a255-98b136694050 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036208 Oct 15 04:16:50.451607 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1280/2459] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:16:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:16:51.326108 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2b21774d-693c-43c0-9d13-55d6fbb542cd tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:51.326706 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2b21774d-693c-43c0-9d13-55d6fbb542cd tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 5c416962-45b3-446b-a17d-3c10ef4c2374] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:51.332402 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b21774d-693c-43c0-9d13-55d6fbb542cd tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:51.332846 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b21774d-693c-43c0-9d13-55d6fbb542cd tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:51.333632 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b21774d-693c-43c0-9d13-55d6fbb542cd tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:51.334060 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2b21774d-693c-43c0-9d13-55d6fbb542cd tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:51.456449 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2b21774d-693c-43c0-9d13-55d6fbb542cd tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:16:51.463434 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2b21774d-693c-43c0-9d13-55d6fbb542cd tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374" status: 200 len: 1313 microversion: 2.1 time: 0.140938 Oct 15 04:16:51.464020 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1180/2460] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:16:51 2021] GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374 => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:16:52.480246 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-16a5112d-0424-43b2-8064-9f7be9cfa388 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:52.480932 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-16a5112d-0424-43b2-8064-9f7be9cfa388 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 5c416962-45b3-446b-a17d-3c10ef4c2374] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:52.486969 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16a5112d-0424-43b2-8064-9f7be9cfa388 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:52.487407 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16a5112d-0424-43b2-8064-9f7be9cfa388 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:52.488174 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16a5112d-0424-43b2-8064-9f7be9cfa388 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:52.488598 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-16a5112d-0424-43b2-8064-9f7be9cfa388 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:52.608466 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-16a5112d-0424-43b2-8064-9f7be9cfa388 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:16:52.615578 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-16a5112d-0424-43b2-8064-9f7be9cfa388 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374" status: 200 len: 1313 microversion: 2.1 time: 0.139291 Oct 15 04:16:52.616742 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1281/2461] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:16:52 2021] GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374 => generated 1313 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:16:53.632569 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-4476ce41-c785-4b99-b751-92fba764ccd9 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:53.633085 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-4476ce41-c785-4b99-b751-92fba764ccd9 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 5c416962-45b3-446b-a17d-3c10ef4c2374] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:53.639073 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4476ce41-c785-4b99-b751-92fba764ccd9 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:53.639522 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4476ce41-c785-4b99-b751-92fba764ccd9 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:53.640307 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4476ce41-c785-4b99-b751-92fba764ccd9 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:53.640744 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-4476ce41-c785-4b99-b751-92fba764ccd9 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:53.759625 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-4476ce41-c785-4b99-b751-92fba764ccd9 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:16:53.766744 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-4476ce41-c785-4b99-b751-92fba764ccd9 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374" status: 200 len: 1313 microversion: 2.1 time: 0.137970 Oct 15 04:16:53.767304 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1181/2462] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:16:53 2021] GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374 => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:16:54.784444 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ea054e43-d0c5-436e-95f7-48b59a65c5d9 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:54.785843 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ea054e43-d0c5-436e-95f7-48b59a65c5d9 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 5c416962-45b3-446b-a17d-3c10ef4c2374] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:54.792550 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea054e43-d0c5-436e-95f7-48b59a65c5d9 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:54.793068 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea054e43-d0c5-436e-95f7-48b59a65c5d9 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:54.794007 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea054e43-d0c5-436e-95f7-48b59a65c5d9 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:54.794448 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-ea054e43-d0c5-436e-95f7-48b59a65c5d9 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:54.920132 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ea054e43-d0c5-436e-95f7-48b59a65c5d9 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:16:54.927445 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ea054e43-d0c5-436e-95f7-48b59a65c5d9 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374" status: 200 len: 1313 microversion: 2.1 time: 0.147668 Oct 15 04:16:54.928033 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1182/2463] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:16:54 2021] GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 04:16:54.961280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-c04fe923-650f-47f6-89a1-923d695e81d5 req-0211ce13-946b-4400-93e0-2c9db7cefe61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c416962-45b3-446b-a17d-3c10ef4c2374", "name": "network-vif-plugged", "status": "completed", "tag": "3eb2b947-ca62-4af3-8445-919fa226db71"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:16:54.962814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:16:54.962814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 04:16:54.970012 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-c04fe923-650f-47f6-89a1-923d695e81d5 req-0211ce13-946b-4400-93e0-2c9db7cefe61 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:54.970509 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-c04fe923-650f-47f6-89a1-923d695e81d5 req-0211ce13-946b-4400-93e0-2c9db7cefe61 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:54.983211 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-c04fe923-650f-47f6-89a1-923d695e81d5 req-0211ce13-946b-4400-93e0-2c9db7cefe61 service nova] Creating event network-vif-plugged:3eb2b947-ca62-4af3-8445-919fa226db71 for instance 5c416962-45b3-446b-a17d-3c10ef4c2374 on hv-cinder-81410 Oct 15 04:16:54.987956 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-c04fe923-650f-47f6-89a1-923d695e81d5 req-0211ce13-946b-4400-93e0-2c9db7cefe61 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210451 Oct 15 04:16:54.988516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1282/2464] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:16:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:16:55.945146 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-440b99b4-7b22-4147-9b11-1f253d6be7e6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:55.945766 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-440b99b4-7b22-4147-9b11-1f253d6be7e6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 5c416962-45b3-446b-a17d-3c10ef4c2374] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:55.951529 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-440b99b4-7b22-4147-9b11-1f253d6be7e6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:55.952009 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-440b99b4-7b22-4147-9b11-1f253d6be7e6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:55.952763 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-440b99b4-7b22-4147-9b11-1f253d6be7e6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:55.953191 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-440b99b4-7b22-4147-9b11-1f253d6be7e6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:56.077667 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-440b99b4-7b22-4147-9b11-1f253d6be7e6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:16:56.085038 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-440b99b4-7b22-4147-9b11-1f253d6be7e6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374" status: 200 len: 1313 microversion: 2.1 time: 0.144052 Oct 15 04:16:56.086004 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1183/2465] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:16:55 2021] GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374 => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:16:57.102913 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-df9f4658-6df3-4756-93e5-ef31a86ea083 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:57.103590 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-df9f4658-6df3-4756-93e5-ef31a86ea083 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 5c416962-45b3-446b-a17d-3c10ef4c2374] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:57.109591 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df9f4658-6df3-4756-93e5-ef31a86ea083 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:57.110035 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df9f4658-6df3-4756-93e5-ef31a86ea083 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:57.110782 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df9f4658-6df3-4756-93e5-ef31a86ea083 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:57.111208 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-df9f4658-6df3-4756-93e5-ef31a86ea083 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:57.228164 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-df9f4658-6df3-4756-93e5-ef31a86ea083 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:16:57.235346 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-df9f4658-6df3-4756-93e5-ef31a86ea083 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374" status: 200 len: 1498 microversion: 2.1 time: 0.136975 Oct 15 04:16:57.235929 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1283/2466] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:16:57 2021] GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374 => generated 1498 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:16:57.592064 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-36f148fd-b4b6-44bc-831f-4e6f5ca8d6ee tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:57.592588 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-36f148fd-b4b6-44bc-831f-4e6f5ca8d6ee tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 5c416962-45b3-446b-a17d-3c10ef4c2374] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:57.598139 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-36f148fd-b4b6-44bc-831f-4e6f5ca8d6ee tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:57.598579 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-36f148fd-b4b6-44bc-831f-4e6f5ca8d6ee tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:57.599319 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-36f148fd-b4b6-44bc-831f-4e6f5ca8d6ee tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:57.599776 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-36f148fd-b4b6-44bc-831f-4e6f5ca8d6ee tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:57.623583 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-36f148fd-b4b6-44bc-831f-4e6f5ca8d6ee tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 5c416962-45b3-446b-a17d-3c10ef4c2374] Going to try to terminate instance {{(pid=120899) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 15 04:16:57.697494 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-36f148fd-b4b6-44bc-831f-4e6f5ca8d6ee tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374" status: 204 len: 0 microversion: 2.1 time: 0.108619 Oct 15 04:16:57.698180 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1184/2467] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 04:16:57 2021] DELETE /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 04:16:57.706152 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-584a9206-19c8-4829-8657-f50d560f7c2d tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:57.706763 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-584a9206-19c8-4829-8657-f50d560f7c2d tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 5c416962-45b3-446b-a17d-3c10ef4c2374] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:57.713074 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-584a9206-19c8-4829-8657-f50d560f7c2d tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:57.713523 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-584a9206-19c8-4829-8657-f50d560f7c2d tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:57.714281 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-584a9206-19c8-4829-8657-f50d560f7c2d tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:57.714716 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-584a9206-19c8-4829-8657-f50d560f7c2d tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:57.832292 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-584a9206-19c8-4829-8657-f50d560f7c2d tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:16:57.839980 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-584a9206-19c8-4829-8657-f50d560f7c2d tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374" status: 200 len: 1504 microversion: 2.1 time: 0.137408 Oct 15 04:16:57.840539 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1284/2468] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:16:57 2021] GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374 => generated 1504 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:16:58.857569 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-006b2741-9007-4624-91c4-d715c1b1b9c0 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:16:58.858264 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-006b2741-9007-4624-91c4-d715c1b1b9c0 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 5c416962-45b3-446b-a17d-3c10ef4c2374] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:16:58.863925 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-006b2741-9007-4624-91c4-d715c1b1b9c0 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:58.864371 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-006b2741-9007-4624-91c4-d715c1b1b9c0 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:58.865116 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-006b2741-9007-4624-91c4-d715c1b1b9c0 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:58.865547 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-006b2741-9007-4624-91c4-d715c1b1b9c0 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:58.982600 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-006b2741-9007-4624-91c4-d715c1b1b9c0 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:16:58.989699 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-006b2741-9007-4624-91c4-d715c1b1b9c0 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374" status: 200 len: 1504 microversion: 2.1 time: 0.136107 Oct 15 04:16:58.990256 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1185/2469] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:16:58 2021] GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374 => generated 1504 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:16:59.453527 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-58e8bab5-d1ab-48c3-af7f-8292719178ea req-2715766d-20d2-4943-b87f-c34aa5a8b8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c416962-45b3-446b-a17d-3c10ef4c2374", "name": "network-vif-deleted", "tag": "3eb2b947-ca62-4af3-8445-919fa226db71"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:16:59.455952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:16:59.455952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 04:16:59.468260 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-58e8bab5-d1ab-48c3-af7f-8292719178ea req-2715766d-20d2-4943-b87f-c34aa5a8b8f0 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:16:59.468700 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-58e8bab5-d1ab-48c3-af7f-8292719178ea req-2715766d-20d2-4943-b87f-c34aa5a8b8f0 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:16:59.479701 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-58e8bab5-d1ab-48c3-af7f-8292719178ea req-2715766d-20d2-4943-b87f-c34aa5a8b8f0 service nova] Creating event network-vif-deleted:3eb2b947-ca62-4af3-8445-919fa226db71 for instance 5c416962-45b3-446b-a17d-3c10ef4c2374 on hv-cinder-81410 Oct 15 04:16:59.484491 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-58e8bab5-d1ab-48c3-af7f-8292719178ea req-2715766d-20d2-4943-b87f-c34aa5a8b8f0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035542 Oct 15 04:16:59.485136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1285/2470] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:16:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:17:00.006497 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e24fa5d8-7ac4-45af-9aa8-0cfbc143ed7b tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:00.007105 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-e24fa5d8-7ac4-45af-9aa8-0cfbc143ed7b tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 5c416962-45b3-446b-a17d-3c10ef4c2374] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:00.012868 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e24fa5d8-7ac4-45af-9aa8-0cfbc143ed7b tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:00.013314 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e24fa5d8-7ac4-45af-9aa8-0cfbc143ed7b tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:00.014068 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e24fa5d8-7ac4-45af-9aa8-0cfbc143ed7b tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:00.014500 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-e24fa5d8-7ac4-45af-9aa8-0cfbc143ed7b tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:00.027407 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.wsgi [None req-e24fa5d8-7ac4-45af-9aa8-0cfbc143ed7b tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] HTTP exception thrown: Instance 5c416962-45b3-446b-a17d-3c10ef4c2374 could not be found. Oct 15 04:17:00.027950 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-e24fa5d8-7ac4-45af-9aa8-0cfbc143ed7b tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Returning 404 to user: Instance 5c416962-45b3-446b-a17d-3c10ef4c2374 could not be found. {{(pid=120899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 04:17:00.028747 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-e24fa5d8-7ac4-45af-9aa8-0cfbc143ed7b tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374" status: 404 len: 111 microversion: 2.1 time: 0.025954 Oct 15 04:17:00.029253 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1186/2471] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:00 2021] GET /compute/v2.1/servers/5c416962-45b3-446b-a17d-3c10ef4c2374 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 04:17:00.120862 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-857e89be-22c9-4372-b982-fdf92717a538 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1179772631", "imageRef": "0ec12dbd-23ec-4d58-b215-4e3cd5f17594", "flavorRef": "452", "networks": [{"uuid": "295a17c3-ae20-4c08-86de-37b249227dde"}]}} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:17:00.168894 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.network.neutron [None req-857e89be-22c9-4372-b982-fdf92717a538 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] validate_networks() for [('295a17c3-ae20-4c08-86de-37b249227dde', None, None, None, None, None)] {{(pid=120897) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 15 04:17:00.500467 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-857e89be-22c9-4372-b982-fdf92717a538 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Flavor limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 04:17:00.501041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-857e89be-22c9-4372-b982-fdf92717a538 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Image limits 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 04:17:00.501349 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-857e89be-22c9-4372-b982-fdf92717a538 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Flavor pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 04:17:00.501777 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-857e89be-22c9-4372-b982-fdf92717a538 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Image pref 0:0:0 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 04:17:00.502186 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.virt.hardware [None req-857e89be-22c9-4372-b982-fdf92717a538 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120897) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 04:17:00.513277 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-857e89be-22c9-4372-b982-fdf92717a538 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:00.514041 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-857e89be-22c9-4372-b982-fdf92717a538 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:00.514986 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-857e89be-22c9-4372-b982-fdf92717a538 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:00.515607 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-857e89be-22c9-4372-b982-fdf92717a538 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:00.532353 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-857e89be-22c9-4372-b982-fdf92717a538 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Getting quotas for project 989f5cd4f7b04ef699892d61ea100130. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 04:17:00.536019 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.quota [None req-857e89be-22c9-4372-b982-fdf92717a538 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Getting quotas for user c5000c775b4a4162b27d6fec841d7f2e and project 989f5cd4f7b04ef699892d61ea100130. Resources: {'cores', 'instances', 'ram'} {{(pid=120897) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 04:17:00.546285 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-857e89be-22c9-4372-b982-fdf92717a538 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Going to run 1 instances... {{(pid=120897) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 15 04:17:00.548679 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-857e89be-22c9-4372-b982-fdf92717a538 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 2459381a-05f6-462d-bacf-b44f501ebfa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ec12dbd-23ec-4d58-b215-4e3cd5f17594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120897) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 15 04:17:00.592921 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-857e89be-22c9-4372-b982-fdf92717a538 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.475993 Oct 15 04:17:00.593554 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1286/2472] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Oct 15 04:17:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 04:17:00.604203 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-ad7483f4-6a4e-4d3b-8aca-6b9bf08b4419 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:00.604836 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-ad7483f4-6a4e-4d3b-8aca-6b9bf08b4419 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 2459381a-05f6-462d-bacf-b44f501ebfa9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:00.654315 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-ad7483f4-6a4e-4d3b-8aca-6b9bf08b4419 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:00.660758 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-ad7483f4-6a4e-4d3b-8aca-6b9bf08b4419 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9" status: 200 len: 1214 microversion: 2.1 time: 0.060716 Oct 15 04:17:00.661317 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1187/2473] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:00 2021] GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9 => generated 1214 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:01.677907 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f003886f-fe10-4369-97a0-37d45f6b3f68 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:01.678543 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f003886f-fe10-4369-97a0-37d45f6b3f68 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 2459381a-05f6-462d-bacf-b44f501ebfa9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:01.684502 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f003886f-fe10-4369-97a0-37d45f6b3f68 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:01.684948 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f003886f-fe10-4369-97a0-37d45f6b3f68 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:01.685698 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f003886f-fe10-4369-97a0-37d45f6b3f68 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:01.686197 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f003886f-fe10-4369-97a0-37d45f6b3f68 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:01.746412 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f003886f-fe10-4369-97a0-37d45f6b3f68 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:01.753648 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f003886f-fe10-4369-97a0-37d45f6b3f68 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9" status: 200 len: 1272 microversion: 2.1 time: 0.079449 Oct 15 04:17:01.754211 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1287/2474] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:01 2021] GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9 => generated 1272 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:02.639017 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-6609763f-1f96-40b1-b957-8aeb7a58d8fe req-367a2b2e-cf68-47fa-9bcf-7c54804e8f1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2459381a-05f6-462d-bacf-b44f501ebfa9", "tag": "2a644651-6b57-4225-9856-8edba3abb414"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:17:02.640613 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:17:02.640613 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 04:17:02.649636 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-6609763f-1f96-40b1-b957-8aeb7a58d8fe req-367a2b2e-cf68-47fa-9bcf-7c54804e8f1e service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:02.650135 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-6609763f-1f96-40b1-b957-8aeb7a58d8fe req-367a2b2e-cf68-47fa-9bcf-7c54804e8f1e service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:02.661423 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-6609763f-1f96-40b1-b957-8aeb7a58d8fe req-367a2b2e-cf68-47fa-9bcf-7c54804e8f1e service nova] Creating event network-changed:2a644651-6b57-4225-9856-8edba3abb414 for instance 2459381a-05f6-462d-bacf-b44f501ebfa9 on hv-cinder-81410 Oct 15 04:17:02.666350 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-6609763f-1f96-40b1-b957-8aeb7a58d8fe req-367a2b2e-cf68-47fa-9bcf-7c54804e8f1e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030924 Oct 15 04:17:02.667098 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1188/2475] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:17:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:17:02.771104 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-94ed257d-fb38-4cf7-832e-ee053996f3ee tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:02.771745 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-94ed257d-fb38-4cf7-832e-ee053996f3ee tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 2459381a-05f6-462d-bacf-b44f501ebfa9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:02.777923 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-94ed257d-fb38-4cf7-832e-ee053996f3ee tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:02.778373 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-94ed257d-fb38-4cf7-832e-ee053996f3ee tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:02.779136 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-94ed257d-fb38-4cf7-832e-ee053996f3ee tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:02.779571 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-94ed257d-fb38-4cf7-832e-ee053996f3ee tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:02.901587 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-94ed257d-fb38-4cf7-832e-ee053996f3ee tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:02.908774 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-94ed257d-fb38-4cf7-832e-ee053996f3ee tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9" status: 200 len: 1314 microversion: 2.1 time: 0.141407 Oct 15 04:17:02.909333 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1288/2476] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:02 2021] GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:03.925800 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-9bb0e540-bde6-484a-88e5-6c902300977e tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:03.926494 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-9bb0e540-bde6-484a-88e5-6c902300977e tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 2459381a-05f6-462d-bacf-b44f501ebfa9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:03.933192 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bb0e540-bde6-484a-88e5-6c902300977e tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:03.933641 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bb0e540-bde6-484a-88e5-6c902300977e tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:03.934395 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bb0e540-bde6-484a-88e5-6c902300977e tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:03.934824 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-9bb0e540-bde6-484a-88e5-6c902300977e tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:04.050918 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-9bb0e540-bde6-484a-88e5-6c902300977e tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:04.057956 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-9bb0e540-bde6-484a-88e5-6c902300977e tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9" status: 200 len: 1314 microversion: 2.1 time: 0.136224 Oct 15 04:17:04.058516 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1189/2477] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:03 2021] GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9 => generated 1314 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:05.074201 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-c5106f18-cc07-4a4e-bee8-6d3a2f9b8a0d tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:05.074860 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-c5106f18-cc07-4a4e-bee8-6d3a2f9b8a0d tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 2459381a-05f6-462d-bacf-b44f501ebfa9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:05.080547 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c5106f18-cc07-4a4e-bee8-6d3a2f9b8a0d tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:05.081002 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c5106f18-cc07-4a4e-bee8-6d3a2f9b8a0d tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:05.081767 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c5106f18-cc07-4a4e-bee8-6d3a2f9b8a0d tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:05.082203 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-c5106f18-cc07-4a4e-bee8-6d3a2f9b8a0d tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:05.203233 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-c5106f18-cc07-4a4e-bee8-6d3a2f9b8a0d tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:05.210951 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-c5106f18-cc07-4a4e-bee8-6d3a2f9b8a0d tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9" status: 200 len: 1314 microversion: 2.1 time: 0.140528 Oct 15 04:17:05.211521 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1289/2478] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:05 2021] GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9 => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:06.227202 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-fdfe2b39-f808-499e-b3db-022fcc1c8784 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:06.227846 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-fdfe2b39-f808-499e-b3db-022fcc1c8784 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 2459381a-05f6-462d-bacf-b44f501ebfa9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:06.233639 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fdfe2b39-f808-499e-b3db-022fcc1c8784 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:06.234085 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fdfe2b39-f808-499e-b3db-022fcc1c8784 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:06.234837 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fdfe2b39-f808-499e-b3db-022fcc1c8784 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:06.235268 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-fdfe2b39-f808-499e-b3db-022fcc1c8784 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:06.353680 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-fdfe2b39-f808-499e-b3db-022fcc1c8784 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:06.360664 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-fdfe2b39-f808-499e-b3db-022fcc1c8784 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9" status: 200 len: 1314 microversion: 2.1 time: 0.137720 Oct 15 04:17:06.361219 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1190/2479] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:06 2021] GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9 => generated 1314 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:06.808337 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-48ae01d4-4d2e-44c4-818e-9da95a39dcd7 req-a8bc0584-5312-4ea0-b410-4d3c2bc86fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2459381a-05f6-462d-bacf-b44f501ebfa9", "name": "network-vif-plugged", "status": "completed", "tag": "2a644651-6b57-4225-9856-8edba3abb414"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:17:06.809957 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:17:06.809957 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 04:17:06.817382 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-48ae01d4-4d2e-44c4-818e-9da95a39dcd7 req-a8bc0584-5312-4ea0-b410-4d3c2bc86fd0 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:06.817907 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-48ae01d4-4d2e-44c4-818e-9da95a39dcd7 req-a8bc0584-5312-4ea0-b410-4d3c2bc86fd0 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:06.830194 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-48ae01d4-4d2e-44c4-818e-9da95a39dcd7 req-a8bc0584-5312-4ea0-b410-4d3c2bc86fd0 service nova] Creating event network-vif-plugged:2a644651-6b57-4225-9856-8edba3abb414 for instance 2459381a-05f6-462d-bacf-b44f501ebfa9 on hv-cinder-81410 Oct 15 04:17:06.835787 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-48ae01d4-4d2e-44c4-818e-9da95a39dcd7 req-a8bc0584-5312-4ea0-b410-4d3c2bc86fd0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031134 Oct 15 04:17:06.836525 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1290/2480] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:17:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:17:07.377533 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-2229f774-af4a-4d42-afc3-052a7d69bd05 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:07.378091 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-2229f774-af4a-4d42-afc3-052a7d69bd05 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 2459381a-05f6-462d-bacf-b44f501ebfa9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:07.383899 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2229f774-af4a-4d42-afc3-052a7d69bd05 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:07.384353 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2229f774-af4a-4d42-afc3-052a7d69bd05 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:07.385109 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2229f774-af4a-4d42-afc3-052a7d69bd05 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:07.385546 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-2229f774-af4a-4d42-afc3-052a7d69bd05 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:07.501555 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-2229f774-af4a-4d42-afc3-052a7d69bd05 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:07.508774 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-2229f774-af4a-4d42-afc3-052a7d69bd05 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9" status: 200 len: 1314 microversion: 2.1 time: 0.134911 Oct 15 04:17:07.509334 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1191/2481] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:07 2021] GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9 => generated 1314 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:08.526394 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-ec3b3aa0-d537-493d-ad32-731747284402 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:08.527021 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-ec3b3aa0-d537-493d-ad32-731747284402 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 2459381a-05f6-462d-bacf-b44f501ebfa9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:08.532917 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ec3b3aa0-d537-493d-ad32-731747284402 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:08.533365 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ec3b3aa0-d537-493d-ad32-731747284402 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:08.534116 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ec3b3aa0-d537-493d-ad32-731747284402 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:08.534548 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-ec3b3aa0-d537-493d-ad32-731747284402 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:08.655171 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-ec3b3aa0-d537-493d-ad32-731747284402 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:08.662226 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-ec3b3aa0-d537-493d-ad32-731747284402 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9" status: 200 len: 1498 microversion: 2.1 time: 0.140444 Oct 15 04:17:08.663385 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1291/2482] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:08 2021] GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9 => generated 1498 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:09.050657 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-0f6ed8e0-211c-4e8e-9075-ba4f7b798b35 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:09.051142 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0f6ed8e0-211c-4e8e-9075-ba4f7b798b35 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 2459381a-05f6-462d-bacf-b44f501ebfa9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:09.056846 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0f6ed8e0-211c-4e8e-9075-ba4f7b798b35 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:09.057290 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0f6ed8e0-211c-4e8e-9075-ba4f7b798b35 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:09.058031 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0f6ed8e0-211c-4e8e-9075-ba4f7b798b35 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:09.058460 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-0f6ed8e0-211c-4e8e-9075-ba4f7b798b35 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:09.082181 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-0f6ed8e0-211c-4e8e-9075-ba4f7b798b35 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 2459381a-05f6-462d-bacf-b44f501ebfa9] Going to try to terminate instance {{(pid=120899) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 15 04:17:09.151847 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-0f6ed8e0-211c-4e8e-9075-ba4f7b798b35 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9" status: 204 len: 0 microversion: 2.1 time: 0.104615 Oct 15 04:17:09.152701 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1192/2483] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 04:17:09 2021] DELETE /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 04:17:09.160767 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-85c07b07-b8ec-420c-b7b2-4102d16c1db6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:09.161374 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-85c07b07-b8ec-420c-b7b2-4102d16c1db6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 2459381a-05f6-462d-bacf-b44f501ebfa9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:09.167039 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-85c07b07-b8ec-420c-b7b2-4102d16c1db6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:09.167489 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-85c07b07-b8ec-420c-b7b2-4102d16c1db6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:09.168275 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-85c07b07-b8ec-420c-b7b2-4102d16c1db6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:09.168709 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-85c07b07-b8ec-420c-b7b2-4102d16c1db6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:09.287898 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-85c07b07-b8ec-420c-b7b2-4102d16c1db6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:09.294906 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-85c07b07-b8ec-420c-b7b2-4102d16c1db6 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9" status: 200 len: 1504 microversion: 2.1 time: 0.137711 Oct 15 04:17:09.295461 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1292/2484] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:09 2021] GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9 => generated 1504 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:10.313145 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-849469cb-417d-4b40-92d4-c7e534f055ab tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:10.313843 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-849469cb-417d-4b40-92d4-c7e534f055ab tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 2459381a-05f6-462d-bacf-b44f501ebfa9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:10.320137 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-849469cb-417d-4b40-92d4-c7e534f055ab tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:10.320592 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-849469cb-417d-4b40-92d4-c7e534f055ab tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:10.321346 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-849469cb-417d-4b40-92d4-c7e534f055ab tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:10.321775 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-849469cb-417d-4b40-92d4-c7e534f055ab tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:10.438651 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-849469cb-417d-4b40-92d4-c7e534f055ab tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:10.445835 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-849469cb-417d-4b40-92d4-c7e534f055ab tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9" status: 200 len: 1504 microversion: 2.1 time: 0.137173 Oct 15 04:17:10.446394 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1193/2485] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:10 2021] GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9 => generated 1504 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:10.892247 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [req-e5d29ea4-462c-4988-960d-64154cff2b58 req-395e45a2-1b81-4f23-90cd-4702d9ceebbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2459381a-05f6-462d-bacf-b44f501ebfa9", "name": "network-vif-deleted", "tag": "2a644651-6b57-4225-9856-8edba3abb414"}]} {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:17:10.894206 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:17:10.894206 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: warnings.warn(msg) Oct 15 04:17:10.901669 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-e5d29ea4-462c-4988-960d-64154cff2b58 req-395e45a2-1b81-4f23-90cd-4702d9ceebbe service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:10.902102 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [req-e5d29ea4-462c-4988-960d-64154cff2b58 req-395e45a2-1b81-4f23-90cd-4702d9ceebbe service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:10.914654 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.compute.server_external_events [req-e5d29ea4-462c-4988-960d-64154cff2b58 req-395e45a2-1b81-4f23-90cd-4702d9ceebbe service nova] Creating event network-vif-deleted:2a644651-6b57-4225-9856-8edba3abb414 for instance 2459381a-05f6-462d-bacf-b44f501ebfa9 on hv-cinder-81410 Oct 15 04:17:10.919578 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [req-e5d29ea4-462c-4988-960d-64154cff2b58 req-395e45a2-1b81-4f23-90cd-4702d9ceebbe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031147 Oct 15 04:17:10.920222 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1293/2486] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:17:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:17:11.464132 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-bba2161e-7dde-4a3e-a904-dee316992211 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:11.464732 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-bba2161e-7dde-4a3e-a904-dee316992211 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 2459381a-05f6-462d-bacf-b44f501ebfa9] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:11.471564 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bba2161e-7dde-4a3e-a904-dee316992211 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:11.472058 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bba2161e-7dde-4a3e-a904-dee316992211 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:11.472810 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bba2161e-7dde-4a3e-a904-dee316992211 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:11.473237 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bba2161e-7dde-4a3e-a904-dee316992211 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:11.505363 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bba2161e-7dde-4a3e-a904-dee316992211 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:11.505795 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-bba2161e-7dde-4a3e-a904-dee316992211 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:11.506819 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.objects.instance [None req-bba2161e-7dde-4a3e-a904-dee316992211 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lazy-loading 'fault' on Instance uuid 2459381a-05f6-462d-bacf-b44f501ebfa9 {{(pid=120899) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 15 04:17:11.551472 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-bba2161e-7dde-4a3e-a904-dee316992211 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5000c775b4a4162b27d6fec841d7f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989f5cd4f7b04ef699892d61ea100130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:11.558919 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-bba2161e-7dde-4a3e-a904-dee316992211 tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9" status: 200 len: 1304 microversion: 2.1 time: 0.099963 Oct 15 04:17:11.559667 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1194/2487] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:11 2021] GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:12.577284 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7ce6287a-f4f6-4201-8cbd-a6458997a54e tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:12.577890 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-7ce6287a-f4f6-4201-8cbd-a6458997a54e tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] [instance: 2459381a-05f6-462d-bacf-b44f501ebfa9] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:12.583869 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7ce6287a-f4f6-4201-8cbd-a6458997a54e tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:12.584830 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7ce6287a-f4f6-4201-8cbd-a6458997a54e tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:12.585571 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7ce6287a-f4f6-4201-8cbd-a6458997a54e tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:12.585995 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-7ce6287a-f4f6-4201-8cbd-a6458997a54e tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:12.598425 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.wsgi [None req-7ce6287a-f4f6-4201-8cbd-a6458997a54e tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] HTTP exception thrown: Instance 2459381a-05f6-462d-bacf-b44f501ebfa9 could not be found. Oct 15 04:17:12.598997 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-7ce6287a-f4f6-4201-8cbd-a6458997a54e tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] Returning 404 to user: Instance 2459381a-05f6-462d-bacf-b44f501ebfa9 could not be found. {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 04:17:12.600454 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-7ce6287a-f4f6-4201-8cbd-a6458997a54e tempest-VolumesActionsTest-383012810 tempest-VolumesActionsTest-383012810-project] 10.222.0.30 "GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9" status: 404 len: 111 microversion: 2.1 time: 0.026620 Oct 15 04:17:12.600969 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1294/2488] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:12 2021] GET /compute/v2.1/servers/2459381a-05f6-462d-bacf-b44f501ebfa9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 04:17:36.089461 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6f9c5151-7cef-4b0e-8dae-b5052da4734e tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2020364307", "imageRef": "0ec12dbd-23ec-4d58-b215-4e3cd5f17594", "flavorRef": "452"}} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:17:36.138400 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.network.neutron [None req-6f9c5151-7cef-4b0e-8dae-b5052da4734e tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] validate_networks() for None {{(pid=120899) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 15 04:17:36.401767 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-6f9c5151-7cef-4b0e-8dae-b5052da4734e tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Flavor limits 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 04:17:36.402217 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-6f9c5151-7cef-4b0e-8dae-b5052da4734e tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Image limits 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 04:17:36.402688 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-6f9c5151-7cef-4b0e-8dae-b5052da4734e tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Flavor pref 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 04:17:36.403096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-6f9c5151-7cef-4b0e-8dae-b5052da4734e tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Image pref 0:0:0 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 04:17:36.403503 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.virt.hardware [None req-6f9c5151-7cef-4b0e-8dae-b5052da4734e tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120899) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 04:17:36.412628 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f9c5151-7cef-4b0e-8dae-b5052da4734e tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:36.413074 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f9c5151-7cef-4b0e-8dae-b5052da4734e tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:36.413862 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f9c5151-7cef-4b0e-8dae-b5052da4734e tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:36.414294 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6f9c5151-7cef-4b0e-8dae-b5052da4734e tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:36.429643 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-6f9c5151-7cef-4b0e-8dae-b5052da4734e tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Getting quotas for project 7620d025b3dc4f9d8780b5991054fd28. Resources: {'cores', 'instances', 'ram'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 15 04:17:36.433452 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.quota [None req-6f9c5151-7cef-4b0e-8dae-b5052da4734e tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Getting quotas for user b84b5179805c47daaf49be4432b0266d and project 7620d025b3dc4f9d8780b5991054fd28. Resources: {'cores', 'instances', 'ram'} {{(pid=120899) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 15 04:17:36.443979 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6f9c5151-7cef-4b0e-8dae-b5052da4734e tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Going to run 1 instances... {{(pid=120899) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 15 04:17:36.446736 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6f9c5151-7cef-4b0e-8dae-b5052da4734e tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] [instance: b2278b43-fbae-44cc-9bcf-be119b453021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ec12dbd-23ec-4d58-b215-4e3cd5f17594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120899) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 15 04:17:36.488555 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6f9c5151-7cef-4b0e-8dae-b5052da4734e tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.403306 Oct 15 04:17:36.489185 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1195/2489] 10.222.0.30 () {60 vars in 1146 bytes} [Fri Oct 15 04:17:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 04:17:36.499007 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-95220b04-7a90-41e4-b5fd-bb44a2256298 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:36.499742 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-95220b04-7a90-41e4-b5fd-bb44a2256298 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] [instance: b2278b43-fbae-44cc-9bcf-be119b453021] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:36.551407 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-95220b04-7a90-41e4-b5fd-bb44a2256298 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84b5179805c47daaf49be4432b0266d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7620d025b3dc4f9d8780b5991054fd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:36.558478 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-95220b04-7a90-41e4-b5fd-bb44a2256298 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] 10.222.0.30 "GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021" status: 200 len: 1215 microversion: 2.1 time: 0.063199 Oct 15 04:17:36.559027 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1295/2490] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:36 2021] GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021 => generated 1215 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:37.575486 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-397deee0-13b9-4936-a63f-10f4102d81d5 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:37.576092 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-397deee0-13b9-4936-a63f-10f4102d81d5 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] [instance: b2278b43-fbae-44cc-9bcf-be119b453021] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:37.582804 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-397deee0-13b9-4936-a63f-10f4102d81d5 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:37.583249 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-397deee0-13b9-4936-a63f-10f4102d81d5 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:37.584048 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-397deee0-13b9-4936-a63f-10f4102d81d5 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:37.584501 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-397deee0-13b9-4936-a63f-10f4102d81d5 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:37.645720 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-397deee0-13b9-4936-a63f-10f4102d81d5 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84b5179805c47daaf49be4432b0266d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7620d025b3dc4f9d8780b5991054fd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:37.653592 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-397deee0-13b9-4936-a63f-10f4102d81d5 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] 10.222.0.30 "GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021" status: 200 len: 1273 microversion: 2.1 time: 0.082010 Oct 15 04:17:37.654158 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1196/2491] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:37 2021] GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021 => generated 1273 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:38.670105 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-bcb25a29-d1ff-4c74-882a-43799b333d8b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:38.670633 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-bcb25a29-d1ff-4c74-882a-43799b333d8b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] [instance: b2278b43-fbae-44cc-9bcf-be119b453021] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:38.676464 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bcb25a29-d1ff-4c74-882a-43799b333d8b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:38.676918 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bcb25a29-d1ff-4c74-882a-43799b333d8b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:38.677693 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bcb25a29-d1ff-4c74-882a-43799b333d8b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:38.678129 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-bcb25a29-d1ff-4c74-882a-43799b333d8b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:38.802248 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-bcb25a29-d1ff-4c74-882a-43799b333d8b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84b5179805c47daaf49be4432b0266d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7620d025b3dc4f9d8780b5991054fd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:38.812518 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-bcb25a29-d1ff-4c74-882a-43799b333d8b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] 10.222.0.30 "GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021" status: 200 len: 1315 microversion: 2.1 time: 0.145676 Oct 15 04:17:38.813084 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1296/2492] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:38 2021] GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:38.989501 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-22deed26-18c1-40c6-8f51-3873c8da9485 req-a71bc33f-07d5-4f42-8265-431b6f5ebfb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2278b43-fbae-44cc-9bcf-be119b453021", "tag": "7fc7a7ac-f741-4a24-8597-3b2be2430e6a"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:17:38.992583 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:17:38.992583 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 04:17:39.000009 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-22deed26-18c1-40c6-8f51-3873c8da9485 req-a71bc33f-07d5-4f42-8265-431b6f5ebfb8 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:39.001223 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-22deed26-18c1-40c6-8f51-3873c8da9485 req-a71bc33f-07d5-4f42-8265-431b6f5ebfb8 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:39.022111 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-22deed26-18c1-40c6-8f51-3873c8da9485 req-a71bc33f-07d5-4f42-8265-431b6f5ebfb8 service nova] Creating event network-changed:7fc7a7ac-f741-4a24-8597-3b2be2430e6a for instance b2278b43-fbae-44cc-9bcf-be119b453021 on hv-cinder-81410 Oct 15 04:17:39.028115 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-22deed26-18c1-40c6-8f51-3873c8da9485 req-a71bc33f-07d5-4f42-8265-431b6f5ebfb8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046031 Oct 15 04:17:39.028767 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1197/2493] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:17:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:17:39.828909 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-eab51f5d-9961-4375-a283-99f5ca8333d6 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:39.829512 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-eab51f5d-9961-4375-a283-99f5ca8333d6 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] [instance: b2278b43-fbae-44cc-9bcf-be119b453021] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:39.835277 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eab51f5d-9961-4375-a283-99f5ca8333d6 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:39.835754 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eab51f5d-9961-4375-a283-99f5ca8333d6 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:39.836516 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eab51f5d-9961-4375-a283-99f5ca8333d6 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:39.836950 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-eab51f5d-9961-4375-a283-99f5ca8333d6 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:39.956507 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-eab51f5d-9961-4375-a283-99f5ca8333d6 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84b5179805c47daaf49be4432b0266d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7620d025b3dc4f9d8780b5991054fd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:39.963507 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-eab51f5d-9961-4375-a283-99f5ca8333d6 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] 10.222.0.30 "GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021" status: 200 len: 1315 microversion: 2.1 time: 0.138265 Oct 15 04:17:39.964098 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1297/2494] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:39 2021] GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021 => generated 1315 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:40.979757 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-6a35328f-8628-45f0-8e83-288525d14e94 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:40.980444 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-6a35328f-8628-45f0-8e83-288525d14e94 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] [instance: b2278b43-fbae-44cc-9bcf-be119b453021] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:40.986427 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6a35328f-8628-45f0-8e83-288525d14e94 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:40.986721 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6a35328f-8628-45f0-8e83-288525d14e94 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:40.987469 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6a35328f-8628-45f0-8e83-288525d14e94 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:40.987935 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-6a35328f-8628-45f0-8e83-288525d14e94 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:41.114415 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-6a35328f-8628-45f0-8e83-288525d14e94 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84b5179805c47daaf49be4432b0266d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7620d025b3dc4f9d8780b5991054fd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:41.122075 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-6a35328f-8628-45f0-8e83-288525d14e94 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] 10.222.0.30 "GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021" status: 200 len: 1315 microversion: 2.1 time: 0.146330 Oct 15 04:17:41.122645 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1198/2495] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:40 2021] GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:42.138762 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-d9484a5e-6e86-4099-b1ad-c18c6c5e987b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:42.139373 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-d9484a5e-6e86-4099-b1ad-c18c6c5e987b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] [instance: b2278b43-fbae-44cc-9bcf-be119b453021] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:42.145172 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d9484a5e-6e86-4099-b1ad-c18c6c5e987b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:42.145640 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d9484a5e-6e86-4099-b1ad-c18c6c5e987b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:42.146394 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d9484a5e-6e86-4099-b1ad-c18c6c5e987b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:42.146831 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-d9484a5e-6e86-4099-b1ad-c18c6c5e987b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:42.265632 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-d9484a5e-6e86-4099-b1ad-c18c6c5e987b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84b5179805c47daaf49be4432b0266d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7620d025b3dc4f9d8780b5991054fd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:42.272731 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-d9484a5e-6e86-4099-b1ad-c18c6c5e987b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] 10.222.0.30 "GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021" status: 200 len: 1315 microversion: 2.1 time: 0.137619 Oct 15 04:17:42.273280 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1298/2496] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:42 2021] GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021 => generated 1315 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:42.934653 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-8675ac59-5df3-466a-afa5-72ff5360594d req-59316a7d-d584-458e-b252-d5f69757c6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2278b43-fbae-44cc-9bcf-be119b453021", "name": "network-vif-plugged", "status": "completed", "tag": "7fc7a7ac-f741-4a24-8597-3b2be2430e6a"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:17:42.936174 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:17:42.936174 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 04:17:42.943305 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-8675ac59-5df3-466a-afa5-72ff5360594d req-59316a7d-d584-458e-b252-d5f69757c6b4 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:42.943773 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-8675ac59-5df3-466a-afa5-72ff5360594d req-59316a7d-d584-458e-b252-d5f69757c6b4 service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:42.954496 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-8675ac59-5df3-466a-afa5-72ff5360594d req-59316a7d-d584-458e-b252-d5f69757c6b4 service nova] Creating event network-vif-plugged:7fc7a7ac-f741-4a24-8597-3b2be2430e6a for instance b2278b43-fbae-44cc-9bcf-be119b453021 on hv-cinder-81410 Oct 15 04:17:42.959286 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-8675ac59-5df3-466a-afa5-72ff5360594d req-59316a7d-d584-458e-b252-d5f69757c6b4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028244 Oct 15 04:17:42.959902 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1199/2497] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:17:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 04:17:43.289517 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-615705a2-adc2-4e82-a8c8-b3ceca0375bc tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:43.290114 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-615705a2-adc2-4e82-a8c8-b3ceca0375bc tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] [instance: b2278b43-fbae-44cc-9bcf-be119b453021] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:43.295881 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-615705a2-adc2-4e82-a8c8-b3ceca0375bc tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:43.296325 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-615705a2-adc2-4e82-a8c8-b3ceca0375bc tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:43.297069 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-615705a2-adc2-4e82-a8c8-b3ceca0375bc tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:43.297497 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-615705a2-adc2-4e82-a8c8-b3ceca0375bc tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:43.413319 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-615705a2-adc2-4e82-a8c8-b3ceca0375bc tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84b5179805c47daaf49be4432b0266d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7620d025b3dc4f9d8780b5991054fd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:43.420389 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-615705a2-adc2-4e82-a8c8-b3ceca0375bc tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] 10.222.0.30 "GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021" status: 200 len: 1315 microversion: 2.1 time: 0.135113 Oct 15 04:17:43.420968 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1299/2498] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:43 2021] GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021 => generated 1315 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:44.437009 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-8ab325eb-ac12-4c05-b22d-ab6c8c5c37b9 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:44.437697 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-8ab325eb-ac12-4c05-b22d-ab6c8c5c37b9 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] [instance: b2278b43-fbae-44cc-9bcf-be119b453021] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:44.443660 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8ab325eb-ac12-4c05-b22d-ab6c8c5c37b9 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:44.444129 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8ab325eb-ac12-4c05-b22d-ab6c8c5c37b9 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:44.444933 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8ab325eb-ac12-4c05-b22d-ab6c8c5c37b9 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:44.445361 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-8ab325eb-ac12-4c05-b22d-ab6c8c5c37b9 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:44.562043 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-8ab325eb-ac12-4c05-b22d-ab6c8c5c37b9 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84b5179805c47daaf49be4432b0266d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7620d025b3dc4f9d8780b5991054fd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:44.569113 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-8ab325eb-ac12-4c05-b22d-ab6c8c5c37b9 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] 10.222.0.30 "GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021" status: 200 len: 1465 microversion: 2.1 time: 0.136365 Oct 15 04:17:44.569686 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1200/2499] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:44 2021] GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021 => generated 1465 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:44.605424 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-4bfb21ff-b031-4084-8c87-723cc141ffe4 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:44.605922 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4bfb21ff-b031-4084-8c87-723cc141ffe4 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] [instance: b2278b43-fbae-44cc-9bcf-be119b453021] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:44.611575 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4bfb21ff-b031-4084-8c87-723cc141ffe4 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:44.612126 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4bfb21ff-b031-4084-8c87-723cc141ffe4 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:44.612886 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4bfb21ff-b031-4084-8c87-723cc141ffe4 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:44.613321 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-4bfb21ff-b031-4084-8c87-723cc141ffe4 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:44.637783 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-4bfb21ff-b031-4084-8c87-723cc141ffe4 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] [instance: b2278b43-fbae-44cc-9bcf-be119b453021] Going to try to terminate instance {{(pid=120897) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 15 04:17:44.708215 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-4bfb21ff-b031-4084-8c87-723cc141ffe4 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021" status: 204 len: 0 microversion: 2.1 time: 0.106526 Oct 15 04:17:44.712512 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1300/2500] 10.222.0.30 () {58 vars in 1238 bytes} [Fri Oct 15 04:17:44 2021] DELETE /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 04:17:44.717559 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [None req-baed488e-239f-4754-bfc4-3b7a6429ee75 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Calling method '>' {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:44.718172 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.compute.api [None req-baed488e-239f-4754-bfc4-3b7a6429ee75 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] [instance: b2278b43-fbae-44cc-9bcf-be119b453021] Fetching instance by UUID {{(pid=120899) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:44.723984 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baed488e-239f-4754-bfc4-3b7a6429ee75 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:44.724433 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baed488e-239f-4754-bfc4-3b7a6429ee75 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:44.725191 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baed488e-239f-4754-bfc4-3b7a6429ee75 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:44.725629 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [None req-baed488e-239f-4754-bfc4-3b7a6429ee75 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:44.846983 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.policy [None req-baed488e-239f-4754-bfc4-3b7a6429ee75 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84b5179805c47daaf49be4432b0266d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7620d025b3dc4f9d8780b5991054fd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120899) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:44.854068 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [None req-baed488e-239f-4754-bfc4-3b7a6429ee75 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] 10.222.0.30 "GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021" status: 200 len: 1471 microversion: 2.1 time: 0.140358 Oct 15 04:17:44.854621 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1201/2501] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:44 2021] GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021 => generated 1471 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:45.871227 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-f8883d24-1244-49d1-ab21-dc0a99e70c96 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:45.871959 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-f8883d24-1244-49d1-ab21-dc0a99e70c96 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] [instance: b2278b43-fbae-44cc-9bcf-be119b453021] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:45.877668 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f8883d24-1244-49d1-ab21-dc0a99e70c96 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:45.878121 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f8883d24-1244-49d1-ab21-dc0a99e70c96 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:45.878882 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f8883d24-1244-49d1-ab21-dc0a99e70c96 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:45.879316 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-f8883d24-1244-49d1-ab21-dc0a99e70c96 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:45.997323 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.policy [None req-f8883d24-1244-49d1-ab21-dc0a99e70c96 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84b5179805c47daaf49be4432b0266d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7620d025b3dc4f9d8780b5991054fd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120897) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 04:17:46.004438 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-f8883d24-1244-49d1-ab21-dc0a99e70c96 tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] 10.222.0.30 "GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021" status: 200 len: 1471 microversion: 2.1 time: 0.137830 Oct 15 04:17:46.004997 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1301/2502] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:45 2021] GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021 => generated 1471 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 04:17:46.464967 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG nova.api.openstack.wsgi [req-8cfcbc75-56dc-41f7-8838-6c1c6174662d req-c8b12caf-2e52-4f99-a98f-73d3dd13aade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2278b43-fbae-44cc-9bcf-be119b453021", "name": "network-vif-deleted", "tag": "7fc7a7ac-f741-4a24-8597-3b2be2430e6a"}]} {{(pid=120899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 04:17:46.466499 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 04:17:46.466499 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: warnings.warn(msg) Oct 15 04:17:46.473650 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-8cfcbc75-56dc-41f7-8838-6c1c6174662d req-c8b12caf-2e52-4f99-a98f-73d3dd13aade service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:46.474096 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: DEBUG oslo_concurrency.lockutils [req-8cfcbc75-56dc-41f7-8838-6c1c6174662d req-c8b12caf-2e52-4f99-a98f-73d3dd13aade service nova] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:46.486508 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.compute.server_external_events [req-8cfcbc75-56dc-41f7-8838-6c1c6174662d req-c8b12caf-2e52-4f99-a98f-73d3dd13aade service nova] Creating event network-vif-deleted:7fc7a7ac-f741-4a24-8597-3b2be2430e6a for instance b2278b43-fbae-44cc-9bcf-be119b453021 on hv-cinder-81410 Oct 15 04:17:46.491326 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO nova.api.openstack.requestlog [req-8cfcbc75-56dc-41f7-8838-6c1c6174662d req-c8b12caf-2e52-4f99-a98f-73d3dd13aade service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029897 Oct 15 04:17:46.492517 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: [pid: 120899|app: 0|req: 1202/2503] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Oct 15 04:17:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 04:17:47.021205 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-488fcbb7-ac70-4330-bd39-23d9317a763b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Calling method '>' {{(pid=120897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 04:17:47.021814 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.compute.api [None req-488fcbb7-ac70-4330-bd39-23d9317a763b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] [instance: b2278b43-fbae-44cc-9bcf-be119b453021] Fetching instance by UUID {{(pid=120897) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 15 04:17:47.028058 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-488fcbb7-ac70-4330-bd39-23d9317a763b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:47.028512 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-488fcbb7-ac70-4330-bd39-23d9317a763b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:47.029272 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-488fcbb7-ac70-4330-bd39-23d9317a763b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 15 04:17:47.029707 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG oslo_concurrency.lockutils [None req-488fcbb7-ac70-4330-bd39-23d9317a763b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Lock "43587adf-3b37-4daa-a785-c641cb70328e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 15 04:17:47.043263 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.wsgi [None req-488fcbb7-ac70-4330-bd39-23d9317a763b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] HTTP exception thrown: Instance b2278b43-fbae-44cc-9bcf-be119b453021 could not be found. Oct 15 04:17:47.043952 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: DEBUG nova.api.openstack.wsgi [None req-488fcbb7-ac70-4330-bd39-23d9317a763b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] Returning 404 to user: Instance b2278b43-fbae-44cc-9bcf-be119b453021 could not be found. {{(pid=120897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 15 04:17:47.044759 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO nova.api.openstack.requestlog [None req-488fcbb7-ac70-4330-bd39-23d9317a763b tempest-VolumesNegativeTest-1167555515 tempest-VolumesNegativeTest-1167555515-project] 10.222.0.30 "GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021" status: 404 len: 111 microversion: 2.1 time: 0.027364 Oct 15 04:17:47.045277 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: [pid: 120897|app: 0|req: 1302/2504] 10.222.0.30 () {58 vars in 1235 bytes} [Fri Oct 15 04:17:47 2021] GET /compute/v2.1/servers/b2278b43-fbae-44cc-9bcf-be119b453021 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 04:18:30.915748 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:18:30.916318 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 04:18:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:19:58.259764 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:19:58.260224 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 04:19:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:20:10.759880 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:20:10.760453 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 04:20:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:20:11.118155 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:20:11.118639 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 04:20:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:21:45.753872 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:21:45.754445 dv-cinder-814100-1-iscsi devstack@n-api.service[120897]: Fri Oct 15 04:21:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 15 04:21:50.932910 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 04:21:50.933425 dv-cinder-814100-1-iscsi devstack@n-api.service[120899]: Fri Oct 15 04:21:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!